2024-09-13T15:50:28.877 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T15:50:28.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T15:50:28.991 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903774 branch: wip-rishabh-testing-20240910.095512-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/cap-flush} email: null first_in_suite: false job_id: '7903774' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240910.095512-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Replacing daemon mds.a sha1: 50bbe7f395997dcd871813949c49addbbf630361 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 50bbe7f395997dcd871813949c49addbbf630361 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.095512-reef sha1: 50bbe7f395997dcd871813949c49addbbf630361 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1152 sha1: 50bbe7f395997dcd871813949c49addbbf630361 sleep_before_teardown: 0 subset: 984/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.095512-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 50bbe7f395997dcd871813949c49addbbf630361 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBg389IDn6KPhZGUeTjqOjobFEAhuqorQiIVojfzabedejj808zKr46Khk0crzdggIeuKSG5LIR5sKf3dwEhRps= smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFfMXDy79iTNVaD2PiJ7NhmR3uXOTx1MICvLx47HwKQl3nfYnsTm2rbZviSQnGTRDQmiWO5L7eu8ZoMABBA1YOE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_cap_flush teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:36:41 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T15:50:28.992 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa; will attempt to use it 2024-09-13T15:50:28.992 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa/tasks 2024-09-13T15:50:28.993 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T15:50:28.994 INFO:teuthology.task.internal:Checking packages... 2024-09-13T15:50:29.015 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '50bbe7f395997dcd871813949c49addbbf630361' 2024-09-13T15:50:29.015 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T15:50:29.015 INFO:teuthology.packaging:ref: None 2024-09-13T15:50:29.015 INFO:teuthology.packaging:tag: None 2024-09-13T15:50:29.015 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.095512-reef 2024-09-13T15:50:29.016 INFO:teuthology.packaging:sha1: 50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:50:29.016 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240910.095512-reef 2024-09-13T15:50:29.162 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-850.g50bbe7f3 2024-09-13T15:50:29.164 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T15:50:29.170 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T15:50:29.170 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T15:50:29.193 INFO:teuthology.task.internal:Saving configuration 2024-09-13T15:50:29.210 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T15:50:29.216 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T15:50:29.248 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903774', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 15:45:28.637403', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBg389IDn6KPhZGUeTjqOjobFEAhuqorQiIVojfzabedejj808zKr46Khk0crzdggIeuKSG5LIR5sKf3dwEhRps='} 2024-09-13T15:50:29.274 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903774', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 15:45:28.639323', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFfMXDy79iTNVaD2PiJ7NhmR3uXOTx1MICvLx47HwKQl3nfYnsTm2rbZviSQnGTRDQmiWO5L7eu8ZoMABBA1YOE='} 2024-09-13T15:50:29.274 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T15:50:29.281 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-13T15:50:29.281 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-13T15:50:29.281 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T15:50:29.353 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f50b1017be0>, signals=[15]) 2024-09-13T15:50:29.354 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T15:50:29.360 INFO:teuthology.task.internal:Opening connections... 2024-09-13T15:50:29.360 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-09-13T15:50:29.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:50:29.448 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-09-13T15:50:29.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:50:29.533 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T15:50:29.539 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-09-13T15:50:29.558 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-09-13T15:50:29.558 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-09-13T15:50:29.617 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-09-13T15:50:29.617 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-09-13T15:50:29.617 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-09-13T15:50:29.617 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-09-13T15:50:29.617 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-09-13T15:50:29.617 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-09-13T15:50:29.617 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T15:50:29.617 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-09-13T15:50:29.618 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-09-13T15:50:29.618 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T15:50:29.618 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-09-13T15:50:29.618 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T15:50:29.618 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T15:50:29.618 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T15:50:29.619 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-09-13T15:50:29.654 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-09-13T15:50:29.673 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-09-13T15:50:29.673 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-09-13T15:50:29.731 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-09-13T15:50:29.731 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2024-09-13T15:50:29.731 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-09-13T15:50:29.731 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-09-13T15:50:29.731 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2024-09-13T15:50:29.731 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2024-09-13T15:50:29.732 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T15:50:29.732 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-09-13T15:50:29.732 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2024-09-13T15:50:29.732 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T15:50:29.732 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-09-13T15:50:29.732 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T15:50:29.732 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T15:50:29.732 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T15:50:29.732 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-09-13T15:50:29.762 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T15:50:29.771 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T15:50:29.777 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T15:50:29.777 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-09-13T15:50:29.780 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-09-13T15:50:29.797 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T15:50:29.804 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T15:50:29.805 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-09-13T15:50:29.838 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-09-13T15:50:29.954 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T15:50:30.024 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T15:50:30.039 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-13T15:50:30.040 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-13T15:50:30.040 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-13T15:50:30.040 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T15:50:30.041 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T15:50:30.060 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:50:30.060 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-13T15:50:30.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:50:30.072 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-13T15:50:30.244 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T15:50:30.244 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T15:50:30.244 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-09-13T15:50:30.245 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T15:50:30.246 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T15:50:30.246 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-13T15:50:30.265 INFO:teuthology.orchestra.run.smithi070.stdout:5.14.0-503.el9.x86_64 2024-09-13T15:50:30.265 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-503.el9.x86_64 2024-09-13T15:50:30.266 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T15:50:30.266 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T15:50:30.267 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum upgrade -y linux-firmware 2024-09-13T15:50:30.267 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T15:50:30.267 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T15:50:30.267 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum upgrade -y linux-firmware 2024-09-13T15:50:32.800 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-13T15:50:33.776 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.2 MB 00:01 2024-09-13T15:50:35.843 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-13T15:50:36.918 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 20 MB 00:02 2024-09-13T15:50:40.035 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-13T15:50:41.401 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.5 MB 00:00 2024-09-13T15:50:41.493 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 19 kB 00:00 2024-09-13T15:50:42.806 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-13T15:50:42.868 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-13T15:50:43.822 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-13T15:50:48.328 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-13T15:50:49.136 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-13T15:50:50.455 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-13T15:50:50.456 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-13T15:50:50.456 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-13T15:50:50.550 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T15:50:50.550 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T15:50:50.707 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-13T15:50:50.707 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-13T15:50:50.709 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi070.front.sepia.ceph.com to complete... 2024-09-13T15:50:51.227 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-13T15:50:51.228 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-13T15:50:51.228 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-13T15:50:51.335 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-13T15:50:51.336 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T15:50:51.489 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-13T15:50:51.489 DEBUG:teuthology.orchestra.run.smithi107:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-13T15:50:51.492 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi107.front.sepia.ceph.com to complete... 2024-09-13T15:51:01.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13 15:51:01 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-13T15:51:01.885 INFO:teuthology.orchestra.run.smithi070.stderr:FINISHED --2024-09-13 15:51:01-- 2024-09-13T15:51:01.885 INFO:teuthology.orchestra.run.smithi070.stderr:Total wall clock time: 11s 2024-09-13T15:51:01.885 INFO:teuthology.orchestra.run.smithi070.stderr:Downloaded: 1 files, 343M in 11s (31.6 MB/s) 2024-09-13T15:51:01.889 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T15:51:01.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-13T15:51:02.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13 15:51:02 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-13T15:51:02.934 INFO:teuthology.orchestra.run.smithi107.stderr:FINISHED --2024-09-13 15:51:02-- 2024-09-13T15:51:02.934 INFO:teuthology.orchestra.run.smithi107.stderr:Total wall clock time: 11s 2024-09-13T15:51:02.934 INFO:teuthology.orchestra.run.smithi107.stderr:Downloaded: 1 files, 343M in 11s (31.2 MB/s) 2024-09-13T15:51:02.936 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-13T15:51:02.937 DEBUG:teuthology.orchestra.run.smithi107:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-13T15:51:03.999 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying... ######################################## 2024-09-13T15:51:04.181 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing... ######################################## 2024-09-13T15:51:04.294 INFO:teuthology.orchestra.run.smithi070.stdout:Updating / installing... 2024-09-13T15:51:05.262 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying... ######################################## 2024-09-13T15:51:05.482 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing... ######################################## 2024-09-13T15:51:05.590 INFO:teuthology.orchestra.run.smithi107.stdout:Updating / installing... 2024-09-13T15:51:12.242 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-13T15:51:13.543 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-13T15:51:52.463 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi070.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-13T15:51:52.464 DEBUG:teuthology.orchestra.run.smithi070:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-13T15:51:52.554 INFO:teuthology.orchestra.run.smithi070.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:51:52.554 INFO:teuthology.orchestra.run.smithi070.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:51:52.554 INFO:teuthology.orchestra.run.smithi070.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:51:52.554 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:51:52.554 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-13T15:51:52.554 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-13T15:51:52.554 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-13T15:51:52.554 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-13T15:51:52.554 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-13T15:51:52.555 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-13T15:51:52.555 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T15:51:52.555 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T15:51:52.555 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T15:51:52.555 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T15:51:52.555 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T15:51:52.555 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T15:51:52.555 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T15:51:52.555 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-13T15:51:52.555 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T15:51:52.555 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T15:51:52.555 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T15:51:52.556 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T15:51:52.556 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T15:51:52.556 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T15:51:52.556 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T15:51:52.556 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T15:51:52.556 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T15:51:52.556 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T15:51:52.556 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T15:51:52.556 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T15:51:52.556 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-13T15:51:52.556 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-13T15:51:52.556 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-13T15:51:52.556 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T15:51:52.557 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-13T15:51:52.557 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T15:51:52.557 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T15:51:52.557 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T15:51:52.557 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-13T15:51:52.557 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T15:51:52.557 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T15:51:52.557 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T15:51:52.557 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-13T15:51:52.557 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T15:51:52.557 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T15:51:52.557 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T15:51:52.557 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T15:51:52.558 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T15:51:52.558 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T15:51:52.558 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T15:51:52.558 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T15:51:52.558 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T15:51:52.558 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T15:51:52.558 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T15:51:52.558 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T15:51:52.558 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T15:51:52.558 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T15:51:52.558 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T15:51:52.558 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T15:51:52.558 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T15:51:52.558 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T15:51:52.559 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T15:51:52.559 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T15:51:52.559 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T15:51:52.559 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T15:51:52.559 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T15:51:52.559 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-13T15:51:52.559 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-13T15:51:52.559 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T15:51:52.559 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T15:51:52.559 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T15:51:52.559 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T15:51:52.559 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T15:51:52.559 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T15:51:52.560 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T15:51:52.560 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T15:51:52.560 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T15:51:52.560 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T15:51:52.560 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T15:51:52.560 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T15:51:52.560 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T15:51:52.560 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T15:51:52.560 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T15:51:52.560 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T15:51:52.560 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T15:51:52.560 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T15:51:52.560 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T15:51:52.560 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T15:51:52.561 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T15:51:52.561 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T15:51:52.561 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-13T15:51:52.561 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-13T15:51:52.561 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T15:51:52.561 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T15:51:52.561 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T15:51:52.561 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T15:51:52.561 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T15:51:52.561 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T15:51:52.561 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T15:51:52.561 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-13T15:51:52.561 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T15:51:52.562 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T15:51:52.562 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-13T15:51:52.562 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T15:51:52.562 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T15:51:52.562 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T15:51:52.562 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T15:51:52.562 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T15:51:52.562 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T15:51:52.562 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T15:51:52.562 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T15:51:52.562 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T15:51:52.562 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T15:51:52.562 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T15:51:52.562 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T15:51:52.563 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T15:51:52.563 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T15:51:52.563 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T15:51:52.563 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T15:51:52.563 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T15:51:52.563 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T15:51:52.563 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T15:51:52.563 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T15:51:52.563 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T15:51:52.563 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T15:51:52.563 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T15:51:52.563 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T15:51:52.563 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T15:51:52.564 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T15:51:52.564 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T15:51:52.564 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T15:51:52.564 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T15:51:52.564 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T15:51:52.564 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T15:51:52.564 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T15:51:52.564 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T15:51:52.564 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T15:51:52.564 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T15:51:52.564 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-13T15:51:52.564 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T15:51:52.565 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T15:51:52.565 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T15:51:52.565 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T15:51:52.565 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T15:51:52.565 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T15:51:52.565 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T15:51:52.565 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T15:51:52.565 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T15:51:52.565 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T15:51:52.565 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T15:51:52.565 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T15:51:52.565 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T15:51:52.565 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T15:51:52.565 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T15:51:52.566 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T15:51:52.566 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T15:51:52.566 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-13T15:51:52.566 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T15:51:52.566 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-13T15:51:52.566 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-13T15:51:52.566 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-13T15:51:52.566 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-13T15:51:52.566 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-13T15:51:52.566 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T15:51:52.566 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-13T15:51:52.566 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-13T15:51:52.566 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T15:51:52.567 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-13T15:51:52.567 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-13T15:51:52.567 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T15:51:52.567 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T15:51:52.567 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-13T15:51:52.567 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-13T15:51:52.567 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T15:51:52.567 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T15:51:52.567 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-13T15:51:52.567 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T15:51:52.567 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T15:51:52.567 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T15:51:52.567 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-13T15:51:52.567 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-13T15:51:52.568 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T15:51:52.568 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-13T15:51:52.568 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-13T15:51:52.568 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T15:51:52.568 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-13T15:51:52.568 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T15:51:52.568 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-13T15:51:52.568 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T15:51:52.568 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T15:51:52.568 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T15:51:52.568 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T15:51:52.568 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T15:51:52.568 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-13T15:51:52.569 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T15:51:52.569 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T15:51:52.569 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T15:51:52.569 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T15:51:52.569 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T15:51:52.569 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T15:51:52.569 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T15:51:52.569 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-13T15:51:52.569 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T15:51:52.569 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T15:51:52.569 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T15:51:52.569 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-13T15:51:52.569 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-13T15:51:52.570 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T15:51:52.570 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T15:51:52.570 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T15:51:52.570 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-13T15:51:52.570 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-13T15:51:52.570 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-13T15:51:52.570 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-13T15:51:52.570 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-13T15:51:52.570 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-13T15:51:52.570 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T15:51:52.570 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T15:51:52.570 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-13T15:51:52.570 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-13T15:51:52.570 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T15:51:52.571 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-13T15:51:52.571 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-13T15:51:52.571 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T15:51:52.571 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T15:51:52.571 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-13T15:51:52.571 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-13T15:51:52.571 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-13T15:51:52.571 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T15:51:52.571 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-13T15:51:52.571 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T15:51:52.571 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T15:51:52.571 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T15:51:52.571 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-13T15:51:52.571 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T15:51:52.572 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-13T15:51:52.572 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T15:51:52.572 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-13T15:51:52.572 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-13T15:51:52.572 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-13T15:51:52.572 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-13T15:51:52.572 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T15:51:52.572 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-13T15:51:52.572 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T15:51:52.572 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-13T15:51:52.572 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T15:51:52.572 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T15:51:52.573 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T15:51:52.573 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T15:51:52.573 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T15:51:52.573 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T15:51:52.573 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T15:51:52.573 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T15:51:52.573 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T15:51:52.573 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T15:51:52.573 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T15:51:52.573 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T15:51:52.573 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T15:51:52.573 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-13T15:51:52.573 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-13T15:51:52.574 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T15:51:52.574 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-13T15:51:52.574 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T15:51:52.574 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T15:51:52.574 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-13T15:51:52.574 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T15:51:52.574 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T15:51:52.574 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T15:51:52.574 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T15:51:52.574 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T15:51:52.574 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T15:51:52.574 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T15:51:52.574 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T15:51:52.574 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T15:51:52.575 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T15:51:52.575 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T15:51:52.575 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T15:51:52.575 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T15:51:52.575 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T15:51:52.575 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T15:51:52.575 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T15:51:52.575 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T15:51:52.575 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T15:51:52.575 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T15:51:52.575 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T15:51:52.575 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T15:51:52.575 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T15:51:52.575 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T15:51:52.576 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T15:51:52.576 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T15:51:52.576 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T15:51:52.576 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T15:51:52.576 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T15:51:52.576 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T15:51:52.576 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T15:51:52.576 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T15:51:52.576 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T15:51:52.576 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T15:51:52.576 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T15:51:52.576 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T15:51:52.576 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T15:51:52.577 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T15:51:52.577 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T15:51:52.577 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T15:51:52.577 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T15:51:52.577 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T15:51:52.577 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T15:51:52.577 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T15:51:52.577 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T15:51:52.577 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T15:51:52.577 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T15:51:52.577 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T15:51:52.577 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T15:51:52.577 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T15:51:52.578 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T15:51:52.578 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T15:51:52.578 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T15:51:52.578 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T15:51:52.578 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T15:51:52.578 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T15:51:52.578 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T15:51:52.578 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T15:51:52.578 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T15:51:52.578 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T15:51:52.578 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T15:51:52.578 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T15:51:52.578 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T15:51:52.579 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T15:51:52.579 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T15:51:52.579 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-13T15:51:52.579 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T15:51:52.579 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T15:51:52.579 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T15:51:52.579 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-13T15:51:52.579 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T15:51:52.579 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T15:51:52.579 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T15:51:52.579 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T15:51:52.579 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T15:51:52.579 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T15:51:52.579 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T15:51:52.580 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T15:51:52.580 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T15:51:52.580 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T15:51:52.580 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T15:51:52.580 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T15:51:52.580 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T15:51:52.580 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T15:51:52.580 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T15:51:52.580 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T15:51:52.580 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T15:51:52.580 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T15:51:52.580 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T15:51:52.580 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T15:51:52.581 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T15:51:52.581 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T15:51:52.581 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T15:51:52.581 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T15:51:52.581 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T15:51:52.581 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T15:51:52.581 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T15:51:52.581 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T15:51:52.581 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T15:51:52.581 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T15:51:52.581 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T15:51:52.581 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T15:51:52.581 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T15:51:52.582 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T15:51:52.582 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T15:51:52.582 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T15:51:52.582 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T15:51:52.582 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T15:51:52.582 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T15:51:52.582 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T15:51:52.582 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T15:51:52.582 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T15:51:52.582 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T15:51:52.582 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T15:51:52.582 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T15:51:52.582 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T15:51:52.583 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T15:51:52.583 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T15:51:52.583 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T15:51:52.583 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T15:51:52.583 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T15:51:52.583 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T15:51:52.583 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T15:51:52.583 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T15:51:52.583 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T15:51:52.583 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T15:51:52.583 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T15:51:52.583 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T15:51:52.583 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T15:51:52.584 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T15:51:52.584 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T15:51:52.584 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T15:51:52.584 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T15:51:52.584 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T15:51:52.584 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T15:51:52.584 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T15:51:52.584 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T15:51:52.584 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T15:51:52.584 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T15:51:52.585 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T15:51:52.585 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T15:51:52.585 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T15:51:52.585 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T15:51:52.585 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T15:51:52.585 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T15:51:52.585 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T15:51:52.585 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T15:51:52.585 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T15:51:52.585 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T15:51:52.585 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T15:51:52.585 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T15:51:52.585 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T15:51:52.586 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T15:51:52.586 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T15:51:52.586 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T15:51:52.586 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T15:51:52.586 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T15:51:52.586 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T15:51:52.586 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-13T15:51:52.586 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T15:51:52.586 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T15:51:52.586 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T15:51:52.586 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T15:51:52.586 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T15:51:52.586 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T15:51:52.587 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T15:51:52.587 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T15:51:52.587 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T15:51:52.587 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T15:51:52.587 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T15:51:52.587 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T15:51:52.587 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T15:51:52.587 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T15:51:52.587 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T15:51:52.587 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T15:51:52.587 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T15:51:52.587 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T15:51:52.587 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T15:51:52.587 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T15:51:52.588 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T15:51:52.588 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T15:51:52.588 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T15:51:52.588 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T15:51:52.588 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T15:51:52.588 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T15:51:52.588 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T15:51:52.588 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T15:51:52.588 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T15:51:52.588 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T15:51:52.588 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T15:51:52.588 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T15:51:52.588 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T15:51:52.589 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T15:51:52.589 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T15:51:52.589 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T15:51:52.589 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T15:51:52.589 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T15:51:52.589 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T15:51:52.589 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T15:51:52.589 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T15:51:52.589 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-13T15:51:52.589 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-13T15:51:52.589 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T15:51:52.589 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T15:51:52.589 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-13T15:51:52.590 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T15:51:52.590 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T15:51:52.590 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T15:51:52.590 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T15:51:52.590 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T15:51:52.590 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T15:51:52.590 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T15:51:52.590 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T15:51:52.590 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T15:51:52.590 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T15:51:52.590 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T15:51:52.590 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T15:51:52.591 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T15:51:52.591 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T15:51:52.591 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T15:51:52.591 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T15:51:52.591 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T15:51:52.591 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T15:51:52.591 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T15:51:52.591 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T15:51:52.591 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T15:51:52.591 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T15:51:52.591 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T15:51:52.591 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-13T15:51:52.591 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T15:51:52.592 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-13T15:51:52.592 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T15:51:52.592 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T15:51:52.592 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-13T15:51:52.592 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-13T15:51:52.592 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T15:51:52.592 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T15:51:52.592 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T15:51:52.592 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T15:51:52.592 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T15:51:52.592 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T15:51:52.592 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T15:51:52.592 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-13T15:51:52.592 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-13T15:51:52.593 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T15:51:52.593 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-13T15:51:52.593 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T15:51:52.593 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-13T15:51:52.593 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T15:51:52.593 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-13T15:51:52.593 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T15:51:52.593 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-13T15:51:52.593 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-13T15:51:52.593 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T15:51:52.593 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-13T15:51:52.593 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T15:51:52.593 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-13T15:51:52.594 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T15:51:52.594 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-13T15:51:52.594 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T15:51:52.594 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-13T15:51:52.594 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T15:51:52.594 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-13T15:51:52.594 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-13T15:51:52.594 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T15:51:52.594 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T15:51:52.594 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T15:51:52.594 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T15:51:52.594 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-13T15:51:52.594 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T15:51:52.594 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-13T15:51:52.595 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T15:51:52.595 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T15:51:52.595 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T15:51:52.595 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T15:51:52.595 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T15:51:52.595 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T15:51:52.595 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T15:51:52.595 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T15:51:52.595 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-13T15:51:52.595 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T15:51:52.595 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-13T15:51:52.595 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T15:51:52.595 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T15:51:52.596 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T15:51:52.596 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T15:51:52.596 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T15:51:52.596 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-13T15:51:52.596 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T15:51:52.596 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T15:51:52.596 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T15:51:52.596 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T15:51:52.596 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-13T15:51:52.596 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T15:51:52.596 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T15:51:52.596 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T15:51:52.596 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T15:51:52.596 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T15:51:52.597 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T15:51:52.597 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T15:51:52.597 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T15:51:52.597 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-13T15:51:52.597 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-13T15:51:52.597 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T15:51:52.597 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T15:51:52.597 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T15:51:52.597 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T15:51:52.597 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T15:51:52.597 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T15:51:52.597 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T15:51:52.598 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T15:51:52.598 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T15:51:52.598 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T15:51:52.598 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T15:51:52.598 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T15:51:52.598 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T15:51:52.598 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T15:51:52.598 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T15:51:52.598 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T15:51:52.598 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-13T15:51:52.598 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T15:51:52.598 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T15:51:52.598 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T15:51:52.598 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T15:51:52.599 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T15:51:52.599 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-13T15:51:52.599 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-13T15:51:52.599 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T15:51:52.599 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T15:51:52.599 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T15:51:52.599 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T15:51:52.599 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T15:51:52.599 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T15:51:52.599 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T15:51:52.599 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-13T15:51:52.599 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T15:51:52.599 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T15:51:52.599 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-13T15:51:52.600 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T15:51:52.600 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T15:51:52.600 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T15:51:52.600 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T15:51:52.600 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-13T15:51:52.600 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-13T15:51:52.600 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T15:51:52.600 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T15:51:52.600 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T15:51:52.600 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T15:51:52.600 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-13T15:51:52.600 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T15:51:52.601 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-13T15:51:52.601 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T15:51:52.601 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T15:51:52.601 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T15:51:52.601 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T15:51:52.601 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T15:51:52.601 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T15:51:52.601 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T15:51:52.601 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-13T15:51:52.601 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T15:51:52.601 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T15:51:52.601 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-13T15:51:52.601 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T15:51:52.601 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T15:51:52.602 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T15:51:52.602 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-13T15:51:52.602 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-13T15:51:52.602 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-13T15:51:52.602 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-13T15:51:52.602 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-13T15:51:52.602 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-13T15:51:52.602 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T15:51:52.602 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T15:51:52.602 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T15:51:52.602 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T15:51:52.602 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-13T15:51:52.602 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T15:51:52.602 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-13T15:51:52.603 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-13T15:51:52.603 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T15:51:52.603 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-13T15:51:52.603 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-13T15:51:52.603 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T15:51:52.603 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T15:51:52.603 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T15:51:52.603 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-13T15:51:52.603 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T15:51:52.603 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T15:51:52.603 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T15:51:52.603 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-13T15:51:52.603 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-13T15:51:52.604 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T15:51:52.604 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T15:51:52.604 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T15:51:52.604 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T15:51:52.604 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-13T15:51:52.604 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T15:51:52.604 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T15:51:52.604 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T15:51:52.604 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T15:51:52.604 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-13T15:51:52.604 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T15:51:52.604 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-13T15:51:52.604 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T15:51:52.604 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-13T15:51:52.605 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T15:51:52.605 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-13T15:51:52.605 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T15:51:52.605 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-13T15:51:52.605 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T15:51:52.605 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T15:51:52.605 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T15:51:52.605 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-13T15:51:52.605 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-13T15:51:52.605 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T15:51:52.605 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-13T15:51:52.605 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T15:51:52.605 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-13T15:51:52.606 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T15:51:52.606 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-13T15:51:52.606 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T15:51:52.606 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T15:51:52.606 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-13T15:51:52.606 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T15:51:52.606 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T15:51:52.606 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-13T15:51:52.606 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T15:51:52.606 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T15:51:52.606 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-13T15:51:52.606 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T15:51:52.606 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T15:51:52.606 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-13T15:51:52.607 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-13T15:51:52.607 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T15:51:52.607 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-13T15:51:52.607 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-13T15:51:52.607 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T15:51:52.607 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-13T15:51:52.607 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T15:51:52.607 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-13T15:51:52.607 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T15:51:52.607 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-13T15:51:52.607 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T15:51:52.607 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-13T15:51:52.607 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T15:51:52.608 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-13T15:51:52.608 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-13T15:51:52.608 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T15:51:52.608 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-13T15:51:52.608 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-13T15:51:52.608 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T15:51:52.608 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T15:51:52.608 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T15:51:52.608 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T15:51:52.608 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T15:51:52.608 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T15:51:52.608 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-13T15:51:52.608 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T15:51:52.609 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T15:51:52.609 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T15:51:52.609 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-13T15:51:52.609 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-13T15:51:52.609 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T15:51:52.609 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T15:51:52.609 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T15:51:52.609 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-13T15:51:52.609 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T15:51:52.609 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-13T15:51:52.609 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T15:51:52.609 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-13T15:51:52.609 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T15:51:52.610 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-13T15:51:52.610 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T15:51:52.610 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-13T15:51:52.610 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T15:51:52.610 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-13T15:51:52.610 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T15:51:52.610 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-13T15:51:52.610 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T15:51:52.610 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-13T15:51:52.610 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T15:51:52.610 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-13T15:51:52.610 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T15:51:52.610 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-13T15:51:52.610 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T15:51:52.611 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-13T15:51:52.611 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T15:51:52.611 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-13T15:51:52.611 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T15:51:52.611 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T15:51:52.611 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-13T15:51:52.611 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T15:51:52.611 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T15:51:52.611 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T15:51:52.611 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-13T15:51:52.611 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-13T15:51:52.611 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T15:51:52.611 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T15:51:52.612 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-13T15:51:52.612 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-13T15:51:52.612 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T15:51:52.612 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-13T15:51:52.612 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T15:51:52.612 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-13T15:51:52.612 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-13T15:51:52.612 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T15:51:52.612 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-13T15:51:52.612 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T15:51:52.612 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T15:51:52.612 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-13T15:51:52.612 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T15:51:52.612 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-13T15:51:52.613 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T15:51:52.613 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-13T15:51:52.613 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T15:51:52.613 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T15:51:52.613 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-13T15:51:52.613 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-13T15:51:52.613 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T15:51:52.613 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T15:51:52.613 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-13T15:51:52.613 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T15:51:52.613 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-13T15:51:52.613 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T15:51:52.614 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-13T15:51:52.614 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T15:51:52.614 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T15:51:52.614 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T15:51:52.614 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T15:51:52.614 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-13T15:51:52.614 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-13T15:51:52.614 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-13T15:51:52.614 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T15:51:52.614 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-13T15:51:52.614 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T15:51:52.615 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-13T15:51:52.615 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T15:51:52.615 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T15:51:52.615 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-13T15:51:52.615 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T15:51:52.615 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T15:51:52.615 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T15:51:52.615 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T15:51:52.615 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-13T15:51:52.615 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-13T15:51:52.615 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T15:51:52.615 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T15:51:52.616 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-13T15:51:52.616 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T15:51:52.616 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T15:51:52.616 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T15:51:52.616 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T15:51:52.616 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-13T15:51:52.616 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T15:51:52.616 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-13T15:51:52.616 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T15:51:52.616 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-13T15:51:52.616 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T15:51:52.616 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T15:51:52.616 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-13T15:51:52.617 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T15:51:52.617 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T15:51:52.617 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-13T15:51:52.617 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T15:51:52.617 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T15:51:52.617 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-13T15:51:52.617 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T15:51:52.617 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-13T15:51:52.617 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T15:51:52.617 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T15:51:52.617 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-13T15:51:52.617 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T15:51:52.617 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T15:51:52.617 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T15:51:52.618 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-13T15:51:52.618 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T15:51:52.618 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T15:51:52.618 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T15:51:52.618 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T15:51:52.618 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T15:51:52.618 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-13T15:51:52.618 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T15:51:52.618 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T15:51:52.618 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-13T15:51:52.618 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T15:51:52.618 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T15:51:52.618 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-13T15:51:52.619 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T15:51:52.619 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T15:51:52.619 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-13T15:51:52.619 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T15:51:52.619 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T15:51:52.619 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T15:51:52.619 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T15:51:52.619 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T15:51:52.619 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-13T15:51:52.619 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T15:51:52.619 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T15:51:52.619 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T15:51:52.619 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T15:51:52.619 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T15:51:52.620 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T15:51:52.620 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T15:51:52.620 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T15:51:52.620 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T15:51:52.620 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T15:51:52.620 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T15:51:52.620 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T15:51:52.620 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-13T15:51:52.620 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T15:51:52.620 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T15:51:52.620 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T15:51:52.620 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-13T15:51:52.620 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T15:51:52.621 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T15:51:52.621 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T15:51:52.621 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T15:51:52.621 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T15:51:52.621 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-13T15:51:52.621 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-13T15:51:52.621 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T15:51:52.621 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T15:51:52.621 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T15:51:52.621 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-13T15:51:52.621 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T15:51:52.621 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T15:51:52.621 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T15:51:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T15:51:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T15:51:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T15:51:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-13T15:51:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T15:51:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-13T15:51:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-13T15:51:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T15:51:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-13T15:51:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T15:51:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-13T15:51:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T15:51:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-13T15:51:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-13T15:51:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T15:51:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-13T15:51:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-13T15:51:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T15:51:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T15:51:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-13T15:51:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T15:51:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T15:51:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T15:51:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T15:51:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-13T15:51:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-13T15:51:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T15:51:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-13T15:51:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-13T15:51:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T15:51:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-13T15:51:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T15:51:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T15:51:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T15:51:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-13T15:51:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-13T15:51:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T15:51:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-13T15:51:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-13T15:51:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T15:51:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T15:51:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T15:51:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T15:51:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T15:51:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T15:51:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T15:51:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T15:51:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T15:51:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T15:51:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T15:51:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T15:51:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-13T15:51:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T15:51:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T15:51:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T15:51:52.626 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T15:51:52.626 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T15:51:52.626 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T15:51:52.626 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T15:51:52.626 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T15:51:52.626 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T15:51:52.626 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T15:51:52.626 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T15:51:52.626 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T15:51:52.626 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-13T15:51:52.626 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T15:51:52.626 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T15:51:52.626 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-13T15:51:52.627 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-13T15:51:52.627 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T15:51:52.627 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T15:51:52.627 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T15:51:52.627 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T15:51:52.627 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-13T15:51:52.627 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T15:51:52.627 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T15:51:52.627 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-13T15:51:52.627 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-13T15:51:52.627 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-13T15:51:52.627 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T15:51:52.627 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T15:51:52.627 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-13T15:51:52.628 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T15:51:52.628 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T15:51:52.628 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T15:51:52.628 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T15:51:52.628 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T15:51:52.628 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T15:51:52.628 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T15:51:52.628 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T15:51:52.628 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T15:51:52.628 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T15:51:52.628 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T15:51:52.628 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T15:51:52.628 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T15:51:52.628 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T15:51:52.629 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T15:51:52.629 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T15:51:52.629 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T15:51:52.629 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T15:51:52.629 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T15:51:52.629 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T15:51:52.629 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T15:51:52.629 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T15:51:52.629 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T15:51:52.629 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T15:51:52.629 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T15:51:52.629 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T15:51:52.629 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T15:51:52.629 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T15:51:52.630 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T15:51:52.630 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T15:51:52.630 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T15:51:52.630 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-13T15:51:52.630 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T15:51:52.630 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T15:51:52.630 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T15:51:52.630 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T15:51:52.630 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T15:51:52.630 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-13T15:51:52.630 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T15:51:52.630 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T15:51:52.630 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-13T15:51:52.630 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T15:51:52.631 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T15:51:52.631 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T15:51:52.631 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-13T15:51:52.631 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T15:51:52.631 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T15:51:52.631 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-13T15:51:52.631 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T15:51:52.631 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-13T15:51:52.631 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T15:51:52.631 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-13T15:51:52.631 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T15:51:52.631 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-13T15:51:52.631 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T15:51:52.631 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T15:51:52.632 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-13T15:51:52.632 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T15:51:52.632 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-13T15:51:52.632 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-13T15:51:52.632 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T15:51:52.632 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-13T15:51:52.632 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T15:51:52.632 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T15:51:52.632 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T15:51:52.632 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-13T15:51:52.632 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-13T15:51:52.632 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-13T15:51:52.632 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-13T15:51:52.632 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-13T15:51:52.633 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T15:51:52.633 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-13T15:51:52.633 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T15:51:52.633 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T15:51:52.633 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-13T15:51:52.633 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T15:51:52.633 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T15:51:52.633 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-13T15:51:52.633 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T15:51:52.633 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T15:51:52.633 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T15:51:52.633 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T15:51:52.633 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T15:51:52.633 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T15:51:52.634 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T15:51:52.634 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-13T15:51:52.634 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T15:51:52.634 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T15:51:52.634 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T15:51:52.634 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-13T15:51:52.634 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T15:51:52.634 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T15:51:52.634 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T15:51:52.634 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-13T15:51:52.634 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T15:51:52.634 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-13T15:51:52.634 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T15:51:52.634 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-13T15:51:52.635 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T15:51:52.635 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T15:51:52.635 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T15:51:52.635 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T15:51:52.635 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-13T15:51:52.635 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T15:51:52.635 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-13T15:51:52.635 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T15:51:52.635 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T15:51:52.635 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-13T15:51:52.635 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T15:51:52.635 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T15:51:52.635 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T15:51:52.635 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-13T15:51:52.636 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T15:51:52.636 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T15:51:52.636 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-13T15:51:52.636 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T15:51:52.636 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T15:51:52.636 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T15:51:52.636 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T15:51:52.636 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T15:51:52.636 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T15:51:52.636 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T15:51:52.636 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T15:51:52.636 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T15:51:52.636 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T15:51:52.636 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T15:51:52.637 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-13T15:51:52.637 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T15:51:52.637 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T15:51:52.637 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T15:51:52.637 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T15:51:52.637 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-13T15:51:52.637 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T15:51:52.637 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-13T15:51:52.637 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-13T15:51:52.637 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T15:51:52.637 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-13T15:51:52.637 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T15:51:52.637 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T15:51:52.638 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T15:51:52.638 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T15:51:52.638 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T15:51:52.638 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T15:51:52.638 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-13T15:51:52.638 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T15:51:52.638 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-13T15:51:52.638 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-13T15:51:52.638 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-13T15:51:52.638 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T15:51:52.638 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T15:51:52.638 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T15:51:52.638 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T15:51:52.638 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T15:51:52.639 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T15:51:52.639 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T15:51:52.639 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T15:51:52.639 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T15:51:52.639 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T15:51:52.639 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T15:51:52.639 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T15:51:52.639 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T15:51:52.639 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T15:51:52.639 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T15:51:52.639 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T15:51:52.639 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T15:51:52.639 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T15:51:52.640 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-13T15:51:52.640 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-13T15:51:52.640 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T15:51:52.640 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T15:51:52.640 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T15:51:52.640 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T15:51:52.640 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-13T15:51:52.640 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-13T15:51:52.640 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T15:51:52.640 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T15:51:52.640 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-13T15:51:52.640 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T15:51:52.640 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-13T15:51:52.640 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-13T15:51:52.641 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T15:51:52.641 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-13T15:51:52.641 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T15:51:52.641 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-13T15:51:52.641 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T15:51:52.641 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T15:51:52.641 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T15:51:52.641 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T15:51:52.641 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T15:51:52.641 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-13T15:51:52.641 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-13T15:51:52.641 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T15:51:52.641 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T15:51:52.641 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T15:51:52.642 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T15:51:52.642 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-13T15:51:52.642 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T15:51:52.642 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-13T15:51:52.642 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T15:51:52.642 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T15:51:52.642 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-13T15:51:52.642 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T15:51:52.642 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T15:51:52.642 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T15:51:52.642 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T15:51:52.642 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T15:51:52.642 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T15:51:52.642 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T15:51:52.643 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T15:51:52.643 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T15:51:52.643 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T15:51:52.643 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-13T15:51:52.643 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T15:51:52.643 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T15:51:52.643 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T15:51:52.643 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T15:51:52.643 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T15:51:52.643 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T15:51:52.643 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T15:51:52.643 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-13T15:51:52.643 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T15:51:52.643 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-13T15:51:52.644 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T15:51:52.644 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T15:51:52.644 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T15:51:52.644 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T15:51:52.644 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T15:51:52.644 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T15:51:52.644 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T15:51:52.644 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T15:51:52.644 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T15:51:52.644 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T15:51:52.644 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T15:51:52.644 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T15:51:52.644 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T15:51:52.645 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T15:51:52.645 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T15:51:52.645 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T15:51:52.645 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T15:51:52.645 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T15:51:52.645 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T15:51:52.645 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T15:51:52.645 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T15:51:52.645 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T15:51:52.645 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T15:51:52.645 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T15:51:52.645 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T15:51:52.645 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T15:51:52.645 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T15:51:52.646 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T15:51:52.646 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T15:51:52.646 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T15:51:52.646 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T15:51:52.646 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T15:51:52.646 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T15:51:52.646 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T15:51:52.646 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T15:51:52.646 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T15:51:52.646 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T15:51:52.646 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T15:51:52.646 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T15:51:52.646 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T15:51:52.647 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T15:51:52.647 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T15:51:52.647 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T15:51:52.647 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T15:51:52.647 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T15:51:52.647 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-13T15:51:52.647 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T15:51:52.647 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T15:51:52.647 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T15:51:52.647 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T15:51:52.647 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T15:51:52.647 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T15:51:52.647 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T15:51:52.647 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T15:51:52.648 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T15:51:52.648 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T15:51:52.648 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T15:51:52.648 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T15:51:52.648 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T15:51:52.648 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T15:51:52.648 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T15:51:52.648 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-13T15:51:52.648 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T15:51:52.648 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T15:51:52.648 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T15:51:52.648 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-13T15:51:52.648 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-13T15:51:52.648 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T15:51:52.649 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T15:51:52.649 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T15:51:52.649 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T15:51:52.649 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-13T15:51:52.649 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T15:51:52.649 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T15:51:52.649 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T15:51:52.649 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T15:51:52.649 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-13T15:51:52.649 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-13T15:51:52.649 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T15:51:52.649 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T15:51:52.649 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T15:51:52.650 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-13T15:51:52.650 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-13T15:51:52.650 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-13T15:51:52.650 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-13T15:51:52.650 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-13T15:51:52.650 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-13T15:51:52.650 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-13T15:51:52.650 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-13T15:51:52.650 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-13T15:51:52.650 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-13T15:51:52.650 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T15:51:52.650 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T15:51:52.650 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-13T15:51:52.650 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T15:51:52.651 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T15:51:52.651 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T15:51:52.651 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T15:51:52.651 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T15:51:52.651 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T15:51:52.651 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T15:51:52.651 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T15:51:52.651 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T15:51:52.651 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T15:51:52.651 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T15:51:52.651 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T15:51:52.651 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-13T15:51:52.651 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T15:51:52.651 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T15:51:52.652 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T15:51:52.652 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T15:51:52.652 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T15:51:52.652 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T15:51:52.652 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T15:51:52.652 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T15:51:52.652 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T15:51:52.652 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T15:51:52.652 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T15:51:52.652 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T15:51:52.652 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T15:51:52.652 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T15:51:52.652 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T15:51:52.652 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T15:51:52.653 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T15:51:52.653 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T15:51:52.653 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T15:51:52.653 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T15:51:52.653 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T15:51:52.653 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T15:51:52.653 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T15:51:52.653 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T15:51:52.653 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T15:51:52.653 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T15:51:52.653 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-13T15:51:52.653 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-13T15:51:52.653 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T15:51:52.653 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T15:51:52.654 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T15:51:52.654 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-13T15:51:52.654 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T15:51:52.654 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T15:51:52.654 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-13T15:51:52.654 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T15:51:52.654 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-13T15:51:52.654 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-13T15:51:52.654 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T15:51:52.654 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-13T15:51:52.654 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T15:51:52.654 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-13T15:51:52.654 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T15:51:52.655 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T15:51:52.655 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-13T15:51:52.655 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T15:51:52.655 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-13T15:51:52.655 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T15:51:52.655 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-13T15:51:52.655 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T15:51:52.655 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-13T15:51:52.655 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T15:51:52.655 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-13T15:51:52.655 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T15:51:52.655 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-13T15:51:52.655 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T15:51:52.656 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-13T15:51:52.656 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-13T15:51:52.656 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-13T15:51:52.656 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T15:51:52.656 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-13T15:51:52.656 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-13T15:51:52.656 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T15:51:52.656 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-13T15:51:52.656 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-13T15:51:52.656 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T15:51:52.656 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-13T15:51:52.656 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-13T15:51:52.656 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T15:51:52.656 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-13T15:51:52.657 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T15:51:52.657 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-13T15:51:52.657 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T15:51:52.657 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-13T15:51:52.657 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T15:51:52.657 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-13T15:51:52.657 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T15:51:52.657 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-13T15:51:52.657 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T15:51:52.657 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-13T15:51:52.657 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T15:51:52.657 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-13T15:51:52.657 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T15:51:52.657 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-13T15:51:52.658 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-13T15:51:52.658 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T15:51:52.658 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-13T15:51:52.658 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T15:51:52.658 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-13T15:51:52.658 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T15:51:52.658 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T15:51:52.658 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T15:51:52.658 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T15:51:52.658 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-13T15:51:52.658 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T15:51:52.658 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T15:51:52.658 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-13T15:51:52.659 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T15:51:52.659 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-13T15:51:52.659 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T15:51:52.659 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-13T15:51:52.659 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T15:51:52.659 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T15:51:52.659 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T15:51:52.659 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T15:51:52.659 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T15:51:52.659 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T15:51:52.659 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T15:51:52.659 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T15:51:52.659 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T15:51:52.659 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T15:51:52.660 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T15:51:52.660 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T15:51:52.660 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T15:51:52.660 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T15:51:52.660 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T15:51:52.660 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T15:51:52.660 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T15:51:52.660 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T15:51:52.660 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T15:51:52.660 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T15:51:52.660 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T15:51:52.660 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T15:51:52.660 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T15:51:52.660 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T15:51:52.661 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T15:51:52.661 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T15:51:52.661 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T15:51:52.661 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T15:51:52.661 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T15:51:52.661 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T15:51:52.661 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T15:51:52.661 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T15:51:52.661 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T15:51:52.661 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T15:51:52.661 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T15:51:52.661 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T15:51:52.661 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T15:51:52.662 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T15:51:52.662 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T15:51:52.662 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T15:51:52.662 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T15:51:52.662 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T15:51:52.662 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T15:51:52.662 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T15:51:52.662 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T15:51:52.662 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T15:51:52.662 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T15:51:52.662 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T15:51:52.662 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T15:51:52.662 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T15:51:52.662 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-13T15:51:52.663 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-13T15:51:52.663 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T15:51:52.663 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-13T15:51:52.663 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T15:51:52.663 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-13T15:51:52.663 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T15:51:52.663 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T15:51:52.663 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T15:51:52.663 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T15:51:52.663 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T15:51:52.663 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-13T15:51:52.663 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T15:51:52.663 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-13T15:51:52.664 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T15:51:52.664 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-13T15:51:52.664 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T15:51:52.664 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-13T15:51:52.664 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T15:51:52.664 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-13T15:51:52.664 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-13T15:51:52.664 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T15:51:52.664 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-13T15:51:52.664 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T15:51:52.664 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T15:51:52.664 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-13T15:51:52.664 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T15:51:52.664 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-13T15:51:52.665 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T15:51:52.665 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-13T15:51:52.665 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T15:51:52.665 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-13T15:51:52.665 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T15:51:52.665 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-13T15:51:52.665 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T15:51:52.665 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-13T15:51:52.665 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-13T15:51:52.665 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-13T15:51:52.665 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T15:51:52.665 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-13T15:51:52.665 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-13T15:51:52.666 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-13T15:51:52.666 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-13T15:51:52.666 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T15:51:52.666 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T15:51:52.666 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-13T15:51:52.666 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-13T15:51:52.666 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T15:51:52.666 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T15:51:52.666 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T15:51:52.666 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T15:51:52.666 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-13T15:51:52.666 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T15:51:52.666 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T15:51:52.666 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-13T15:51:52.666 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T15:51:52.667 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-13T15:51:52.667 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T15:51:52.667 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-13T15:51:52.667 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T15:51:52.667 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T15:51:52.667 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T15:51:52.667 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T15:51:52.667 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-13T15:51:52.667 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-13T15:51:52.667 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-13T15:51:52.667 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T15:51:52.667 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-13T15:51:52.667 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-13T15:51:52.667 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T15:51:52.668 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T15:51:52.668 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T15:51:52.668 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T15:51:52.668 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T15:51:52.668 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T15:51:52.668 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T15:51:52.668 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T15:51:52.668 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-13T15:51:52.668 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T15:51:52.668 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T15:51:52.668 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T15:51:52.668 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T15:51:52.668 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T15:51:52.669 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-13T15:51:52.669 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T15:51:52.669 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-13T15:51:52.669 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T15:51:52.669 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T15:51:52.669 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T15:51:52.669 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T15:51:52.669 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-13T15:51:52.669 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T15:51:52.669 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-13T15:51:52.669 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T15:51:52.669 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T15:51:52.669 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-13T15:51:52.669 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T15:51:52.670 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T15:51:52.670 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T15:51:52.670 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T15:51:52.670 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T15:51:52.670 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T15:51:52.670 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T15:51:52.670 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T15:51:52.670 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T15:51:52.670 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T15:51:52.670 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T15:51:52.670 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T15:51:52.670 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T15:51:52.670 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T15:51:52.670 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T15:51:52.671 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T15:51:52.671 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T15:51:52.671 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T15:51:52.671 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T15:51:52.671 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T15:51:52.671 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T15:51:52.671 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-13T15:51:52.671 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T15:51:52.671 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T15:51:52.671 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-13T15:51:52.671 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T15:51:52.671 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-13T15:51:52.671 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-13T15:51:52.671 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T15:51:52.672 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-13T15:51:52.672 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T15:51:52.672 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T15:51:52.672 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T15:51:52.672 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T15:51:52.672 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-13T15:51:52.672 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-13T15:51:52.672 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-13T15:51:52.672 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T15:51:52.672 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T15:51:52.672 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T15:51:52.672 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T15:51:52.672 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T15:51:52.672 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-13T15:51:52.673 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-13T15:51:52.673 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T15:51:52.673 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T15:51:52.673 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T15:51:52.673 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-13T15:51:52.673 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T15:51:52.673 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T15:51:52.673 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T15:51:52.673 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T15:51:52.673 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T15:51:52.673 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T15:51:52.673 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T15:51:52.673 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T15:51:52.673 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T15:51:52.674 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T15:51:52.674 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-13T15:51:52.674 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T15:51:52.674 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T15:51:52.674 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T15:51:52.674 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T15:51:52.674 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T15:51:52.674 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T15:51:52.674 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T15:51:52.674 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T15:51:52.674 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T15:51:52.674 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T15:51:52.674 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T15:51:52.674 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T15:51:52.675 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T15:51:52.675 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T15:51:52.675 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T15:51:52.675 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T15:51:52.675 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T15:51:52.675 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T15:51:52.675 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T15:51:52.675 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T15:51:52.675 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T15:51:52.675 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T15:51:52.675 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T15:51:52.675 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T15:51:52.675 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T15:51:52.675 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T15:51:52.676 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T15:51:52.676 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T15:51:52.676 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T15:51:52.676 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T15:51:52.676 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T15:51:52.676 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T15:51:52.676 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T15:51:52.676 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T15:51:52.676 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T15:51:52.676 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T15:51:52.676 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T15:51:52.676 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T15:51:52.676 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-13T15:51:52.676 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T15:51:52.677 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T15:51:52.677 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T15:51:52.677 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T15:51:52.677 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T15:51:52.677 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T15:51:52.677 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T15:51:52.677 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-13T15:51:52.677 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T15:51:52.677 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T15:51:52.677 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T15:51:52.677 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T15:51:52.677 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T15:51:52.677 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T15:51:52.677 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T15:51:52.678 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T15:51:52.678 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T15:51:52.678 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T15:51:52.678 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T15:51:52.678 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T15:51:52.678 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T15:51:52.678 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T15:51:52.678 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T15:51:52.678 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T15:51:52.678 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T15:51:52.678 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T15:51:52.678 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T15:51:52.678 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T15:51:52.679 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T15:51:52.679 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T15:51:52.679 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T15:51:52.679 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T15:51:52.679 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T15:51:52.679 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T15:51:52.679 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T15:51:52.679 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-13T15:51:52.679 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T15:51:52.679 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-13T15:51:52.679 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T15:51:52.679 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T15:51:52.679 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T15:51:52.679 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T15:51:52.680 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T15:51:52.680 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T15:51:52.680 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T15:51:52.680 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-13T15:51:52.680 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T15:51:52.680 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-13T15:51:52.680 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T15:51:52.680 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-13T15:51:52.680 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T15:51:52.680 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-13T15:51:52.680 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-13T15:51:52.680 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T15:51:52.680 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T15:51:52.680 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T15:51:52.681 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T15:51:52.681 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T15:51:52.681 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T15:51:52.681 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T15:51:52.681 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T15:51:52.681 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T15:51:52.681 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T15:51:52.681 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T15:51:52.681 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T15:51:52.681 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T15:51:52.681 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T15:51:52.681 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T15:51:52.681 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T15:51:52.682 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-13T15:51:52.682 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T15:51:52.682 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T15:51:52.682 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T15:51:52.682 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T15:51:52.682 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T15:51:52.682 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T15:51:52.682 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T15:51:52.682 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T15:51:52.682 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T15:51:52.682 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T15:51:52.682 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T15:51:52.682 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T15:51:52.682 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T15:51:52.683 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T15:51:52.683 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T15:51:52.683 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T15:51:52.683 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T15:51:52.683 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T15:51:52.683 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T15:51:52.683 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T15:51:52.683 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T15:51:52.683 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T15:51:52.683 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T15:51:52.683 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T15:51:52.683 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T15:51:52.683 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T15:51:52.684 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T15:51:52.684 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T15:51:52.684 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T15:51:52.684 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T15:51:52.684 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T15:51:52.684 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T15:51:52.684 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T15:51:52.684 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T15:51:52.684 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T15:51:52.684 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T15:51:52.684 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T15:51:52.685 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T15:51:52.685 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T15:51:52.685 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T15:51:52.685 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T15:51:52.685 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T15:51:52.685 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T15:51:52.685 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T15:51:52.685 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T15:51:52.685 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T15:51:52.685 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T15:51:52.685 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T15:51:52.685 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T15:51:52.685 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T15:51:52.686 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T15:51:52.686 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T15:51:52.686 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T15:51:52.686 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T15:51:52.686 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T15:51:52.686 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T15:51:52.686 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T15:51:52.686 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T15:51:52.686 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-13T15:51:52.686 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T15:51:52.686 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T15:51:52.686 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T15:51:52.686 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T15:51:52.686 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-13T15:51:52.687 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T15:51:52.687 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T15:51:52.687 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T15:51:52.687 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T15:51:52.687 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T15:51:52.687 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T15:51:52.687 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T15:51:52.687 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T15:51:52.687 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T15:51:52.687 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T15:51:52.687 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T15:51:52.687 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T15:51:52.687 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T15:51:52.688 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T15:51:52.688 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T15:51:52.688 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T15:51:52.688 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T15:51:52.688 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T15:51:52.688 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T15:51:52.688 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T15:51:52.688 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T15:51:52.688 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T15:51:52.688 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T15:51:52.688 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T15:51:52.688 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T15:51:52.688 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T15:51:52.688 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T15:51:52.689 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T15:51:52.689 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T15:51:52.689 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T15:51:52.689 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T15:51:52.689 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T15:51:52.689 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T15:51:52.689 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T15:51:52.689 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T15:51:52.689 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T15:51:52.689 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T15:51:52.689 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T15:51:52.689 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T15:51:52.689 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T15:51:52.690 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T15:51:52.690 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T15:51:52.690 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T15:51:52.690 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T15:51:52.690 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T15:51:52.690 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T15:51:52.690 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T15:51:52.690 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T15:51:52.690 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T15:51:52.690 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T15:51:52.690 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T15:51:52.690 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T15:51:52.690 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T15:51:52.690 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T15:51:52.691 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T15:51:52.691 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T15:51:52.691 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T15:51:52.691 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T15:51:52.691 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T15:51:52.691 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T15:51:52.691 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T15:51:52.691 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T15:51:52.691 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T15:51:52.691 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T15:51:52.691 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T15:51:52.691 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T15:51:52.691 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T15:51:52.691 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T15:51:52.692 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T15:51:52.692 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T15:51:52.692 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T15:51:52.692 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-13T15:51:52.692 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T15:51:52.692 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-13T15:51:52.692 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T15:51:52.692 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-13T15:51:52.692 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T15:51:52.692 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T15:51:52.692 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T15:51:52.692 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T15:51:52.692 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-13T15:51:52.693 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T15:51:52.693 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-13T15:51:52.693 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T15:51:52.693 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T15:51:52.693 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T15:51:52.693 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-13T15:51:52.693 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T15:51:52.693 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T15:51:52.693 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T15:51:52.693 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T15:51:52.693 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T15:51:52.693 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T15:51:52.693 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T15:51:52.694 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T15:51:52.694 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T15:51:52.694 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T15:51:52.694 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T15:51:52.694 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T15:51:52.694 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T15:51:52.694 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T15:51:52.694 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T15:51:52.694 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T15:51:52.694 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T15:51:52.694 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T15:51:52.694 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T15:51:52.694 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T15:51:52.694 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T15:51:52.695 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T15:51:52.695 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T15:51:52.695 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T15:51:52.695 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T15:51:52.695 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T15:51:52.695 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T15:51:52.695 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T15:51:52.695 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T15:51:52.695 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T15:51:52.695 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T15:51:52.695 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T15:51:52.695 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T15:51:52.695 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T15:51:52.695 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T15:51:52.696 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T15:51:52.696 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T15:51:52.696 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T15:51:52.696 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T15:51:52.696 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T15:51:52.696 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T15:51:52.696 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T15:51:52.696 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T15:51:52.696 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-13T15:51:52.696 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T15:51:52.696 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T15:51:52.696 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-13T15:51:52.696 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-13T15:51:52.696 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T15:51:52.697 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T15:51:52.697 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T15:51:52.697 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-13T15:51:52.697 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T15:51:52.697 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-13T15:51:52.697 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T15:51:52.697 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T15:51:52.697 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-13T15:51:52.697 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T15:51:52.697 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-13T15:51:52.697 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T15:51:52.697 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T15:51:52.697 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T15:51:52.698 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T15:51:52.698 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T15:51:52.698 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-13T15:51:52.698 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T15:51:52.698 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-13T15:51:52.698 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-13T15:51:52.698 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-13T15:51:52.698 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-13T15:51:52.698 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-13T15:51:52.698 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-13T15:51:52.698 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T15:51:52.698 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T15:51:52.698 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T15:51:52.698 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T15:51:52.699 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T15:51:52.699 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T15:51:52.699 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T15:51:52.699 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T15:51:52.699 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T15:51:52.699 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T15:51:52.699 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T15:51:52.699 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T15:51:52.699 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T15:51:52.699 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-13T15:51:52.699 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T15:51:52.704 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:51:52.704 DEBUG:teuthology.orchestra.run.smithi070:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-13T15:51:52.727 INFO:teuthology.orchestra.run.smithi070.stdout:postinstall scriptlet (using /bin/sh): 2024-09-13T15:51:52.727 INFO:teuthology.orchestra.run.smithi070.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T15:51:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T15:51:52.727 INFO:teuthology.orchestra.run.smithi070.stdout:fi 2024-09-13T15:51:52.727 INFO:teuthology.orchestra.run.smithi070.stdout:for file in vmlinuz System.map config; do 2024-09-13T15:51:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-13T15:51:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T15:51:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: fi 2024-09-13T15:51:52.727 INFO:teuthology.orchestra.run.smithi070.stdout:done 2024-09-13T15:51:52.727 INFO:teuthology.orchestra.run.smithi070.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-13T15:51:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-13T15:51:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T15:51:52.728 INFO:teuthology.orchestra.run.smithi070.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T15:51:52.728 INFO:teuthology.orchestra.run.smithi070.stdout:fi 2024-09-13T15:51:52.728 INFO:teuthology.orchestra.run.smithi070.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-13T15:51:52.728 INFO:teuthology.orchestra.run.smithi070.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:51:52.728 INFO:teuthology.orchestra.run.smithi070.stdout:fi 2024-09-13T15:51:52.728 INFO:teuthology.orchestra.run.smithi070.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-13T15:51:52.728 INFO:teuthology.orchestra.run.smithi070.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T15:51:52.728 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:51:52.728 INFO:teuthology.orchestra.run.smithi070.stdout:fi 2024-09-13T15:51:52.729 DEBUG:teuthology.orchestra.run.smithi070:> sudo rpm -qi grub2-tools 2024-09-13T15:51:52.803 INFO:teuthology.orchestra.run.smithi070.stdout:Name : grub2-tools 2024-09-13T15:51:52.803 INFO:teuthology.orchestra.run.smithi070.stdout:Epoch : 1 2024-09-13T15:51:52.803 INFO:teuthology.orchestra.run.smithi070.stdout:Version : 2.06 2024-09-13T15:51:52.803 INFO:teuthology.orchestra.run.smithi070.stdout:Release : 82.el9 2024-09-13T15:51:52.803 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: x86_64 2024-09-13T15:51:52.803 INFO:teuthology.orchestra.run.smithi070.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T15:51:52.803 INFO:teuthology.orchestra.run.smithi070.stdout:Group : Unspecified 2024-09-13T15:51:52.803 INFO:teuthology.orchestra.run.smithi070.stdout:Size : 8274670 2024-09-13T15:51:52.803 INFO:teuthology.orchestra.run.smithi070.stdout:License : GPLv3+ 2024-09-13T15:51:52.803 INFO:teuthology.orchestra.run.smithi070.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T15:51:52.803 INFO:teuthology.orchestra.run.smithi070.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T15:51:52.804 INFO:teuthology.orchestra.run.smithi070.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T15:51:52.804 INFO:teuthology.orchestra.run.smithi070.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T15:51:52.804 INFO:teuthology.orchestra.run.smithi070.stdout:Packager : builder@centos.org 2024-09-13T15:51:52.804 INFO:teuthology.orchestra.run.smithi070.stdout:Vendor : CentOS 2024-09-13T15:51:52.804 INFO:teuthology.orchestra.run.smithi070.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T15:51:52.804 INFO:teuthology.orchestra.run.smithi070.stdout:Summary : Support tools for GRUB. 2024-09-13T15:51:52.804 INFO:teuthology.orchestra.run.smithi070.stdout:Description : 2024-09-13T15:51:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T15:51:52.804 INFO:teuthology.orchestra.run.smithi070.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T15:51:52.804 INFO:teuthology.orchestra.run.smithi070.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T15:51:52.804 INFO:teuthology.orchestra.run.smithi070.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T15:51:52.804 INFO:teuthology.orchestra.run.smithi070.stdout:hardware devices. 2024-09-13T15:51:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T15:51:52.804 INFO:teuthology.orchestra.run.smithi070.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T15:51:52.805 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T15:51:52.805 INFO:teuthology.task.kernel:Updating grub on smithi070 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:51:52.806 DEBUG:teuthology.orchestra.run.smithi070:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T15:51:53.450 INFO:teuthology.orchestra.run.smithi070.stderr:Generating grub configuration file ... 2024-09-13T15:51:53.536 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-13T15:51:53.536 DEBUG:teuthology.orchestra.run.smithi107:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-13T15:51:53.620 INFO:teuthology.orchestra.run.smithi107.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:51:53.620 INFO:teuthology.orchestra.run.smithi107.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:51:53.620 INFO:teuthology.orchestra.run.smithi107.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:51:53.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:51:53.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-13T15:51:53.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-13T15:51:53.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-13T15:51:53.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-13T15:51:53.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-13T15:51:53.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-13T15:51:53.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T15:51:53.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T15:51:53.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T15:51:53.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T15:51:53.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T15:51:53.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T15:51:53.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T15:51:53.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-13T15:51:53.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T15:51:53.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T15:51:53.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T15:51:53.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T15:51:53.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T15:51:53.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T15:51:53.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T15:51:53.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T15:51:53.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T15:51:53.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T15:51:53.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T15:51:53.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T15:51:53.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-13T15:51:53.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-13T15:51:53.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-13T15:51:53.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T15:51:53.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-13T15:51:53.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T15:51:53.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T15:51:53.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T15:51:53.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-13T15:51:53.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T15:51:53.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T15:51:53.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T15:51:53.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-13T15:51:53.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T15:51:53.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T15:51:53.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T15:51:53.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T15:51:53.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T15:51:53.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T15:51:53.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T15:51:53.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T15:51:53.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T15:51:53.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T15:51:53.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T15:51:53.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T15:51:53.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T15:51:53.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T15:51:53.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T15:51:53.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T15:51:53.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T15:51:53.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T15:51:53.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T15:51:53.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T15:51:53.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T15:51:53.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T15:51:53.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T15:51:53.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-13T15:51:53.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-13T15:51:53.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T15:51:53.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T15:51:53.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T15:51:53.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T15:51:53.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T15:51:53.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T15:51:53.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T15:51:53.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T15:51:53.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T15:51:53.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T15:51:53.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T15:51:53.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T15:51:53.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T15:51:53.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T15:51:53.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T15:51:53.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T15:51:53.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T15:51:53.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T15:51:53.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T15:51:53.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T15:51:53.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T15:51:53.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T15:51:53.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-13T15:51:53.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-13T15:51:53.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T15:51:53.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T15:51:53.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T15:51:53.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T15:51:53.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T15:51:53.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T15:51:53.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T15:51:53.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-13T15:51:53.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T15:51:53.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T15:51:53.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-13T15:51:53.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T15:51:53.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T15:51:53.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T15:51:53.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T15:51:53.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T15:51:53.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T15:51:53.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T15:51:53.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T15:51:53.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T15:51:53.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T15:51:53.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T15:51:53.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T15:51:53.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T15:51:53.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T15:51:53.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T15:51:53.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T15:51:53.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T15:51:53.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T15:51:53.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T15:51:53.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T15:51:53.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T15:51:53.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T15:51:53.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T15:51:53.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T15:51:53.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T15:51:53.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T15:51:53.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T15:51:53.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T15:51:53.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T15:51:53.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T15:51:53.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T15:51:53.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T15:51:53.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T15:51:53.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T15:51:53.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T15:51:53.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-13T15:51:53.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T15:51:53.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T15:51:53.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T15:51:53.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T15:51:53.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T15:51:53.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T15:51:53.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T15:51:53.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T15:51:53.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T15:51:53.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T15:51:53.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T15:51:53.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T15:51:53.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T15:51:53.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T15:51:53.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T15:51:53.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T15:51:53.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T15:51:53.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-13T15:51:53.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T15:51:53.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-13T15:51:53.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-13T15:51:53.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-13T15:51:53.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-13T15:51:53.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-13T15:51:53.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T15:51:53.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-13T15:51:53.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-13T15:51:53.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T15:51:53.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-13T15:51:53.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-13T15:51:53.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T15:51:53.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T15:51:53.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-13T15:51:53.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-13T15:51:53.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T15:51:53.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T15:51:53.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-13T15:51:53.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T15:51:53.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T15:51:53.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T15:51:53.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-13T15:51:53.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-13T15:51:53.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T15:51:53.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-13T15:51:53.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-13T15:51:53.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T15:51:53.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-13T15:51:53.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T15:51:53.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-13T15:51:53.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T15:51:53.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T15:51:53.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T15:51:53.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T15:51:53.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T15:51:53.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-13T15:51:53.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T15:51:53.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T15:51:53.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T15:51:53.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T15:51:53.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T15:51:53.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T15:51:53.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T15:51:53.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-13T15:51:53.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T15:51:53.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T15:51:53.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T15:51:53.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-13T15:51:53.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-13T15:51:53.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T15:51:53.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T15:51:53.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T15:51:53.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-13T15:51:53.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-13T15:51:53.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-13T15:51:53.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-13T15:51:53.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-13T15:51:53.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-13T15:51:53.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T15:51:53.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T15:51:53.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-13T15:51:53.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-13T15:51:53.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T15:51:53.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-13T15:51:53.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-13T15:51:53.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T15:51:53.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T15:51:53.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-13T15:51:53.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-13T15:51:53.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-13T15:51:53.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T15:51:53.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-13T15:51:53.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T15:51:53.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T15:51:53.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T15:51:53.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-13T15:51:53.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T15:51:53.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-13T15:51:53.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T15:51:53.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-13T15:51:53.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-13T15:51:53.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-13T15:51:53.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-13T15:51:53.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T15:51:53.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-13T15:51:53.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T15:51:53.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-13T15:51:53.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T15:51:53.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T15:51:53.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T15:51:53.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T15:51:53.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T15:51:53.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T15:51:53.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T15:51:53.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T15:51:53.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T15:51:53.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T15:51:53.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T15:51:53.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T15:51:53.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T15:51:53.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-13T15:51:53.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-13T15:51:53.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T15:51:53.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-13T15:51:53.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T15:51:53.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T15:51:53.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-13T15:51:53.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T15:51:53.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T15:51:53.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T15:51:53.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T15:51:53.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T15:51:53.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T15:51:53.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T15:51:53.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T15:51:53.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T15:51:53.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T15:51:53.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T15:51:53.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T15:51:53.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T15:51:53.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T15:51:53.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T15:51:53.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T15:51:53.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T15:51:53.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T15:51:53.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T15:51:53.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T15:51:53.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T15:51:53.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T15:51:53.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T15:51:53.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T15:51:53.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T15:51:53.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T15:51:53.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T15:51:53.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T15:51:53.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T15:51:53.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T15:51:53.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T15:51:53.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T15:51:53.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T15:51:53.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T15:51:53.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T15:51:53.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T15:51:53.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T15:51:53.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T15:51:53.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T15:51:53.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T15:51:53.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T15:51:53.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T15:51:53.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T15:51:53.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T15:51:53.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T15:51:53.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T15:51:53.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T15:51:53.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T15:51:53.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T15:51:53.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T15:51:53.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T15:51:53.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T15:51:53.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T15:51:53.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T15:51:53.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T15:51:53.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T15:51:53.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T15:51:53.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T15:51:53.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T15:51:53.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T15:51:53.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T15:51:53.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T15:51:53.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T15:51:53.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T15:51:53.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-13T15:51:53.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T15:51:53.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T15:51:53.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T15:51:53.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-13T15:51:53.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T15:51:53.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T15:51:53.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T15:51:53.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T15:51:53.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T15:51:53.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T15:51:53.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T15:51:53.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T15:51:53.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T15:51:53.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T15:51:53.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T15:51:53.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T15:51:53.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T15:51:53.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T15:51:53.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T15:51:53.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T15:51:53.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T15:51:53.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T15:51:53.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T15:51:53.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T15:51:53.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T15:51:53.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T15:51:53.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T15:51:53.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T15:51:53.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T15:51:53.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T15:51:53.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T15:51:53.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T15:51:53.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T15:51:53.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T15:51:53.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T15:51:53.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T15:51:53.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T15:51:53.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T15:51:53.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T15:51:53.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T15:51:53.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T15:51:53.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T15:51:53.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T15:51:53.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T15:51:53.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T15:51:53.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T15:51:53.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T15:51:53.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T15:51:53.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T15:51:53.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T15:51:53.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T15:51:53.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T15:51:53.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T15:51:53.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T15:51:53.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T15:51:53.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T15:51:53.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T15:51:53.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T15:51:53.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T15:51:53.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T15:51:53.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T15:51:53.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T15:51:53.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T15:51:53.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T15:51:53.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T15:51:53.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T15:51:53.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T15:51:53.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T15:51:53.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T15:51:53.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T15:51:53.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T15:51:53.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T15:51:53.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T15:51:53.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T15:51:53.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T15:51:53.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T15:51:53.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T15:51:53.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T15:51:53.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T15:51:53.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T15:51:53.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T15:51:53.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T15:51:53.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T15:51:53.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T15:51:53.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T15:51:53.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T15:51:53.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T15:51:53.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T15:51:53.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T15:51:53.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T15:51:53.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T15:51:53.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T15:51:53.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-13T15:51:53.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T15:51:53.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T15:51:53.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T15:51:53.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T15:51:53.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T15:51:53.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T15:51:53.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T15:51:53.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T15:51:53.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T15:51:53.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T15:51:53.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T15:51:53.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T15:51:53.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T15:51:53.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T15:51:53.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T15:51:53.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T15:51:53.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T15:51:53.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T15:51:53.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T15:51:53.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T15:51:53.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T15:51:53.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T15:51:53.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T15:51:53.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T15:51:53.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T15:51:53.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T15:51:53.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T15:51:53.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T15:51:53.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T15:51:53.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T15:51:53.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T15:51:53.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T15:51:53.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T15:51:53.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T15:51:53.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T15:51:53.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T15:51:53.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T15:51:53.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T15:51:53.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T15:51:53.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T15:51:53.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T15:51:53.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-13T15:51:53.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-13T15:51:53.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T15:51:53.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T15:51:53.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-13T15:51:53.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T15:51:53.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T15:51:53.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T15:51:53.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T15:51:53.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T15:51:53.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T15:51:53.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T15:51:53.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T15:51:53.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T15:51:53.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T15:51:53.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T15:51:53.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T15:51:53.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T15:51:53.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T15:51:53.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T15:51:53.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T15:51:53.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T15:51:53.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T15:51:53.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T15:51:53.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T15:51:53.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T15:51:53.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T15:51:53.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T15:51:53.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-13T15:51:53.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T15:51:53.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-13T15:51:53.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T15:51:53.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T15:51:53.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-13T15:51:53.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-13T15:51:53.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T15:51:53.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T15:51:53.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T15:51:53.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T15:51:53.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T15:51:53.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T15:51:53.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T15:51:53.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-13T15:51:53.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-13T15:51:53.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T15:51:53.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-13T15:51:53.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T15:51:53.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-13T15:51:53.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T15:51:53.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-13T15:51:53.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T15:51:53.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-13T15:51:53.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-13T15:51:53.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T15:51:53.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-13T15:51:53.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T15:51:53.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-13T15:51:53.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T15:51:53.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-13T15:51:53.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T15:51:53.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-13T15:51:53.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T15:51:53.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-13T15:51:53.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-13T15:51:53.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T15:51:53.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T15:51:53.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T15:51:53.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T15:51:53.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-13T15:51:53.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T15:51:53.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-13T15:51:53.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T15:51:53.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T15:51:53.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T15:51:53.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T15:51:53.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T15:51:53.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T15:51:53.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T15:51:53.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T15:51:53.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-13T15:51:53.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T15:51:53.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-13T15:51:53.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T15:51:53.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T15:51:53.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T15:51:53.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T15:51:53.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T15:51:53.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-13T15:51:53.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T15:51:53.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T15:51:53.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T15:51:53.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T15:51:53.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-13T15:51:53.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T15:51:53.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T15:51:53.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T15:51:53.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T15:51:53.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T15:51:53.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T15:51:53.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T15:51:53.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T15:51:53.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-13T15:51:53.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-13T15:51:53.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T15:51:53.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T15:51:53.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T15:51:53.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T15:51:53.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T15:51:53.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T15:51:53.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T15:51:53.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T15:51:53.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T15:51:53.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T15:51:53.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T15:51:53.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T15:51:53.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T15:51:53.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T15:51:53.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T15:51:53.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T15:51:53.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-13T15:51:53.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T15:51:53.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T15:51:53.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T15:51:53.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T15:51:53.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T15:51:53.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-13T15:51:53.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-13T15:51:53.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T15:51:53.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T15:51:53.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T15:51:53.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T15:51:53.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T15:51:53.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T15:51:53.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T15:51:53.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-13T15:51:53.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T15:51:53.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T15:51:53.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-13T15:51:53.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T15:51:53.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T15:51:53.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T15:51:53.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T15:51:53.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-13T15:51:53.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-13T15:51:53.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T15:51:53.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T15:51:53.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T15:51:53.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T15:51:53.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-13T15:51:53.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T15:51:53.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-13T15:51:53.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T15:51:53.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T15:51:53.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T15:51:53.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T15:51:53.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T15:51:53.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T15:51:53.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T15:51:53.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-13T15:51:53.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T15:51:53.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T15:51:53.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-13T15:51:53.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T15:51:53.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T15:51:53.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T15:51:53.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-13T15:51:53.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-13T15:51:53.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-13T15:51:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-13T15:51:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-13T15:51:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-13T15:51:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T15:51:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T15:51:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T15:51:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T15:51:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-13T15:51:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T15:51:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-13T15:51:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-13T15:51:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T15:51:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-13T15:51:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-13T15:51:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T15:51:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T15:51:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T15:51:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-13T15:51:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T15:51:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T15:51:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T15:51:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-13T15:51:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-13T15:51:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T15:51:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T15:51:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T15:51:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T15:51:53.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-13T15:51:53.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T15:51:53.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T15:51:53.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T15:51:53.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T15:51:53.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-13T15:51:53.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T15:51:53.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-13T15:51:53.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T15:51:53.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-13T15:51:53.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T15:51:53.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-13T15:51:53.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T15:51:53.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-13T15:51:53.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T15:51:53.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T15:51:53.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T15:51:53.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-13T15:51:53.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-13T15:51:53.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T15:51:53.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-13T15:51:53.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T15:51:53.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-13T15:51:53.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T15:51:53.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-13T15:51:53.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T15:51:53.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T15:51:53.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-13T15:51:53.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T15:51:53.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T15:51:53.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-13T15:51:53.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T15:51:53.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T15:51:53.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-13T15:51:53.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T15:51:53.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T15:51:53.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-13T15:51:53.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-13T15:51:53.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T15:51:53.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-13T15:51:53.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-13T15:51:53.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T15:51:53.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-13T15:51:53.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T15:51:53.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-13T15:51:53.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T15:51:53.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-13T15:51:53.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T15:51:53.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-13T15:51:53.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T15:51:53.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-13T15:51:53.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-13T15:51:53.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T15:51:53.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-13T15:51:53.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-13T15:51:53.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T15:51:53.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T15:51:53.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T15:51:53.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T15:51:53.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T15:51:53.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T15:51:53.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-13T15:51:53.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T15:51:53.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T15:51:53.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T15:51:53.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-13T15:51:53.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-13T15:51:53.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T15:51:53.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T15:51:53.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T15:51:53.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-13T15:51:53.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T15:51:53.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-13T15:51:53.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T15:51:53.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-13T15:51:53.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T15:51:53.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-13T15:51:53.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T15:51:53.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-13T15:51:53.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T15:51:53.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-13T15:51:53.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T15:51:53.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-13T15:51:53.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T15:51:53.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-13T15:51:53.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T15:51:53.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-13T15:51:53.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T15:51:53.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-13T15:51:53.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T15:51:53.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-13T15:51:53.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T15:51:53.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-13T15:51:53.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T15:51:53.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T15:51:53.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-13T15:51:53.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T15:51:53.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T15:51:53.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T15:51:53.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-13T15:51:53.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-13T15:51:53.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T15:51:53.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T15:51:53.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-13T15:51:53.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-13T15:51:53.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T15:51:53.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-13T15:51:53.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T15:51:53.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-13T15:51:53.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-13T15:51:53.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T15:51:53.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-13T15:51:53.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T15:51:53.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T15:51:53.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-13T15:51:53.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T15:51:53.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-13T15:51:53.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T15:51:53.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-13T15:51:53.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T15:51:53.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T15:51:53.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-13T15:51:53.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-13T15:51:53.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T15:51:53.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T15:51:53.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-13T15:51:53.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T15:51:53.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-13T15:51:53.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T15:51:53.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-13T15:51:53.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T15:51:53.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T15:51:53.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T15:51:53.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T15:51:53.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-13T15:51:53.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-13T15:51:53.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-13T15:51:53.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T15:51:53.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-13T15:51:53.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T15:51:53.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-13T15:51:53.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T15:51:53.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T15:51:53.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-13T15:51:53.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T15:51:53.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T15:51:53.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T15:51:53.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T15:51:53.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-13T15:51:53.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-13T15:51:53.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T15:51:53.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T15:51:53.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-13T15:51:53.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T15:51:53.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T15:51:53.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T15:51:53.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T15:51:53.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-13T15:51:53.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T15:51:53.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-13T15:51:53.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T15:51:53.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-13T15:51:53.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T15:51:53.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T15:51:53.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-13T15:51:53.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T15:51:53.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T15:51:53.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-13T15:51:53.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T15:51:53.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T15:51:53.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-13T15:51:53.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T15:51:53.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-13T15:51:53.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T15:51:53.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T15:51:53.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-13T15:51:53.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T15:51:53.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T15:51:53.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T15:51:53.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-13T15:51:53.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T15:51:53.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T15:51:53.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T15:51:53.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T15:51:53.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T15:51:53.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-13T15:51:53.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T15:51:53.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T15:51:53.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-13T15:51:53.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T15:51:53.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T15:51:53.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-13T15:51:53.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T15:51:53.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T15:51:53.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-13T15:51:53.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T15:51:53.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T15:51:53.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T15:51:53.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T15:51:53.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T15:51:53.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-13T15:51:53.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T15:51:53.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T15:51:53.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T15:51:53.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T15:51:53.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T15:51:53.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T15:51:53.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T15:51:53.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T15:51:53.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T15:51:53.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T15:51:53.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T15:51:53.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T15:51:53.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-13T15:51:53.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T15:51:53.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T15:51:53.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T15:51:53.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-13T15:51:53.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T15:51:53.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T15:51:53.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T15:51:53.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T15:51:53.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T15:51:53.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-13T15:51:53.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-13T15:51:53.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T15:51:53.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T15:51:53.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T15:51:53.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-13T15:51:53.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T15:51:53.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T15:51:53.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T15:51:53.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T15:51:53.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T15:51:53.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T15:51:53.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-13T15:51:53.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T15:51:53.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-13T15:51:53.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-13T15:51:53.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T15:51:53.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-13T15:51:53.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T15:51:53.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-13T15:51:53.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T15:51:53.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-13T15:51:53.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-13T15:51:53.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T15:51:53.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-13T15:51:53.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-13T15:51:53.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T15:51:53.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T15:51:53.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-13T15:51:53.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T15:51:53.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T15:51:53.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T15:51:53.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T15:51:53.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-13T15:51:53.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-13T15:51:53.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T15:51:53.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-13T15:51:53.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-13T15:51:53.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T15:51:53.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-13T15:51:53.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T15:51:53.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T15:51:53.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T15:51:53.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-13T15:51:53.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-13T15:51:53.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T15:51:53.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-13T15:51:53.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-13T15:51:53.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T15:51:53.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T15:51:53.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T15:51:53.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T15:51:53.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T15:51:53.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T15:51:53.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T15:51:53.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T15:51:53.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T15:51:53.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T15:51:53.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T15:51:53.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T15:51:53.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-13T15:51:53.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T15:51:53.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T15:51:53.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T15:51:53.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T15:51:53.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T15:51:53.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T15:51:53.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T15:51:53.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T15:51:53.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T15:51:53.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T15:51:53.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T15:51:53.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T15:51:53.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-13T15:51:53.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T15:51:53.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T15:51:53.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-13T15:51:53.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-13T15:51:53.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T15:51:53.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T15:51:53.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T15:51:53.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T15:51:53.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-13T15:51:53.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T15:51:53.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T15:51:53.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-13T15:51:53.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-13T15:51:53.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-13T15:51:53.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T15:51:53.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T15:51:53.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-13T15:51:53.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T15:51:53.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T15:51:53.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T15:51:53.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T15:51:53.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T15:51:53.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T15:51:53.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T15:51:53.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T15:51:53.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T15:51:53.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T15:51:53.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T15:51:53.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T15:51:53.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T15:51:53.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T15:51:53.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T15:51:53.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T15:51:53.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T15:51:53.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T15:51:53.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T15:51:53.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T15:51:53.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T15:51:53.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T15:51:53.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T15:51:53.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T15:51:53.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T15:51:53.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T15:51:53.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T15:51:53.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T15:51:53.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T15:51:53.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T15:51:53.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T15:51:53.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-13T15:51:53.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T15:51:53.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T15:51:53.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T15:51:53.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T15:51:53.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T15:51:53.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-13T15:51:53.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T15:51:53.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T15:51:53.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-13T15:51:53.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T15:51:53.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T15:51:53.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T15:51:53.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-13T15:51:53.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T15:51:53.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T15:51:53.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-13T15:51:53.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T15:51:53.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-13T15:51:53.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T15:51:53.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-13T15:51:53.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T15:51:53.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-13T15:51:53.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T15:51:53.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T15:51:53.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-13T15:51:53.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T15:51:53.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-13T15:51:53.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-13T15:51:53.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T15:51:53.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-13T15:51:53.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T15:51:53.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T15:51:53.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T15:51:53.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-13T15:51:53.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-13T15:51:53.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-13T15:51:53.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-13T15:51:53.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-13T15:51:53.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T15:51:53.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-13T15:51:53.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T15:51:53.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T15:51:53.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-13T15:51:53.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T15:51:53.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T15:51:53.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-13T15:51:53.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T15:51:53.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T15:51:53.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T15:51:53.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T15:51:53.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T15:51:53.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T15:51:53.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T15:51:53.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-13T15:51:53.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T15:51:53.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T15:51:53.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T15:51:53.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-13T15:51:53.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T15:51:53.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T15:51:53.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T15:51:53.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-13T15:51:53.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T15:51:53.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-13T15:51:53.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T15:51:53.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-13T15:51:53.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T15:51:53.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T15:51:53.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T15:51:53.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T15:51:53.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-13T15:51:53.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T15:51:53.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-13T15:51:53.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T15:51:53.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T15:51:53.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-13T15:51:53.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T15:51:53.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T15:51:53.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T15:51:53.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-13T15:51:53.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T15:51:53.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T15:51:53.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-13T15:51:53.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T15:51:53.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T15:51:53.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T15:51:53.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T15:51:53.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T15:51:53.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T15:51:53.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T15:51:53.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T15:51:53.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T15:51:53.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T15:51:53.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T15:51:53.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-13T15:51:53.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T15:51:53.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T15:51:53.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T15:51:53.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T15:51:53.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-13T15:51:53.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T15:51:53.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-13T15:51:53.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-13T15:51:53.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T15:51:53.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-13T15:51:53.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T15:51:53.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T15:51:53.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T15:51:53.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T15:51:53.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T15:51:53.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T15:51:53.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-13T15:51:53.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T15:51:53.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-13T15:51:53.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-13T15:51:53.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-13T15:51:53.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T15:51:53.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T15:51:53.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T15:51:53.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T15:51:53.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T15:51:53.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T15:51:53.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T15:51:53.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T15:51:53.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T15:51:53.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T15:51:53.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T15:51:53.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T15:51:53.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T15:51:53.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T15:51:53.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T15:51:53.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T15:51:53.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T15:51:53.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T15:51:53.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-13T15:51:53.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-13T15:51:53.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T15:51:53.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T15:51:53.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T15:51:53.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T15:51:53.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-13T15:51:53.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-13T15:51:53.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T15:51:53.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T15:51:53.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-13T15:51:53.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T15:51:53.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-13T15:51:53.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-13T15:51:53.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T15:51:53.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-13T15:51:53.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T15:51:53.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-13T15:51:53.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T15:51:53.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T15:51:53.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T15:51:53.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T15:51:53.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T15:51:53.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-13T15:51:53.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-13T15:51:53.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T15:51:53.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T15:51:53.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T15:51:53.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T15:51:53.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-13T15:51:53.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T15:51:53.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-13T15:51:53.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T15:51:53.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T15:51:53.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-13T15:51:53.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T15:51:53.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T15:51:53.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T15:51:53.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T15:51:53.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T15:51:53.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T15:51:53.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T15:51:53.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T15:51:53.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T15:51:53.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T15:51:53.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-13T15:51:53.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T15:51:53.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T15:51:53.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T15:51:53.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T15:51:53.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T15:51:53.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T15:51:53.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T15:51:53.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-13T15:51:53.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T15:51:53.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-13T15:51:53.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T15:51:53.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T15:51:53.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T15:51:53.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T15:51:53.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T15:51:53.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T15:51:53.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T15:51:53.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T15:51:53.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T15:51:53.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T15:51:53.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T15:51:53.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T15:51:53.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T15:51:53.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T15:51:53.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T15:51:53.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T15:51:53.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T15:51:53.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T15:51:53.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T15:51:53.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T15:51:53.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T15:51:53.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T15:51:53.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T15:51:53.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T15:51:53.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T15:51:53.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T15:51:53.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T15:51:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T15:51:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T15:51:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T15:51:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T15:51:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T15:51:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T15:51:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T15:51:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T15:51:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T15:51:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T15:51:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T15:51:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T15:51:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T15:51:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T15:51:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T15:51:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T15:51:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T15:51:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T15:51:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-13T15:51:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T15:51:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T15:51:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T15:51:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T15:51:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T15:51:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T15:51:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T15:51:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T15:51:53.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T15:51:53.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T15:51:53.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T15:51:53.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T15:51:53.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T15:51:53.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T15:51:53.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T15:51:53.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-13T15:51:53.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T15:51:53.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T15:51:53.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T15:51:53.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-13T15:51:53.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-13T15:51:53.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T15:51:53.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T15:51:53.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T15:51:53.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T15:51:53.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-13T15:51:53.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T15:51:53.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T15:51:53.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T15:51:53.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T15:51:53.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-13T15:51:53.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-13T15:51:53.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T15:51:53.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T15:51:53.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T15:51:53.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-13T15:51:53.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-13T15:51:53.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-13T15:51:53.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-13T15:51:53.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-13T15:51:53.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-13T15:51:53.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-13T15:51:53.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-13T15:51:53.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-13T15:51:53.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-13T15:51:53.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T15:51:53.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T15:51:53.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-13T15:51:53.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T15:51:53.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T15:51:53.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T15:51:53.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T15:51:53.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T15:51:53.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T15:51:53.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T15:51:53.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T15:51:53.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T15:51:53.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T15:51:53.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T15:51:53.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T15:51:53.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-13T15:51:53.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T15:51:53.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T15:51:53.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T15:51:53.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T15:51:53.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T15:51:53.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T15:51:53.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T15:51:53.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T15:51:53.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T15:51:53.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T15:51:53.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T15:51:53.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T15:51:53.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T15:51:53.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T15:51:53.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T15:51:53.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T15:51:53.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T15:51:53.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T15:51:53.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T15:51:53.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T15:51:53.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T15:51:53.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T15:51:53.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T15:51:53.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T15:51:53.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T15:51:53.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T15:51:53.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-13T15:51:53.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-13T15:51:53.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T15:51:53.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T15:51:53.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T15:51:53.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-13T15:51:53.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T15:51:53.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T15:51:53.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-13T15:51:53.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T15:51:53.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-13T15:51:53.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-13T15:51:53.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T15:51:53.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-13T15:51:53.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T15:51:53.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-13T15:51:53.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T15:51:53.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T15:51:53.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-13T15:51:53.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T15:51:53.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-13T15:51:53.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T15:51:53.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-13T15:51:53.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T15:51:53.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-13T15:51:53.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T15:51:53.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-13T15:51:53.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T15:51:53.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-13T15:51:53.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T15:51:53.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-13T15:51:53.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-13T15:51:53.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-13T15:51:53.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T15:51:53.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-13T15:51:53.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-13T15:51:53.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T15:51:53.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-13T15:51:53.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-13T15:51:53.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T15:51:53.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-13T15:51:53.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-13T15:51:53.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T15:51:53.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-13T15:51:53.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T15:51:53.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-13T15:51:53.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T15:51:53.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-13T15:51:53.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T15:51:53.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-13T15:51:53.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T15:51:53.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-13T15:51:53.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T15:51:53.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-13T15:51:53.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T15:51:53.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-13T15:51:53.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T15:51:53.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-13T15:51:53.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-13T15:51:53.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T15:51:53.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-13T15:51:53.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T15:51:53.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-13T15:51:53.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T15:51:53.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T15:51:53.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T15:51:53.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T15:51:53.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-13T15:51:53.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T15:51:53.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T15:51:53.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-13T15:51:53.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T15:51:53.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-13T15:51:53.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T15:51:53.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-13T15:51:53.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T15:51:53.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T15:51:53.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T15:51:53.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T15:51:53.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T15:51:53.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T15:51:53.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T15:51:53.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T15:51:53.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T15:51:53.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T15:51:53.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T15:51:53.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T15:51:53.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T15:51:53.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T15:51:53.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T15:51:53.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T15:51:53.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T15:51:53.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T15:51:53.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T15:51:53.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T15:51:53.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T15:51:53.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T15:51:53.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T15:51:53.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T15:51:53.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T15:51:53.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T15:51:53.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T15:51:53.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T15:51:53.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T15:51:53.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T15:51:53.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T15:51:53.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T15:51:53.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T15:51:53.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T15:51:53.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T15:51:53.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T15:51:53.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T15:51:53.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T15:51:53.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T15:51:53.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T15:51:53.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T15:51:53.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T15:51:53.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T15:51:53.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T15:51:53.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T15:51:53.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T15:51:53.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T15:51:53.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T15:51:53.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T15:51:53.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T15:51:53.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-13T15:51:53.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-13T15:51:53.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T15:51:53.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-13T15:51:53.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T15:51:53.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-13T15:51:53.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T15:51:53.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T15:51:53.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T15:51:53.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T15:51:53.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T15:51:53.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-13T15:51:53.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T15:51:53.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-13T15:51:53.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T15:51:53.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-13T15:51:53.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T15:51:53.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-13T15:51:53.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T15:51:53.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-13T15:51:53.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-13T15:51:53.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T15:51:53.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-13T15:51:53.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T15:51:53.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T15:51:53.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-13T15:51:53.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T15:51:53.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-13T15:51:53.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T15:51:53.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-13T15:51:53.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T15:51:53.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-13T15:51:53.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T15:51:53.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-13T15:51:53.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T15:51:53.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-13T15:51:53.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-13T15:51:53.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-13T15:51:53.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T15:51:53.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-13T15:51:53.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-13T15:51:53.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-13T15:51:53.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-13T15:51:53.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T15:51:53.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T15:51:53.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-13T15:51:53.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-13T15:51:53.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T15:51:53.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T15:51:53.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T15:51:53.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T15:51:53.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-13T15:51:53.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T15:51:53.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T15:51:53.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-13T15:51:53.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T15:51:53.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-13T15:51:53.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T15:51:53.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-13T15:51:53.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T15:51:53.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T15:51:53.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T15:51:53.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T15:51:53.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-13T15:51:53.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-13T15:51:53.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-13T15:51:53.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T15:51:53.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-13T15:51:53.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-13T15:51:53.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T15:51:53.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T15:51:53.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T15:51:53.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T15:51:53.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T15:51:53.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T15:51:53.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T15:51:53.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T15:51:53.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-13T15:51:53.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T15:51:53.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T15:51:53.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T15:51:53.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T15:51:53.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T15:51:53.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-13T15:51:53.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T15:51:53.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-13T15:51:53.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T15:51:53.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T15:51:53.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T15:51:53.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T15:51:53.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-13T15:51:53.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T15:51:53.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-13T15:51:53.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T15:51:53.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T15:51:53.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-13T15:51:53.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T15:51:53.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T15:51:53.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T15:51:53.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T15:51:53.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T15:51:53.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T15:51:53.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T15:51:53.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T15:51:53.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T15:51:53.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T15:51:53.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T15:51:53.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T15:51:53.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T15:51:53.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T15:51:53.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T15:51:53.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T15:51:53.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T15:51:53.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T15:51:53.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T15:51:53.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T15:51:53.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T15:51:53.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-13T15:51:53.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T15:51:53.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T15:51:53.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-13T15:51:53.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T15:51:53.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-13T15:51:53.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-13T15:51:53.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T15:51:53.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-13T15:51:53.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T15:51:53.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T15:51:53.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T15:51:53.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T15:51:53.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-13T15:51:53.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-13T15:51:53.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-13T15:51:53.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T15:51:53.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T15:51:53.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T15:51:53.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T15:51:53.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T15:51:53.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-13T15:51:53.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-13T15:51:53.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T15:51:53.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T15:51:53.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T15:51:53.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-13T15:51:53.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T15:51:53.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T15:51:53.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T15:51:53.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T15:51:53.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T15:51:53.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T15:51:53.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T15:51:53.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T15:51:53.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T15:51:53.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T15:51:53.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-13T15:51:53.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T15:51:53.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T15:51:53.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T15:51:53.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T15:51:53.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T15:51:53.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T15:51:53.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T15:51:53.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T15:51:53.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T15:51:53.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T15:51:53.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T15:51:53.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T15:51:53.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T15:51:53.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T15:51:53.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T15:51:53.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T15:51:53.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T15:51:53.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T15:51:53.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T15:51:53.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T15:51:53.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T15:51:53.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T15:51:53.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T15:51:53.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T15:51:53.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T15:51:53.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T15:51:53.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T15:51:53.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T15:51:53.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T15:51:53.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T15:51:53.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T15:51:53.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T15:51:53.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T15:51:53.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T15:51:53.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T15:51:53.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T15:51:53.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T15:51:53.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T15:51:53.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-13T15:51:53.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T15:51:53.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T15:51:53.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T15:51:53.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T15:51:53.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T15:51:53.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T15:51:53.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T15:51:53.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-13T15:51:53.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T15:51:53.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T15:51:53.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T15:51:53.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T15:51:53.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T15:51:53.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T15:51:53.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T15:51:53.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T15:51:53.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T15:51:53.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T15:51:53.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T15:51:53.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T15:51:53.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T15:51:53.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T15:51:53.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T15:51:53.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T15:51:53.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T15:51:53.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T15:51:53.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T15:51:53.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T15:51:53.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T15:51:53.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T15:51:53.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T15:51:53.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T15:51:53.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T15:51:53.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T15:51:53.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T15:51:53.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-13T15:51:53.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T15:51:53.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-13T15:51:53.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T15:51:53.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T15:51:53.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T15:51:53.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T15:51:53.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T15:51:53.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T15:51:53.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T15:51:53.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-13T15:51:53.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T15:51:53.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-13T15:51:53.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T15:51:53.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-13T15:51:53.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T15:51:53.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-13T15:51:53.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-13T15:51:53.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T15:51:53.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T15:51:53.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T15:51:53.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T15:51:53.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T15:51:53.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T15:51:53.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T15:51:53.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T15:51:53.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T15:51:53.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T15:51:53.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T15:51:53.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T15:51:53.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T15:51:53.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T15:51:53.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T15:51:53.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T15:51:53.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-13T15:51:53.748 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T15:51:53.751 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T15:51:53.751 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T15:51:53.751 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T15:51:53.751 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T15:51:53.751 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T15:51:53.751 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T15:51:53.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T15:51:53.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T15:51:53.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T15:51:53.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T15:51:53.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T15:51:53.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T15:51:53.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T15:51:53.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T15:51:53.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T15:51:53.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T15:51:53.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T15:51:53.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T15:51:53.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T15:51:53.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T15:51:53.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T15:51:53.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T15:51:53.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T15:51:53.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T15:51:53.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T15:51:53.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T15:51:53.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T15:51:53.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T15:51:53.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T15:51:53.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T15:51:53.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T15:51:53.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T15:51:53.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T15:51:53.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T15:51:53.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T15:51:53.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T15:51:53.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T15:51:53.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T15:51:53.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T15:51:53.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T15:51:53.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T15:51:53.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T15:51:53.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T15:51:53.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T15:51:53.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T15:51:53.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T15:51:53.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T15:51:53.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T15:51:53.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T15:51:53.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T15:51:53.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T15:51:53.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T15:51:53.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T15:51:53.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T15:51:53.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T15:51:53.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T15:51:53.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T15:51:53.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-13T15:51:53.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T15:51:53.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T15:51:53.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T15:51:53.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T15:51:53.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-13T15:51:53.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T15:51:53.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T15:51:53.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T15:51:53.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T15:51:53.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T15:51:53.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T15:51:53.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T15:51:53.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T15:51:53.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T15:51:53.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T15:51:53.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T15:51:53.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T15:51:53.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T15:51:53.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T15:51:53.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T15:51:53.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T15:51:53.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T15:51:53.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T15:51:53.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T15:51:53.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T15:51:53.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T15:51:53.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T15:51:53.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T15:51:53.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T15:51:53.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T15:51:53.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T15:51:53.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T15:51:53.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T15:51:53.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T15:51:53.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T15:51:53.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T15:51:53.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T15:51:53.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T15:51:53.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T15:51:53.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T15:51:53.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T15:51:53.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T15:51:53.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T15:51:53.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T15:51:53.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T15:51:53.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T15:51:53.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T15:51:53.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T15:51:53.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T15:51:53.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T15:51:53.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T15:51:53.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T15:51:53.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T15:51:53.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T15:51:53.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T15:51:53.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T15:51:53.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T15:51:53.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T15:51:53.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T15:51:53.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T15:51:53.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T15:51:53.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T15:51:53.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T15:51:53.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T15:51:53.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T15:51:53.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T15:51:53.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T15:51:53.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T15:51:53.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T15:51:53.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T15:51:53.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T15:51:53.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T15:51:53.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T15:51:53.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T15:51:53.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T15:51:53.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T15:51:53.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-13T15:51:53.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T15:51:53.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-13T15:51:53.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T15:51:53.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-13T15:51:53.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T15:51:53.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T15:51:53.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T15:51:53.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T15:51:53.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-13T15:51:53.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T15:51:53.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-13T15:51:53.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T15:51:53.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T15:51:53.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T15:51:53.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-13T15:51:53.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T15:51:53.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T15:51:53.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T15:51:53.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T15:51:53.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T15:51:53.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T15:51:53.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T15:51:53.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T15:51:53.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T15:51:53.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T15:51:53.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T15:51:53.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T15:51:53.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T15:51:53.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T15:51:53.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T15:51:53.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T15:51:53.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T15:51:53.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T15:51:53.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T15:51:53.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T15:51:53.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T15:51:53.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T15:51:53.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T15:51:53.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T15:51:53.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T15:51:53.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T15:51:53.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T15:51:53.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T15:51:53.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T15:51:53.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T15:51:53.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T15:51:53.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T15:51:53.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T15:51:53.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T15:51:53.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T15:51:53.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T15:51:53.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T15:51:53.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T15:51:53.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T15:51:53.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T15:51:53.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T15:51:53.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T15:51:53.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T15:51:53.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-13T15:51:53.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T15:51:53.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T15:51:53.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-13T15:51:53.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-13T15:51:53.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T15:51:53.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T15:51:53.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T15:51:53.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-13T15:51:53.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T15:51:53.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-13T15:51:53.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T15:51:53.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T15:51:53.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-13T15:51:53.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T15:51:53.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-13T15:51:53.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T15:51:53.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T15:51:53.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T15:51:53.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T15:51:53.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T15:51:53.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-13T15:51:53.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T15:51:53.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-13T15:51:53.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-13T15:51:53.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-13T15:51:53.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-13T15:51:53.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-13T15:51:53.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-13T15:51:53.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T15:51:53.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T15:51:53.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T15:51:53.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T15:51:53.768 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T15:51:53.768 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T15:51:53.768 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T15:51:53.768 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T15:51:53.768 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T15:51:53.768 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T15:51:53.768 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T15:51:53.768 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T15:51:53.768 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T15:51:53.768 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-13T15:51:53.768 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T15:51:53.772 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:51:53.772 DEBUG:teuthology.orchestra.run.smithi107:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-13T15:51:53.794 INFO:teuthology.orchestra.run.smithi107.stdout:postinstall scriptlet (using /bin/sh): 2024-09-13T15:51:53.795 INFO:teuthology.orchestra.run.smithi107.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T15:51:53.795 INFO:teuthology.orchestra.run.smithi107.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T15:51:53.795 INFO:teuthology.orchestra.run.smithi107.stdout:fi 2024-09-13T15:51:53.795 INFO:teuthology.orchestra.run.smithi107.stdout:for file in vmlinuz System.map config; do 2024-09-13T15:51:53.795 INFO:teuthology.orchestra.run.smithi107.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-13T15:51:53.795 INFO:teuthology.orchestra.run.smithi107.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T15:51:53.795 INFO:teuthology.orchestra.run.smithi107.stdout: fi 2024-09-13T15:51:53.795 INFO:teuthology.orchestra.run.smithi107.stdout:done 2024-09-13T15:51:53.795 INFO:teuthology.orchestra.run.smithi107.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-13T15:51:53.795 INFO:teuthology.orchestra.run.smithi107.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-13T15:51:53.796 INFO:teuthology.orchestra.run.smithi107.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T15:51:53.796 INFO:teuthology.orchestra.run.smithi107.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T15:51:53.796 INFO:teuthology.orchestra.run.smithi107.stdout:fi 2024-09-13T15:51:53.796 INFO:teuthology.orchestra.run.smithi107.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-13T15:51:53.796 INFO:teuthology.orchestra.run.smithi107.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:51:53.796 INFO:teuthology.orchestra.run.smithi107.stdout:fi 2024-09-13T15:51:53.796 INFO:teuthology.orchestra.run.smithi107.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-13T15:51:53.796 INFO:teuthology.orchestra.run.smithi107.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T15:51:53.796 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:51:53.796 INFO:teuthology.orchestra.run.smithi107.stdout:fi 2024-09-13T15:51:53.798 DEBUG:teuthology.orchestra.run.smithi107:> sudo rpm -qi grub2-tools 2024-09-13T15:51:53.872 INFO:teuthology.orchestra.run.smithi107.stdout:Name : grub2-tools 2024-09-13T15:51:53.874 INFO:teuthology.orchestra.run.smithi107.stdout:Epoch : 1 2024-09-13T15:51:53.874 INFO:teuthology.orchestra.run.smithi107.stdout:Version : 2.06 2024-09-13T15:51:53.875 INFO:teuthology.orchestra.run.smithi107.stdout:Release : 82.el9 2024-09-13T15:51:53.875 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: x86_64 2024-09-13T15:51:53.875 INFO:teuthology.orchestra.run.smithi107.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T15:51:53.875 INFO:teuthology.orchestra.run.smithi107.stdout:Group : Unspecified 2024-09-13T15:51:53.876 INFO:teuthology.orchestra.run.smithi107.stdout:Size : 8274670 2024-09-13T15:51:53.876 INFO:teuthology.orchestra.run.smithi107.stdout:License : GPLv3+ 2024-09-13T15:51:53.877 INFO:teuthology.orchestra.run.smithi107.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T15:51:53.877 INFO:teuthology.orchestra.run.smithi107.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T15:51:53.877 INFO:teuthology.orchestra.run.smithi107.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T15:51:53.877 INFO:teuthology.orchestra.run.smithi107.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T15:51:53.878 INFO:teuthology.orchestra.run.smithi107.stdout:Packager : builder@centos.org 2024-09-13T15:51:53.878 INFO:teuthology.orchestra.run.smithi107.stdout:Vendor : CentOS 2024-09-13T15:51:53.878 INFO:teuthology.orchestra.run.smithi107.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T15:51:53.878 INFO:teuthology.orchestra.run.smithi107.stdout:Summary : Support tools for GRUB. 2024-09-13T15:51:53.878 INFO:teuthology.orchestra.run.smithi107.stdout:Description : 2024-09-13T15:51:53.878 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T15:51:53.878 INFO:teuthology.orchestra.run.smithi107.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T15:51:53.878 INFO:teuthology.orchestra.run.smithi107.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T15:51:53.879 INFO:teuthology.orchestra.run.smithi107.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T15:51:53.879 INFO:teuthology.orchestra.run.smithi107.stdout:hardware devices. 2024-09-13T15:51:53.879 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T15:51:53.879 INFO:teuthology.orchestra.run.smithi107.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T15:51:53.880 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T15:51:53.880 INFO:teuthology.task.kernel:Updating grub on smithi107 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:51:53.880 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T15:51:54.441 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2024-09-13T15:51:54.752 INFO:teuthology.orchestra.run.smithi070.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T15:51:54.779 INFO:teuthology.orchestra.run.smithi070.stderr:done 2024-09-13T15:51:54.782 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-13T15:51:54.797 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.p73TOrJrmQ 2024-09-13T15:51:54.797 DEBUG:teuthology.orchestra.run.smithi070:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.p73TOrJrmQ 2024-09-13T15:51:54.864 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.p73TOrJrmQ 2024-09-13T15:51:55.003 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.p73TOrJrmQ is 6KB 2024-09-13T15:51:55.051 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.p73TOrJrmQ 2024-09-13T15:51:55.066 DEBUG:teuthology.orchestra.run.smithi070:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T15:51:55.129 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T15:51:55.129 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T15:51:55.129 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T15:51:55.129 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-13T15:51:55.130 DEBUG:teuthology.orchestra.run.smithi070:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:51:55.279 DEBUG:teuthology.orchestra.run.smithi070:> sudo shutdown -r now 2024-09-13T15:51:55.799 INFO:teuthology.orchestra.run.smithi107.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T15:51:55.836 INFO:teuthology.orchestra.run.smithi107.stderr:done 2024-09-13T15:51:55.838 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-09-13T15:51:55.854 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.PeTrs27DOA 2024-09-13T15:51:55.854 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.PeTrs27DOA 2024-09-13T15:51:55.921 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.PeTrs27DOA 2024-09-13T15:51:56.061 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.PeTrs27DOA is 6KB 2024-09-13T15:51:56.109 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.PeTrs27DOA 2024-09-13T15:51:56.124 DEBUG:teuthology.orchestra.run.smithi107:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T15:51:56.186 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T15:51:56.186 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T15:51:56.186 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T15:51:56.186 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-13T15:51:56.188 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:51:56.347 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2024-09-13T15:52:25.309 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-13T15:52:25.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-13T15:52:25.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:52:26.350 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-13T15:52:26.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-13T15:52:26.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:53:00.989 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-09-13T15:53:09.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-13T15:53:10.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:53:25.337 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T15:53:28.381 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-09-13T15:53:34.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-13T15:53:34.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:53:35.897 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-13T15:53:36.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-13T15:53:36.487 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T15:53:36.487 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-13T15:53:36.522 INFO:teuthology.orchestra.run.smithi070.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:53:36.523 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:53:36.523 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T15:53:36.523 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T15:53:37.529 DEBUG:teuthology.parallel:result is None 2024-09-13T15:53:40.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-13T15:53:40.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:53:40.846 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-09-13T15:53:41.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-13T15:53:41.402 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T15:53:41.403 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-09-13T15:53:41.437 INFO:teuthology.orchestra.run.smithi107.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:53:41.437 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:53:41.437 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T15:53:41.437 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T15:53:42.438 DEBUG:teuthology.parallel:result is None 2024-09-13T15:53:42.439 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T15:53:42.447 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T15:53:42.448 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T15:53:42.454 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T15:53:42.490 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T15:53:42.500 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T15:53:42.509 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T15:53:42.509 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T15:53:42.530 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T15:53:42.574 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T15:53:42.580 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T15:53:42.581 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T15:53:42.613 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T15:53:42.724 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T15:53:42.731 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T15:53:42.771 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T15:53:42.807 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T15:53:42.810 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T15:53:42.818 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T15:53:42.818 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T15:53:42.823 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T15:53:42.879 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T15:53:42.888 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T15:53:42.888 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T15:53:42.893 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T15:53:42.927 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T15:53:43.042 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T15:53:43.111 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T15:53:43.185 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T15:53:43.251 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T15:53:43.252 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T15:53:43.307 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T15:53:43.385 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T15:53:43.457 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T15:53:43.602 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T15:53:43.669 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T15:53:43.669 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T15:53:43.750 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-09-13T15:53:43.754 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-09-13T15:53:43.839 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T15:53:43.851 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T15:53:44.090 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T15:53:44.099 INFO:teuthology.task.internal:Starting timer... 2024-09-13T15:53:44.099 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T15:53:44.111 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T15:53:44.120 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-13T15:53:44.121 DEBUG:teuthology.orchestra.run.smithi070:> sudo service auditd rotate 2024-09-13T15:53:44.218 INFO:teuthology.orchestra.run.smithi070.stdout:Rotating logs: 2024-09-13T15:53:44.222 DEBUG:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2024-09-13T15:53:44.317 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: 2024-09-13T15:53:44.321 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T15:53:44.321 DEBUG:teuthology.orchestra.run.smithi070:> /usr/sbin/getenforce 2024-09-13T15:53:44.361 INFO:teuthology.orchestra.run.smithi070.stdout:Permissive 2024-09-13T15:53:44.362 DEBUG:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2024-09-13T15:53:44.405 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2024-09-13T15:53:44.405 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi070.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi107.front.sepia.ceph.com': 'permissive'} 2024-09-13T15:53:44.406 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T15:53:44.461 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:53:44.462 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T15:53:44.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:53:44.521 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T15:53:44.521 DEBUG:teuthology.orchestra.run.smithi070:> sudo /usr/sbin/setenforce permissive 2024-09-13T15:53:44.584 DEBUG:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2024-09-13T15:53:44.710 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T15:53:44.720 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-13T15:53:44.723 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-13T15:53:44.868 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T15:53:44.878 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T15:53:44.879 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi070.front.sepia.ceph.com,smithi107.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T15:58:31.902 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi107.front.sepia.ceph.com')] 2024-09-13T15:58:31.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-13T15:58:31.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:58:32.018 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-13T15:58:32.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-13T15:58:32.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-13T15:58:32.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:58:32.224 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-09-13T15:58:32.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-13T15:58:32.327 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T15:58:32.337 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T15:58:32.338 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T15:58:32.338 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T15:58:32.342 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T15:58:32.342 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T15:58:32.399 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T15:58:32.427 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T15:58:32.428 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T15:58:32.457 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T15:58:32.479 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: ntpd: command not found 2024-09-13T15:58:32.503 INFO:teuthology.orchestra.run.smithi070.stdout:506 Cannot talk to daemon 2024-09-13T15:58:32.507 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2024-09-13T15:58:32.532 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2024-09-13T15:58:32.532 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T15:58:32.560 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T15:58:32.561 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T15:58:32.589 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T15:58:32.668 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-09-13T15:58:32.675 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T15:58:32.676 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-09-13T15:58:32.676 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:58:32.676 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:58:32.676 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:58:32.676 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:58:32.685 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-09-13T15:58:32.691 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T15:58:32.692 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-09-13T15:58:32.692 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:58:32.692 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:58:32.692 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:58:32.692 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:58:32.693 INFO:teuthology.run_tasks:Running task install... 2024-09-13T15:58:32.701 DEBUG:teuthology.task.install:project ceph 2024-09-13T15:58:32.701 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}} 2024-09-13T15:58:32.701 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'} 2024-09-13T15:58:32.701 INFO:teuthology.task.install:Using flavor: default 2024-09-13T15:58:32.706 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T15:58:32.707 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T15:58:32.707 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'tag': None, 'wait_for_package': False} 2024-09-13T15:58:32.707 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:58:32.709 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'tag': None, 'wait_for_package': False} 2024-09-13T15:58:32.710 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:58:32.854 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/ 2024-09-13T15:58:32.855 INFO:teuthology.task.install.rpm:Package version is 18.2.4-850.g50bbe7f3 2024-09-13T15:58:32.868 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/ 2024-09-13T15:58:32.868 INFO:teuthology.task.install.rpm:Package version is 18.2.4-850.g50bbe7f3 2024-09-13T15:58:32.974 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T15:58:32.974 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T15:58:32.974 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T15:58:32.985 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T15:58:32.985 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T15:58:32.985 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T15:58:33.031 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T15:58:33.031 DEBUG:teuthology.orchestra.run.smithi070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50bbe7f395997dcd871813949c49addbbf630361/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T15:58:33.041 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T15:58:33.041 DEBUG:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50bbe7f395997dcd871813949c49addbbf630361/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T15:58:33.129 DEBUG:teuthology.orchestra.run.smithi070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T15:58:33.138 DEBUG:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T15:58:33.207 DEBUG:teuthology.orchestra.run.smithi070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T15:58:33.216 DEBUG:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T15:58:33.262 INFO:teuthology.orchestra.run.smithi070.stdout:check_obsoletes = 1 2024-09-13T15:58:33.265 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum clean all 2024-09-13T15:58:33.271 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2024-09-13T15:58:33.274 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum clean all 2024-09-13T15:58:33.534 INFO:teuthology.orchestra.run.smithi070.stdout:45 files removed 2024-09-13T15:58:33.551 INFO:teuthology.orchestra.run.smithi107.stdout:45 files removed 2024-09-13T15:58:33.567 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T15:58:33.587 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T15:58:34.273 INFO:teuthology.orchestra.run.smithi070.stdout:ceph packages for x86_64 247 kB/s | 77 kB 00:00 2024-09-13T15:58:34.314 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 234 kB/s | 77 kB 00:00 2024-09-13T15:58:34.582 INFO:teuthology.orchestra.run.smithi070.stdout:ceph noarch packages 43 kB/s | 11 kB 00:00 2024-09-13T15:58:34.639 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 41 kB/s | 11 kB 00:00 2024-09-13T15:58:34.874 INFO:teuthology.orchestra.run.smithi070.stdout:ceph source packages 7.3 kB/s | 1.9 kB 00:00 2024-09-13T15:58:34.956 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 6.7 kB/s | 1.9 kB 00:00 2024-09-13T15:58:35.474 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-13T15:58:37.099 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.2 MB 00:02 2024-09-13T15:58:37.592 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:00 2024-09-13T15:58:40.157 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-13T15:58:41.976 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 18 MB/s | 6.5 MB 00:00 2024-09-13T15:58:43.568 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-13T15:58:44.897 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-13T15:58:46.257 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-13T15:58:47.908 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 19 kB 00:00 2024-09-13T15:58:48.862 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-13T15:58:51.228 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-13T15:58:53.706 INFO:teuthology.orchestra.run.smithi070.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T15:58:53.706 INFO:teuthology.orchestra.run.smithi070.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T15:58:53.717 INFO:teuthology.orchestra.run.smithi070.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T15:58:53.718 INFO:teuthology.orchestra.run.smithi070.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T15:58:53.719 INFO:teuthology.orchestra.run.smithi070.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T15:58:53.720 INFO:teuthology.orchestra.run.smithi070.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T15:58:53.721 INFO:teuthology.orchestra.run.smithi070.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T15:58:53.723 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T15:58:53.724 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T15:58:53.786 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-13T15:58:53.801 INFO:teuthology.orchestra.run.smithi070.stdout:====================================================================================== 2024-09-13T15:58:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-13T15:58:53.801 INFO:teuthology.orchestra.run.smithi070.stdout:====================================================================================== 2024-09-13T15:58:53.801 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-13T15:58:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T15:58:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: ceph x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 6.5 k 2024-09-13T15:58:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 5.1 M 2024-09-13T15:58:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 852 k 2024-09-13T15:58:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 143 k 2024-09-13T15:58:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 1.5 M 2024-09-13T15:58:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 139 k 2024-09-13T15:58:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 3.5 M 2024-09-13T15:58:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 7.4 M 2024-09-13T15:58:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 49 k 2024-09-13T15:58:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 7.8 M 2024-09-13T15:58:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 40 M 2024-09-13T15:58:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 264 k 2024-09-13T15:58:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 226 k 2024-09-13T15:58:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 224 k 2024-09-13T15:58:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 18 k 2024-09-13T15:58:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T15:58:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T15:58:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T15:58:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 31 k 2024-09-13T15:58:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 712 k 2024-09-13T15:58:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 127 k 2024-09-13T15:58:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T15:58:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T15:58:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T15:58:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T15:58:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T15:58:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T15:58:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 162 k 2024-09-13T15:58:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 319 k 2024-09-13T15:58:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 301 k 2024-09-13T15:58:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 99 k 2024-09-13T15:58:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 87 k 2024-09-13T15:58:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T15:58:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 172 k 2024-09-13T15:58:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T15:58:53.804 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrading: 2024-09-13T15:58:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T15:58:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T15:58:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T15:58:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T15:58:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: librados2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.3 M 2024-09-13T15:58:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T15:58:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T15:58:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T15:58:53.805 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-13T15:58:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T15:58:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T15:58:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 18 M 2024-09-13T15:58:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 24 k 2024-09-13T15:58:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 2.1 M 2024-09-13T15:58:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 246 k 2024-09-13T15:58:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.7 M 2024-09-13T15:58:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 17 M 2024-09-13T15:58:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 16 k 2024-09-13T15:58:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 25 k 2024-09-13T15:58:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T15:58:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T15:58:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T15:58:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T15:58:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T15:58:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T15:58:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T15:58:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T15:58:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 166 k 2024-09-13T15:58:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T15:58:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T15:58:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T15:58:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T15:58:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T15:58:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 477 k 2024-09-13T15:58:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T15:58:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.5 M 2024-09-13T15:58:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T15:58:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T15:58:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T15:58:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T15:58:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T15:58:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T15:58:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T15:58:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T15:58:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T15:58:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T15:58:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T15:58:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 45 k 2024-09-13T15:58:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 129 k 2024-09-13T15:58:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T15:58:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T15:58:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T15:58:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T15:58:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T15:58:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T15:58:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T15:58:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T15:58:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T15:58:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T15:58:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T15:58:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T15:58:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T15:58:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T15:58:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T15:58:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T15:58:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T15:58:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T15:58:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T15:58:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T15:58:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T15:58:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T15:58:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T15:58:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T15:58:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T15:58:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T15:58:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T15:58:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T15:58:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T15:58:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T15:58:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T15:58:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T15:58:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T15:58:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T15:58:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T15:58:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T15:58:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T15:58:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T15:58:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T15:58:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T15:58:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T15:58:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T15:58:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T15:58:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T15:58:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T15:58:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T15:58:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T15:58:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T15:58:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T15:58:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T15:58:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T15:58:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T15:58:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T15:58:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T15:58:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T15:58:53.812 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-13T15:58:53.812 INFO:teuthology.orchestra.run.smithi070.stdout:====================================================================================== 2024-09-13T15:58:53.812 INFO:teuthology.orchestra.run.smithi070.stdout:Install 130 Packages 2024-09-13T15:58:53.812 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrade 8 Packages 2024-09-13T15:58:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T15:58:53.813 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 203 M 2024-09-13T15:58:53.813 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-13T15:58:54.279 INFO:teuthology.orchestra.run.smithi070.stdout:(1/138): ceph-18.2.4-850.g50bbe7f3.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-13T15:58:54.446 INFO:teuthology.orchestra.run.smithi070.stdout:(2/138): ceph-fuse-18.2.4-850.g50bbe7f3.el9.x86 5.0 MB/s | 852 kB 00:00 2024-09-13T15:58:54.513 INFO:teuthology.orchestra.run.smithi070.stdout:(3/138): ceph-immutable-object-cache-18.2.4-850 2.1 MB/s | 143 kB 00:00 2024-09-13T15:58:54.663 INFO:teuthology.orchestra.run.smithi070.stdout:(4/138): ceph-base-18.2.4-850.g50bbe7f3.el9.x86 10 MB/s | 5.1 MB 00:00 2024-09-13T15:58:54.730 INFO:teuthology.orchestra.run.smithi070.stdout:(5/138): ceph-mds-18.2.4-850.g50bbe7f3.el9.x86_ 9.7 MB/s | 2.1 MB 00:00 2024-09-13T15:58:54.797 INFO:teuthology.orchestra.run.smithi070.stdout:(6/138): ceph-mgr-18.2.4-850.g50bbe7f3.el9.x86_ 11 MB/s | 1.5 MB 00:00 2024-09-13T15:58:55.089 INFO:teuthology.orchestra.run.smithi070.stdout:(7/138): ceph-mon-18.2.4-850.g50bbe7f3.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-13T15:58:55.192 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-13T15:58:55.281 INFO:teuthology.orchestra.run.smithi070.stdout:(8/138): ceph-common-18.2.4-850.g50bbe7f3.el9.x 16 MB/s | 18 MB 00:01 2024-09-13T15:58:55.323 INFO:teuthology.orchestra.run.smithi070.stdout:(9/138): ceph-selinux-18.2.4-850.g50bbe7f3.el9. 607 kB/s | 25 kB 00:00 2024-09-13T15:58:55.548 INFO:teuthology.orchestra.run.smithi070.stdout:(10/138): ceph-radosgw-18.2.4-850.g50bbe7f3.el9 17 MB/s | 7.8 MB 00:00 2024-09-13T15:58:55.606 INFO:teuthology.orchestra.run.smithi070.stdout:(11/138): cephfs-mirror-18.2.4-850.g50bbe7f3.el 3.8 MB/s | 224 kB 00:00 2024-09-13T15:58:55.774 INFO:teuthology.orchestra.run.smithi070.stdout:(12/138): ceph-osd-18.2.4-850.g50bbe7f3.el9.x86 17 MB/s | 17 MB 00:00 2024-09-13T15:58:55.790 INFO:teuthology.orchestra.run.smithi070.stdout:(13/138): libcephfs-devel-18.2.4-850.g50bbe7f3. 169 kB/s | 31 kB 00:00 2024-09-13T15:58:55.832 INFO:teuthology.orchestra.run.smithi070.stdout:(14/138): libcephfs2-18.2.4-850.g50bbe7f3.el9.x 12 MB/s | 712 kB 00:00 2024-09-13T15:58:55.866 INFO:teuthology.orchestra.run.smithi070.stdout:(15/138): libcephsqlite-18.2.4-850.g50bbe7f3.el 2.2 MB/s | 166 kB 00:00 2024-09-13T15:58:55.891 INFO:teuthology.orchestra.run.smithi070.stdout:(16/138): librados-devel-18.2.4-850.g50bbe7f3.e 2.1 MB/s | 127 kB 00:00 2024-09-13T15:58:55.925 INFO:teuthology.orchestra.run.smithi070.stdout:(17/138): libradosstriper1-18.2.4-850.g50bbe7f3 7.9 MB/s | 477 kB 00:00 2024-09-13T15:58:56.001 INFO:teuthology.orchestra.run.smithi070.stdout:(18/138): python3-ceph-argparse-18.2.4-850.g50b 600 kB/s | 45 kB 00:00 2024-09-13T15:58:56.084 INFO:teuthology.orchestra.run.smithi070.stdout:(19/138): librgw2-18.2.4-850.g50bbe7f3.el9.x86_ 23 MB/s | 4.5 MB 00:00 2024-09-13T15:58:56.109 INFO:teuthology.orchestra.run.smithi070.stdout:(20/138): python3-ceph-common-18.2.4-850.g50bbe 1.2 MB/s | 129 kB 00:00 2024-09-13T15:58:56.136 INFO:teuthology.orchestra.run.smithi070.stdout:(21/138): python3-cephfs-18.2.4-850.g50bbe7f3.e 3.2 MB/s | 162 kB 00:00 2024-09-13T15:58:56.160 INFO:teuthology.orchestra.run.smithi070.stdout:(22/138): python3-rados-18.2.4-850.g50bbe7f3.el 6.2 MB/s | 319 kB 00:00 2024-09-13T15:58:56.185 INFO:teuthology.orchestra.run.smithi070.stdout:(23/138): python3-rbd-18.2.4-850.g50bbe7f3.el9. 5.9 MB/s | 301 kB 00:00 2024-09-13T15:58:56.211 INFO:teuthology.orchestra.run.smithi070.stdout:(24/138): python3-rgw-18.2.4-850.g50bbe7f3.el9. 1.9 MB/s | 99 kB 00:00 2024-09-13T15:58:56.236 INFO:teuthology.orchestra.run.smithi070.stdout:(25/138): rbd-fuse-18.2.4-850.g50bbe7f3.el9.x86 1.7 MB/s | 87 kB 00:00 2024-09-13T15:58:56.286 INFO:teuthology.orchestra.run.smithi070.stdout:(26/138): rbd-nbd-18.2.4-850.g50bbe7f3.el9.x86_ 3.4 MB/s | 172 kB 00:00 2024-09-13T15:58:56.362 INFO:teuthology.orchestra.run.smithi070.stdout:(27/138): rbd-mirror-18.2.4-850.g50bbe7f3.el9.x 20 MB/s | 3.0 MB 00:00 2024-09-13T15:58:56.387 INFO:teuthology.orchestra.run.smithi070.stdout:(28/138): ceph-grafana-dashboards-18.2.4-850.g5 244 kB/s | 24 kB 00:00 2024-09-13T15:58:56.412 INFO:teuthology.orchestra.run.smithi070.stdout:(29/138): ceph-mgr-cephadm-18.2.4-850.g50bbe7f3 2.7 MB/s | 139 kB 00:00 2024-09-13T15:58:56.571 INFO:teuthology.orchestra.run.smithi070.stdout:(30/138): ceph-mgr-dashboard-18.2.4-850.g50bbe7 19 MB/s | 3.5 MB 00:00 2024-09-13T15:58:56.638 INFO:teuthology.orchestra.run.smithi070.stdout:(31/138): ceph-mgr-modules-core-18.2.4-850.g50b 3.6 MB/s | 246 kB 00:00 2024-09-13T15:58:56.780 INFO:teuthology.orchestra.run.smithi070.stdout:(32/138): ceph-mgr-diskprediction-local-18.2.4- 20 MB/s | 7.4 MB 00:00 2024-09-13T15:58:56.805 INFO:teuthology.orchestra.run.smithi070.stdout:(33/138): ceph-mgr-rook-18.2.4-850.g50bbe7f3.el 296 kB/s | 49 kB 00:00 2024-09-13T15:58:56.830 INFO:teuthology.orchestra.run.smithi070.stdout:(34/138): ceph-prometheus-alerts-18.2.4-850.g50 329 kB/s | 16 kB 00:00 2024-09-13T15:58:56.864 INFO:teuthology.orchestra.run.smithi070.stdout:(35/138): ceph-volume-18.2.4-850.g50bbe7f3.el9. 4.4 MB/s | 264 kB 00:00 2024-09-13T15:58:56.889 INFO:teuthology.orchestra.run.smithi070.stdout:(36/138): cephadm-18.2.4-850.g50bbe7f3.el9.noar 3.8 MB/s | 226 kB 00:00 2024-09-13T15:58:56.915 INFO:teuthology.orchestra.run.smithi070.stdout:(37/138): cephfs-top-18.2.4-850.g50bbe7f3.el9.n 364 kB/s | 18 kB 00:00 2024-09-13T15:58:57.040 INFO:teuthology.orchestra.run.smithi070.stdout:(38/138): fuse-2.9.9-16.el9.x86_64.rpm 532 kB/s | 80 kB 00:00 2024-09-13T15:58:57.482 INFO:teuthology.orchestra.run.smithi070.stdout:(39/138): ceph-test-18.2.4-850.g50bbe7f3.el9.x8 18 MB/s | 40 MB 00:02 2024-09-13T15:58:57.507 INFO:teuthology.orchestra.run.smithi070.stdout:(40/138): libquadmath-11.5.0-2.el9.x86_64.rpm 409 kB/s | 191 kB 00:00 2024-09-13T15:58:57.541 INFO:teuthology.orchestra.run.smithi070.stdout:(41/138): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-13T15:58:57.634 INFO:teuthology.orchestra.run.smithi070.stdout:(42/138): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-09-13T15:58:57.717 INFO:teuthology.orchestra.run.smithi070.stdout:(43/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-13T15:58:57.729 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T15:58:57.730 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T15:58:57.741 INFO:teuthology.orchestra.run.smithi107.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T15:58:57.742 INFO:teuthology.orchestra.run.smithi107.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T15:58:57.743 INFO:teuthology.orchestra.run.smithi107.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T15:58:57.744 INFO:teuthology.orchestra.run.smithi107.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T15:58:57.746 INFO:teuthology.orchestra.run.smithi107.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T15:58:57.748 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T15:58:57.749 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T15:58:57.750 INFO:teuthology.orchestra.run.smithi070.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-13T15:58:57.813 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-13T15:58:57.834 INFO:teuthology.orchestra.run.smithi070.stdout:(45/138): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-13T15:58:57.838 INFO:teuthology.orchestra.run.smithi107.stdout:====================================================================================== 2024-09-13T15:58:57.838 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-13T15:58:57.838 INFO:teuthology.orchestra.run.smithi107.stdout:====================================================================================== 2024-09-13T15:58:57.838 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-13T15:58:57.838 INFO:teuthology.orchestra.run.smithi107.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T15:58:57.838 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 6.5 k 2024-09-13T15:58:57.838 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 5.1 M 2024-09-13T15:58:57.838 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 852 k 2024-09-13T15:58:57.838 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 143 k 2024-09-13T15:58:57.839 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 1.5 M 2024-09-13T15:58:57.839 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 139 k 2024-09-13T15:58:57.839 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 3.5 M 2024-09-13T15:58:57.839 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 7.4 M 2024-09-13T15:58:57.839 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 49 k 2024-09-13T15:58:57.839 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 7.8 M 2024-09-13T15:58:57.839 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 40 M 2024-09-13T15:58:57.839 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 264 k 2024-09-13T15:58:57.839 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 226 k 2024-09-13T15:58:57.839 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 224 k 2024-09-13T15:58:57.839 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 18 k 2024-09-13T15:58:57.839 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T15:58:57.840 INFO:teuthology.orchestra.run.smithi107.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T15:58:57.840 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T15:58:57.840 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 31 k 2024-09-13T15:58:57.840 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 712 k 2024-09-13T15:58:57.840 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 127 k 2024-09-13T15:58:57.840 INFO:teuthology.orchestra.run.smithi107.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T15:58:57.840 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T15:58:57.840 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T15:58:57.840 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T15:58:57.840 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T15:58:57.840 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T15:58:57.840 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 162 k 2024-09-13T15:58:57.841 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 319 k 2024-09-13T15:58:57.841 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 301 k 2024-09-13T15:58:57.841 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 99 k 2024-09-13T15:58:57.841 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 87 k 2024-09-13T15:58:57.841 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T15:58:57.841 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 172 k 2024-09-13T15:58:57.841 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T15:58:57.841 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2024-09-13T15:58:57.841 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T15:58:57.841 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T15:58:57.841 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T15:58:57.841 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T15:58:57.841 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.3 M 2024-09-13T15:58:57.842 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T15:58:57.842 INFO:teuthology.orchestra.run.smithi107.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T15:58:57.842 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T15:58:57.842 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-13T15:58:57.842 INFO:teuthology.orchestra.run.smithi107.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T15:58:57.842 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T15:58:57.842 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 18 M 2024-09-13T15:58:57.842 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 24 k 2024-09-13T15:58:57.842 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 2.1 M 2024-09-13T15:58:57.842 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 246 k 2024-09-13T15:58:57.842 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.7 M 2024-09-13T15:58:57.842 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 17 M 2024-09-13T15:58:57.842 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 16 k 2024-09-13T15:58:57.842 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 25 k 2024-09-13T15:58:57.842 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T15:58:57.843 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T15:58:57.843 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T15:58:57.843 INFO:teuthology.orchestra.run.smithi107.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T15:58:57.843 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T15:58:57.843 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T15:58:57.843 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T15:58:57.843 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T15:58:57.843 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 166 k 2024-09-13T15:58:57.843 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T15:58:57.843 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T15:58:57.843 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T15:58:57.843 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T15:58:57.843 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T15:58:57.843 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 477 k 2024-09-13T15:58:57.844 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T15:58:57.844 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.5 M 2024-09-13T15:58:57.844 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T15:58:57.844 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T15:58:57.844 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T15:58:57.844 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T15:58:57.844 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T15:58:57.844 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T15:58:57.844 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T15:58:57.844 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T15:58:57.844 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T15:58:57.844 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T15:58:57.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T15:58:57.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 45 k 2024-09-13T15:58:57.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 129 k 2024-09-13T15:58:57.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T15:58:57.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T15:58:57.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T15:58:57.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T15:58:57.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T15:58:57.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T15:58:57.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T15:58:57.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T15:58:57.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T15:58:57.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T15:58:57.846 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T15:58:57.846 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T15:58:57.846 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T15:58:57.846 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T15:58:57.846 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T15:58:57.846 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T15:58:57.846 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T15:58:57.846 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T15:58:57.846 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T15:58:57.846 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T15:58:57.846 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T15:58:57.846 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T15:58:57.847 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T15:58:57.847 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T15:58:57.847 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T15:58:57.847 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T15:58:57.847 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T15:58:57.847 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T15:58:57.847 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T15:58:57.847 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T15:58:57.847 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T15:58:57.847 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T15:58:57.847 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T15:58:57.847 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T15:58:57.848 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T15:58:57.848 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T15:58:57.848 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T15:58:57.848 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T15:58:57.848 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T15:58:57.848 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T15:58:57.848 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T15:58:57.848 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T15:58:57.848 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T15:58:57.848 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T15:58:57.848 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T15:58:57.848 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T15:58:57.849 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T15:58:57.849 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T15:58:57.849 INFO:teuthology.orchestra.run.smithi107.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T15:58:57.849 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T15:58:57.849 INFO:teuthology.orchestra.run.smithi107.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T15:58:57.849 INFO:teuthology.orchestra.run.smithi107.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T15:58:57.849 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T15:58:57.849 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T15:58:57.849 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T15:58:57.849 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-13T15:58:57.849 INFO:teuthology.orchestra.run.smithi107.stdout:====================================================================================== 2024-09-13T15:58:57.849 INFO:teuthology.orchestra.run.smithi107.stdout:Install 130 Packages 2024-09-13T15:58:57.849 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 8 Packages 2024-09-13T15:58:57.849 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T15:58:57.850 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 203 M 2024-09-13T15:58:57.850 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-13T15:58:57.943 INFO:teuthology.orchestra.run.smithi070.stdout:(46/138): python3-cryptography-36.0.1-4.el9.x86 2.8 MB/s | 1.2 MB 00:00 2024-09-13T15:58:57.977 INFO:teuthology.orchestra.run.smithi070.stdout:(47/138): python3-requests-2.25.1-8.el9.noarch. 482 kB/s | 125 kB 00:00 2024-09-13T15:58:58.077 INFO:teuthology.orchestra.run.smithi070.stdout:(48/138): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-13T15:58:58.127 INFO:teuthology.orchestra.run.smithi070.stdout:(49/138): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-13T15:58:58.236 INFO:teuthology.orchestra.run.smithi070.stdout:(50/138): automake-1.16.2-8.el9.noarch.rpm 1.7 MB/s | 689 kB 00:00 2024-09-13T15:58:58.286 INFO:teuthology.orchestra.run.smithi070.stdout:(51/138): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2024-09-13T15:58:58.320 INFO:teuthology.orchestra.run.smithi070.stdout:(52/138): bison-3.7.4-5.el9.x86_64.rpm 2.4 MB/s | 943 kB 00:00 2024-09-13T15:58:58.345 INFO:teuthology.orchestra.run.smithi070.stdout:(53/138): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-13T15:58:58.387 INFO:teuthology.orchestra.run.smithi070.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-09-13T15:58:58.412 INFO:teuthology.orchestra.run.smithi070.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-09-13T15:58:58.487 INFO:teuthology.orchestra.run.smithi070.stdout:(56/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 604 kB/s | 45 kB 00:00 2024-09-13T15:58:58.521 INFO:teuthology.orchestra.run.smithi070.stdout:(57/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-13T15:58:58.746 INFO:teuthology.orchestra.run.smithi070.stdout:(58/138): librdkafka-1.6.1-102.el9.x86_64.rpm 2.5 MB/s | 662 kB 00:00 2024-09-13T15:58:58.793 INFO:teuthology.orchestra.run.smithi107.stdout:(1/138): ceph-18.2.4-850.g50bbe7f3.el9.x86_64.r 45 kB/s | 6.5 kB 00:00 2024-09-13T15:58:58.813 INFO:teuthology.orchestra.run.smithi070.stdout:(59/138): libtool-2.4.6-46.el9.x86_64.rpm 1.9 MB/s | 581 kB 00:00 2024-09-13T15:58:58.839 INFO:teuthology.orchestra.run.smithi070.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 267 kB/s | 24 kB 00:00 2024-09-13T15:58:58.864 INFO:teuthology.orchestra.run.smithi070.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-13T15:58:58.930 INFO:teuthology.orchestra.run.smithi070.stdout:(62/138): openblas-0.3.26-2.el9.x86_64.rpm 579 kB/s | 38 kB 00:00 2024-09-13T15:58:58.977 INFO:teuthology.orchestra.run.smithi107.stdout:(2/138): ceph-fuse-18.2.4-850.g50bbe7f3.el9.x86 4.5 MB/s | 852 kB 00:00 2024-09-13T15:58:58.989 INFO:teuthology.orchestra.run.smithi070.stdout:(63/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-09-13T15:58:59.044 INFO:teuthology.orchestra.run.smithi107.stdout:(3/138): ceph-immutable-object-cache-18.2.4-850 2.1 MB/s | 143 kB 00:00 2024-09-13T15:58:59.144 INFO:teuthology.orchestra.run.smithi107.stdout:(4/138): ceph-base-18.2.4-850.g50bbe7f3.el9.x86 10 MB/s | 5.1 MB 00:00 2024-09-13T15:58:59.215 INFO:teuthology.orchestra.run.smithi070.stdout:(64/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.2 MB/s | 3.0 MB 00:00 2024-09-13T15:58:59.269 INFO:teuthology.orchestra.run.smithi107.stdout:(5/138): ceph-mgr-18.2.4-850.g50bbe7f3.el9.x86_ 12 MB/s | 1.5 MB 00:00 2024-09-13T15:58:59.344 INFO:teuthology.orchestra.run.smithi107.stdout:(6/138): ceph-mds-18.2.4-850.g50bbe7f3.el9.x86_ 7.0 MB/s | 2.1 MB 00:00 2024-09-13T15:58:59.590 INFO:teuthology.orchestra.run.smithi070.stdout:(65/138): postgresql-13.16-1.el9.x86_64.rpm 4.2 MB/s | 1.6 MB 00:00 2024-09-13T15:58:59.601 INFO:teuthology.orchestra.run.smithi107.stdout:(7/138): ceph-mon-18.2.4-850.g50bbe7f3.el9.x86_ 14 MB/s | 4.7 MB 00:00 2024-09-13T15:58:59.787 INFO:teuthology.orchestra.run.smithi107.stdout:(8/138): ceph-common-18.2.4-850.g50bbe7f3.el9.x 16 MB/s | 18 MB 00:01 2024-09-13T15:58:59.815 INFO:teuthology.orchestra.run.smithi070.stdout:(66/138): postgresql-contrib-13.16-1.el9.x86_64 4.0 MB/s | 910 kB 00:00 2024-09-13T15:58:59.854 INFO:teuthology.orchestra.run.smithi107.stdout:(9/138): ceph-selinux-18.2.4-850.g50bbe7f3.el9. 381 kB/s | 25 kB 00:00 2024-09-13T15:58:59.874 INFO:teuthology.orchestra.run.smithi070.stdout:(67/138): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-13T15:59:00.121 INFO:teuthology.orchestra.run.smithi107.stdout:(10/138): ceph-radosgw-18.2.4-850.g50bbe7f3.el9 15 MB/s | 7.8 MB 00:00 2024-09-13T15:59:00.140 INFO:teuthology.orchestra.run.smithi070.stdout:(68/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-09-13T15:59:00.171 INFO:teuthology.orchestra.run.smithi107.stdout:(11/138): cephfs-mirror-18.2.4-850.g50bbe7f3.el 4.4 MB/s | 224 kB 00:00 2024-09-13T15:59:00.254 INFO:teuthology.orchestra.run.smithi107.stdout:(12/138): libcephfs-devel-18.2.4-850.g50bbe7f3. 374 kB/s | 31 kB 00:00 2024-09-13T15:59:00.355 INFO:teuthology.orchestra.run.smithi107.stdout:(13/138): libcephfs2-18.2.4-850.g50bbe7f3.el9.x 7.0 MB/s | 712 kB 00:00 2024-09-13T15:59:00.416 INFO:teuthology.orchestra.run.smithi070.stdout:(69/138): openblas-openmp-0.3.26-2.el9.x86_64.r 3.3 MB/s | 4.9 MB 00:01 2024-09-13T15:59:00.439 INFO:teuthology.orchestra.run.smithi107.stdout:(14/138): libcephsqlite-18.2.4-850.g50bbe7f3.el 1.9 MB/s | 166 kB 00:00 2024-09-13T15:59:00.517 INFO:teuthology.orchestra.run.smithi070.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-13T15:59:00.617 INFO:teuthology.orchestra.run.smithi070.stdout:(71/138): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-13T15:59:00.630 INFO:teuthology.orchestra.run.smithi107.stdout:(15/138): ceph-osd-18.2.4-850.g50bbe7f3.el9.x86 13 MB/s | 17 MB 00:01 2024-09-13T15:59:00.655 INFO:teuthology.orchestra.run.smithi107.stdout:(16/138): librados-devel-18.2.4-850.g50bbe7f3.e 584 kB/s | 127 kB 00:00 2024-09-13T15:59:00.684 INFO:teuthology.orchestra.run.smithi070.stdout:(72/138): python3-jsonpatch-1.21-16.el9.noarch. 385 kB/s | 26 kB 00:00 2024-09-13T15:59:00.689 INFO:teuthology.orchestra.run.smithi107.stdout:(17/138): libradosstriper1-18.2.4-850.g50bbe7f3 8.0 MB/s | 477 kB 00:00 2024-09-13T15:59:00.742 INFO:teuthology.orchestra.run.smithi070.stdout:(73/138): python3-jsonpointer-2.0-4.el9.noarch. 330 kB/s | 19 kB 00:00 2024-09-13T15:59:00.764 INFO:teuthology.orchestra.run.smithi107.stdout:(18/138): python3-ceph-argparse-18.2.4-850.g50b 601 kB/s | 45 kB 00:00 2024-09-13T15:59:00.809 INFO:teuthology.orchestra.run.smithi070.stdout:(74/138): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-13T15:59:00.856 INFO:teuthology.orchestra.run.smithi107.stdout:(19/138): librgw2-18.2.4-850.g50bbe7f3.el9.x86_ 22 MB/s | 4.5 MB 00:00 2024-09-13T15:59:00.868 INFO:teuthology.orchestra.run.smithi070.stdout:(75/138): python3-markupsafe-1.1.1-12.el9.x86_6 598 kB/s | 35 kB 00:00 2024-09-13T15:59:00.881 INFO:teuthology.orchestra.run.smithi107.stdout:(20/138): python3-ceph-common-18.2.4-850.g50bbe 1.1 MB/s | 129 kB 00:00 2024-09-13T15:59:00.907 INFO:teuthology.orchestra.run.smithi107.stdout:(21/138): python3-cephfs-18.2.4-850.g50bbe7f3.e 3.2 MB/s | 162 kB 00:00 2024-09-13T15:59:00.932 INFO:teuthology.orchestra.run.smithi107.stdout:(22/138): python3-rados-18.2.4-850.g50bbe7f3.el 6.2 MB/s | 319 kB 00:00 2024-09-13T15:59:00.957 INFO:teuthology.orchestra.run.smithi107.stdout:(23/138): python3-rbd-18.2.4-850.g50bbe7f3.el9. 5.9 MB/s | 301 kB 00:00 2024-09-13T15:59:00.983 INFO:teuthology.orchestra.run.smithi107.stdout:(24/138): python3-rgw-18.2.4-850.g50bbe7f3.el9. 1.9 MB/s | 99 kB 00:00 2024-09-13T15:59:01.008 INFO:teuthology.orchestra.run.smithi107.stdout:(25/138): rbd-fuse-18.2.4-850.g50bbe7f3.el9.x86 1.7 MB/s | 87 kB 00:00 2024-09-13T15:59:01.067 INFO:teuthology.orchestra.run.smithi107.stdout:(26/138): rbd-nbd-18.2.4-850.g50bbe7f3.el9.x86_ 2.9 MB/s | 172 kB 00:00 2024-09-13T15:59:01.099 INFO:teuthology.orchestra.run.smithi070.stdout:(76/138): postgresql-server-13.16-1.el9.x86_64. 4.7 MB/s | 5.8 MB 00:01 2024-09-13T15:59:01.183 INFO:teuthology.orchestra.run.smithi107.stdout:(27/138): rbd-mirror-18.2.4-850.g50bbe7f3.el9.x 15 MB/s | 3.0 MB 00:00 2024-09-13T15:59:01.234 INFO:teuthology.orchestra.run.smithi070.stdout:(77/138): python3-babel-2.9.1-2.el9.noarch.rpm 5.5 MB/s | 6.0 MB 00:01 2024-09-13T15:59:01.234 INFO:teuthology.orchestra.run.smithi107.stdout:(28/138): ceph-grafana-dashboards-18.2.4-850.g5 146 kB/s | 24 kB 00:00 2024-09-13T15:59:01.259 INFO:teuthology.orchestra.run.smithi107.stdout:(29/138): ceph-mgr-cephadm-18.2.4-850.g50bbe7f3 1.8 MB/s | 139 kB 00:00 2024-09-13T15:59:01.277 INFO:teuthology.orchestra.run.smithi070.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 250 kB 00:00 2024-09-13T15:59:01.302 INFO:teuthology.orchestra.run.smithi070.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-13T15:59:01.336 INFO:teuthology.orchestra.run.smithi070.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-13T15:59:01.361 INFO:teuthology.orchestra.run.smithi070.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 722 kB/s | 42 kB 00:00 2024-09-13T15:59:01.387 INFO:teuthology.orchestra.run.smithi070.stdout:(82/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-13T15:59:01.418 INFO:teuthology.orchestra.run.smithi107.stdout:(30/138): ceph-mgr-dashboard-18.2.4-850.g50bbe7 19 MB/s | 3.5 MB 00:00 2024-09-13T15:59:01.428 INFO:teuthology.orchestra.run.smithi070.stdout:(83/138): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-09-13T15:59:01.462 INFO:teuthology.orchestra.run.smithi070.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 678 kB/s | 51 kB 00:00 2024-09-13T15:59:01.477 INFO:teuthology.orchestra.run.smithi107.stdout:(31/138): ceph-mgr-modules-core-18.2.4-850.g50b 4.1 MB/s | 246 kB 00:00 2024-09-13T15:59:01.560 INFO:teuthology.orchestra.run.smithi107.stdout:(32/138): ceph-mgr-rook-18.2.4-850.g50bbe7f3.el 594 kB/s | 49 kB 00:00 2024-09-13T15:59:01.604 INFO:teuthology.orchestra.run.smithi070.stdout:(85/138): python3-requests-oauthlib-1.3.0-12.el 306 kB/s | 54 kB 00:00 2024-09-13T15:59:01.671 INFO:teuthology.orchestra.run.smithi070.stdout:(86/138): python3-toml-0.10.2-6.el9.noarch.rpm 627 kB/s | 42 kB 00:00 2024-09-13T15:59:01.746 INFO:teuthology.orchestra.run.smithi070.stdout:(87/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.8 MB/s | 5.1 MB 00:00 2024-09-13T15:59:01.797 INFO:teuthology.orchestra.run.smithi070.stdout:(88/138): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-13T15:59:01.822 INFO:teuthology.orchestra.run.smithi070.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 769 kB/s | 58 kB 00:00 2024-09-13T15:59:01.864 INFO:teuthology.orchestra.run.smithi070.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.4 MB/s | 96 kB 00:00 2024-09-13T15:59:01.889 INFO:teuthology.orchestra.run.smithi070.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 954 kB/s | 64 kB 00:00 2024-09-13T15:59:01.931 INFO:teuthology.orchestra.run.smithi070.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 673 kB/s | 45 kB 00:00 2024-09-13T15:59:01.960 INFO:teuthology.orchestra.run.smithi107.stdout:(33/138): ceph-test-18.2.4-850.g50bbe7f3.el9.x8 19 MB/s | 40 MB 00:02 2024-09-13T15:59:01.973 INFO:teuthology.orchestra.run.smithi070.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.3 MB/s | 111 kB 00:00 2024-09-13T15:59:02.010 INFO:teuthology.orchestra.run.smithi107.stdout:(34/138): ceph-prometheus-alerts-18.2.4-850.g50 37 kB/s | 16 kB 00:00 2024-09-13T15:59:02.036 INFO:teuthology.orchestra.run.smithi107.stdout:(35/138): ceph-volume-18.2.4-850.g50bbe7f3.el9. 3.5 MB/s | 264 kB 00:00 2024-09-13T15:59:02.040 INFO:teuthology.orchestra.run.smithi070.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 2.8 MB/s | 308 kB 00:00 2024-09-13T15:59:02.057 INFO:teuthology.orchestra.run.smithi070.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-13T15:59:02.061 INFO:teuthology.orchestra.run.smithi107.stdout:(36/138): cephadm-18.2.4-850.g50bbe7f3.el9.noar 4.4 MB/s | 226 kB 00:00 2024-09-13T15:59:02.101 INFO:teuthology.orchestra.run.smithi070.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-09-13T15:59:02.103 INFO:teuthology.orchestra.run.smithi107.stdout:(37/138): cephfs-top-18.2.4-850.g50bbe7f3.el9.n 274 kB/s | 18 kB 00:00 2024-09-13T15:59:02.183 INFO:teuthology.orchestra.run.smithi070.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 831 kB/s | 67 kB 00:00 2024-09-13T15:59:02.211 INFO:teuthology.orchestra.run.smithi107.stdout:(38/138): ceph-mgr-diskprediction-local-18.2.4- 7.8 MB/s | 7.4 MB 00:00 2024-09-13T15:59:02.275 INFO:teuthology.orchestra.run.smithi070.stdout:(98/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-13T15:59:02.358 INFO:teuthology.orchestra.run.smithi070.stdout:(99/138): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-13T15:59:02.370 INFO:teuthology.orchestra.run.smithi107.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 258 kB/s | 80 kB 00:00 2024-09-13T15:59:02.392 INFO:teuthology.orchestra.run.smithi070.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-13T15:59:02.434 INFO:teuthology.orchestra.run.smithi070.stdout:(101/138): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-09-13T15:59:02.437 INFO:teuthology.orchestra.run.smithi107.stdout:(40/138): libquadmath-11.5.0-2.el9.x86_64.rpm 850 kB/s | 191 kB 00:00 2024-09-13T15:59:02.459 INFO:teuthology.orchestra.run.smithi070.stdout:(102/138): python3-cachetools-4.2.4-1.el9.noarc 482 kB/s | 32 kB 00:00 2024-09-13T15:59:02.485 INFO:teuthology.orchestra.run.smithi070.stdout:(103/138): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-13T15:59:02.496 INFO:teuthology.orchestra.run.smithi107.stdout:(41/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-13T15:59:02.510 INFO:teuthology.orchestra.run.smithi070.stdout:(104/138): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-13T15:59:02.543 INFO:teuthology.orchestra.run.smithi070.stdout:(105/138): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-13T15:59:02.554 INFO:teuthology.orchestra.run.smithi107.stdout:(42/138): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-13T15:59:02.569 INFO:teuthology.orchestra.run.smithi070.stdout:(106/138): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-13T15:59:02.596 INFO:teuthology.orchestra.run.smithi107.stdout:(43/138): libgfortran-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 801 kB 00:00 2024-09-13T15:59:02.611 INFO:teuthology.orchestra.run.smithi070.stdout:(107/138): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-09-13T15:59:02.622 INFO:teuthology.orchestra.run.smithi107.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-13T15:59:02.639 INFO:teuthology.orchestra.run.smithi070.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 253 kB/s | 18 kB 00:00 2024-09-13T15:59:02.647 INFO:teuthology.orchestra.run.smithi107.stdout:(45/138): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-13T15:59:02.664 INFO:teuthology.orchestra.run.smithi070.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 439 kB/s | 23 kB 00:00 2024-09-13T15:59:02.689 INFO:teuthology.orchestra.run.smithi107.stdout:(46/138): python3-cryptography-36.0.1-4.el9.x86 4.9 MB/s | 1.2 MB 00:00 2024-09-13T15:59:02.690 INFO:teuthology.orchestra.run.smithi070.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 390 kB/s | 19 kB 00:00 2024-09-13T15:59:02.714 INFO:teuthology.orchestra.run.smithi107.stdout:(47/138): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-13T15:59:02.715 INFO:teuthology.orchestra.run.smithi070.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-13T15:59:02.740 INFO:teuthology.orchestra.run.smithi070.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-13T15:59:02.774 INFO:teuthology.orchestra.run.smithi070.stdout:(113/138): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-13T15:59:02.816 INFO:teuthology.orchestra.run.smithi070.stdout:(114/138): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-09-13T15:59:02.823 INFO:teuthology.orchestra.run.smithi107.stdout:(48/138): boost-program-options-1.75.0-8.el9.x8 988 kB/s | 107 kB 00:00 2024-09-13T15:59:02.841 INFO:teuthology.orchestra.run.smithi070.stdout:(115/138): python3-natsort-7.1.1-5.el9.noarch.r 866 kB/s | 58 kB 00:00 2024-09-13T15:59:02.865 INFO:teuthology.orchestra.run.smithi107.stdout:(49/138): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-09-13T15:59:02.866 INFO:teuthology.orchestra.run.smithi070.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-13T15:59:02.892 INFO:teuthology.orchestra.run.smithi070.stdout:(117/138): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-13T15:59:02.906 INFO:teuthology.orchestra.run.smithi107.stdout:(50/138): elfutils-libelf-devel-0.191-4.el9.x86 260 kB/s | 22 kB 00:00 2024-09-13T15:59:02.917 INFO:teuthology.orchestra.run.smithi070.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-13T15:59:02.932 INFO:teuthology.orchestra.run.smithi107.stdout:(51/138): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-13T15:59:02.943 INFO:teuthology.orchestra.run.smithi070.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 608 kB/s | 31 kB 00:00 2024-09-13T15:59:02.968 INFO:teuthology.orchestra.run.smithi070.stdout:(120/138): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-13T15:59:02.974 INFO:teuthology.orchestra.run.smithi107.stdout:(52/138): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-13T15:59:02.993 INFO:teuthology.orchestra.run.smithi070.stdout:(121/138): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-13T15:59:03.016 INFO:teuthology.orchestra.run.smithi107.stdout:(53/138): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-13T15:59:03.018 INFO:teuthology.orchestra.run.smithi070.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-13T15:59:03.044 INFO:teuthology.orchestra.run.smithi070.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-13T15:59:03.057 INFO:teuthology.orchestra.run.smithi107.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 219 kB/s | 18 kB 00:00 2024-09-13T15:59:03.077 INFO:teuthology.orchestra.run.smithi070.stdout:(124/138): python3-webob-1.8.8-2.el9.noarch.rpm 3.9 MB/s | 230 kB 00:00 2024-09-13T15:59:03.124 INFO:teuthology.orchestra.run.smithi107.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-09-13T15:59:03.128 INFO:teuthology.orchestra.run.smithi070.stdout:(125/138): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-09-13T15:59:03.150 INFO:teuthology.orchestra.run.smithi107.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-13T15:59:03.153 INFO:teuthology.orchestra.run.smithi070.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 807 kB/s | 20 kB 00:00 2024-09-13T15:59:03.187 INFO:teuthology.orchestra.run.smithi070.stdout:(127/138): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-13T15:59:03.192 INFO:teuthology.orchestra.run.smithi107.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 677 kB/s | 45 kB 00:00 2024-09-13T15:59:03.221 INFO:teuthology.orchestra.run.smithi070.stdout:(128/138): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-13T15:59:03.279 INFO:teuthology.orchestra.run.smithi070.stdout:(129/138): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-13T15:59:03.361 INFO:teuthology.orchestra.run.smithi107.stdout:(58/138): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-13T15:59:03.428 INFO:teuthology.orchestra.run.smithi107.stdout:(59/138): libtool-2.4.6-46.el9.x86_64.rpm 2.4 MB/s | 581 kB 00:00 2024-09-13T15:59:03.478 INFO:teuthology.orchestra.run.smithi107.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 209 kB/s | 24 kB 00:00 2024-09-13T15:59:03.521 INFO:teuthology.orchestra.run.smithi070.stdout:(130/138): librados2-18.2.4-850.g50bbe7f3.el9.x 11 MB/s | 3.3 MB 00:00 2024-09-13T15:59:03.528 INFO:teuthology.orchestra.run.smithi107.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 474 kB/s | 47 kB 00:00 2024-09-13T15:59:03.554 INFO:teuthology.orchestra.run.smithi107.stdout:(62/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-13T15:59:03.588 INFO:teuthology.orchestra.run.smithi070.stdout:(131/138): librbd1-18.2.4-850.g50bbe7f3.el9.x86 9.8 MB/s | 3.0 MB 00:00 2024-09-13T15:59:03.621 INFO:teuthology.orchestra.run.smithi107.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 419 kB/s | 38 kB 00:00 2024-09-13T15:59:04.147 INFO:teuthology.orchestra.run.smithi070.stdout:(132/138): NetworkManager-libnm-1.49.90-1.el9.x 3.2 MB/s | 1.8 MB 00:00 2024-09-13T15:59:04.239 INFO:teuthology.orchestra.run.smithi070.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 447 kB/s | 41 kB 00:00 2024-09-13T15:59:04.279 INFO:teuthology.orchestra.run.smithi107.stdout:(64/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.2 MB/s | 3.0 MB 00:01 2024-09-13T15:59:04.414 INFO:teuthology.orchestra.run.smithi070.stdout:(134/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.5 MB/s | 16 MB 00:02 2024-09-13T15:59:04.439 INFO:teuthology.orchestra.run.smithi070.stdout:(135/138): NetworkManager-tui-1.49.90-1.el9.x86 1.2 MB/s | 249 kB 00:00 2024-09-13T15:59:04.471 INFO:teuthology.orchestra.run.smithi107.stdout:(65/138): postgresql-13.16-1.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-09-13T15:59:04.590 INFO:teuthology.orchestra.run.smithi070.stdout:(136/138): NetworkManager-1.49.90-1.el9.x86_64. 2.2 MB/s | 2.3 MB 00:01 2024-09-13T15:59:04.790 INFO:teuthology.orchestra.run.smithi070.stdout:(137/138): openssl-3.2.2-6.el9.x86_64.rpm 3.6 MB/s | 1.4 MB 00:00 2024-09-13T15:59:05.140 INFO:teuthology.orchestra.run.smithi070.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 2.4 MB 00:00 2024-09-13T15:59:05.146 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-13T15:59:05.146 INFO:teuthology.orchestra.run.smithi070.stdout:Total 18 MB/s | 203 MB 00:11 2024-09-13T15:59:05.330 INFO:teuthology.orchestra.run.smithi107.stdout:(66/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.6 MB/s | 4.4 MB 00:01 2024-09-13T15:59:05.422 INFO:teuthology.orchestra.run.smithi107.stdout:(67/138): openblas-openmp-0.3.26-2.el9.x86_64.r 2.6 MB/s | 4.9 MB 00:01 2024-09-13T15:59:05.447 INFO:teuthology.orchestra.run.smithi107.stdout:(68/138): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-13T15:59:05.847 INFO:teuthology.orchestra.run.smithi107.stdout:(69/138): postgresql-contrib-13.16-1.el9.x86_64 661 kB/s | 910 kB 00:01 2024-09-13T15:59:05.898 INFO:teuthology.orchestra.run.smithi107.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-13T15:59:05.940 INFO:teuthology.orchestra.run.smithi107.stdout:(71/138): python3-jinja2-2.11.3-6.el9.noarch.rp 5.9 MB/s | 248 kB 00:00 2024-09-13T15:59:05.998 INFO:teuthology.orchestra.run.smithi107.stdout:(72/138): python3-jsonpatch-1.21-16.el9.noarch. 441 kB/s | 26 kB 00:00 2024-09-13T15:59:06.057 INFO:teuthology.orchestra.run.smithi107.stdout:(73/138): python3-jsonpointer-2.0-4.el9.noarch. 330 kB/s | 19 kB 00:00 2024-09-13T15:59:06.107 INFO:teuthology.orchestra.run.smithi107.stdout:(74/138): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-13T15:59:06.166 INFO:teuthology.orchestra.run.smithi107.stdout:(75/138): python3-markupsafe-1.1.1-12.el9.x86_6 597 kB/s | 35 kB 00:00 2024-09-13T15:59:06.554 INFO:teuthology.orchestra.run.smithi107.stdout:(76/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-13T15:59:06.633 INFO:teuthology.orchestra.run.smithi107.stdout:(77/138): python3-babel-2.9.1-2.el9.noarch.rpm 5.0 MB/s | 6.0 MB 00:01 2024-09-13T15:59:06.658 INFO:teuthology.orchestra.run.smithi107.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-13T15:59:06.701 INFO:teuthology.orchestra.run.smithi107.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-13T15:59:06.726 INFO:teuthology.orchestra.run.smithi107.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-13T15:59:06.767 INFO:teuthology.orchestra.run.smithi107.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 634 kB/s | 42 kB 00:00 2024-09-13T15:59:06.793 INFO:teuthology.orchestra.run.smithi107.stdout:(82/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-13T15:59:06.835 INFO:teuthology.orchestra.run.smithi107.stdout:(83/138): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-13T15:59:06.908 INFO:teuthology.orchestra.run.smithi107.stdout:(84/138): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-09-13T15:59:06.908 INFO:teuthology.orchestra.run.smithi107.stdout:(85/138): python3-requests-oauthlib-1.3.0-12.el 911 kB/s | 54 kB 00:00 2024-09-13T15:59:06.936 INFO:teuthology.orchestra.run.smithi107.stdout:(86/138): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-13T15:59:06.971 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-13T15:59:06.986 INFO:teuthology.orchestra.run.smithi107.stdout:(87/138): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-13T15:59:07.037 INFO:teuthology.orchestra.run.smithi107.stdout:(88/138): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T15:59:07.087 INFO:teuthology.orchestra.run.smithi107.stdout:(89/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-13T15:59:07.137 INFO:teuthology.orchestra.run.smithi107.stdout:(90/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-13T15:59:07.145 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-13T15:59:07.145 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-13T15:59:07.238 INFO:teuthology.orchestra.run.smithi107.stdout:(91/138): postgresql-server-13.16-1.el9.x86_64. 3.2 MB/s | 5.8 MB 00:01 2024-09-13T15:59:07.263 INFO:teuthology.orchestra.run.smithi107.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 357 kB/s | 45 kB 00:00 2024-09-13T15:59:07.322 INFO:teuthology.orchestra.run.smithi107.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.3 MB/s | 111 kB 00:00 2024-09-13T15:59:07.372 INFO:teuthology.orchestra.run.smithi107.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 2.8 MB/s | 308 kB 00:00 2024-09-13T15:59:07.397 INFO:teuthology.orchestra.run.smithi107.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T15:59:07.423 INFO:teuthology.orchestra.run.smithi107.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T15:59:07.448 INFO:teuthology.orchestra.run.smithi107.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-13T15:59:07.515 INFO:teuthology.orchestra.run.smithi107.stdout:(98/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-13T15:59:07.565 INFO:teuthology.orchestra.run.smithi107.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 11 MB/s | 548 kB 00:00 2024-09-13T15:59:07.591 INFO:teuthology.orchestra.run.smithi107.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-13T15:59:07.616 INFO:teuthology.orchestra.run.smithi107.stdout:(101/138): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-13T15:59:07.641 INFO:teuthology.orchestra.run.smithi107.stdout:(102/138): python3-certifi-2023.05.07-4.el9.noa 569 kB/s | 14 kB 00:00 2024-09-13T15:59:07.699 INFO:teuthology.orchestra.run.smithi107.stdout:(103/138): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-13T15:59:07.733 INFO:teuthology.orchestra.run.smithi107.stdout:(104/138): python3-cherrypy-18.6.1-2.el9.noarch 10 MB/s | 358 kB 00:00 2024-09-13T15:59:07.767 INFO:teuthology.orchestra.run.smithi107.stdout:(105/138): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-13T15:59:07.792 INFO:teuthology.orchestra.run.smithi107.stdout:(106/138): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-13T15:59:07.859 INFO:teuthology.orchestra.run.smithi107.stdout:(107/138): libarrow-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 4.4 MB 00:00 2024-09-13T15:59:07.885 INFO:teuthology.orchestra.run.smithi107.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-09-13T15:59:07.910 INFO:teuthology.orchestra.run.smithi107.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-13T15:59:07.937 INFO:teuthology.orchestra.run.smithi107.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 385 kB/s | 19 kB 00:00 2024-09-13T15:59:07.961 INFO:teuthology.orchestra.run.smithi107.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-13T15:59:07.986 INFO:teuthology.orchestra.run.smithi107.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-13T15:59:08.011 INFO:teuthology.orchestra.run.smithi107.stdout:(113/138): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-13T15:59:08.037 INFO:teuthology.orchestra.run.smithi107.stdout:(114/138): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-13T15:59:08.075 INFO:teuthology.orchestra.run.smithi107.stdout:(115/138): python3-kubernetes-26.1.0-2.el9.noar 7.4 MB/s | 1.0 MB 00:00 2024-09-13T15:59:08.100 INFO:teuthology.orchestra.run.smithi107.stdout:(116/138): python3-pecan-1.4.2-3.el9.noarch.rpm 4.2 MB/s | 272 kB 00:00 2024-09-13T15:59:08.125 INFO:teuthology.orchestra.run.smithi107.stdout:(117/138): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-13T15:59:08.142 INFO:teuthology.orchestra.run.smithi107.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-09-13T15:59:08.168 INFO:teuthology.orchestra.run.smithi107.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 733 kB/s | 31 kB 00:00 2024-09-13T15:59:08.193 INFO:teuthology.orchestra.run.smithi107.stdout:(120/138): python3-rsa-4.9-2.el9.noarch.rpm 2.4 MB/s | 59 kB 00:00 2024-09-13T15:59:08.218 INFO:teuthology.orchestra.run.smithi107.stdout:(121/138): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-13T15:59:08.243 INFO:teuthology.orchestra.run.smithi107.stdout:(122/138): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-13T15:59:08.269 INFO:teuthology.orchestra.run.smithi107.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-13T15:59:08.294 INFO:teuthology.orchestra.run.smithi107.stdout:(124/138): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-13T15:59:08.319 INFO:teuthology.orchestra.run.smithi107.stdout:(125/138): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-13T15:59:08.345 INFO:teuthology.orchestra.run.smithi107.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 794 kB/s | 20 kB 00:00 2024-09-13T15:59:08.387 INFO:teuthology.orchestra.run.smithi107.stdout:(127/138): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-13T15:59:08.421 INFO:teuthology.orchestra.run.smithi107.stdout:(128/138): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-13T15:59:08.479 INFO:teuthology.orchestra.run.smithi107.stdout:(129/138): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-13T15:59:08.680 INFO:teuthology.orchestra.run.smithi107.stdout:(130/138): librados2-18.2.4-850.g50bbe7f3.el9.x 13 MB/s | 3.3 MB 00:00 2024-09-13T15:59:08.755 INFO:teuthology.orchestra.run.smithi107.stdout:(131/138): librbd1-18.2.4-850.g50bbe7f3.el9.x86 11 MB/s | 3.0 MB 00:00 2024-09-13T15:59:09.088 INFO:teuthology.orchestra.run.smithi107.stdout:(132/138): NetworkManager-libnm-1.49.90-1.el9.x 5.4 MB/s | 1.8 MB 00:00 2024-09-13T15:59:09.147 INFO:teuthology.orchestra.run.smithi107.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 698 kB/s | 41 kB 00:00 2024-09-13T15:59:09.298 INFO:teuthology.orchestra.run.smithi107.stdout:(134/138): NetworkManager-tui-1.49.90-1.el9.x86 1.6 MB/s | 249 kB 00:00 2024-09-13T15:59:09.372 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-13T15:59:09.373 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-13T15:59:09.498 INFO:teuthology.orchestra.run.smithi107.stdout:(135/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.2 MB/s | 16 MB 00:02 2024-09-13T15:59:09.548 INFO:teuthology.orchestra.run.smithi107.stdout:(136/138): NetworkManager-1.49.90-1.el9.x86_64. 2.7 MB/s | 2.3 MB 00:00 2024-09-13T15:59:10.132 INFO:teuthology.orchestra.run.smithi107.stdout:(137/138): openssl-3.2.2-6.el9.x86_64.rpm 1.6 MB/s | 1.4 MB 00:00 2024-09-13T15:59:10.240 INFO:teuthology.orchestra.run.smithi107.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.2 MB/s | 2.4 MB 00:00 2024-09-13T15:59:10.244 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-13T15:59:10.244 INFO:teuthology.orchestra.run.smithi107.stdout:Total 16 MB/s | 203 MB 00:12 2024-09-13T15:59:12.040 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-13T15:59:12.210 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-13T15:59:12.210 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-13T15:59:14.411 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-13T15:59:14.412 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-13T15:59:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-13T15:59:15.478 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T15:59:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T15:59:15.802 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T15:59:15.855 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T15:59:15.887 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T15:59:15.945 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T15:59:16.296 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T15:59:16.412 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:59:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:59:16.588 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:59:16.700 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:59:16.743 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T15:59:16.954 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T15:59:17.008 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T15:59:17.034 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:59:17.156 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:59:17.185 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T15:59:17.409 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T15:59:17.598 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T15:59:17.722 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:59:17.858 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:59:18.216 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:59:18.256 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T15:59:18.300 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T15:59:18.382 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T15:59:18.424 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T15:59:18.499 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T15:59:18.587 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T15:59:18.644 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T15:59:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T15:59:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T15:59:18.815 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T15:59:18.849 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 27/146 2024-09-13T15:59:18.894 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 28/146 2024-09-13T15:59:18.979 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 29/146 2024-09-13T15:59:19.138 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T15:59:19.199 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T15:59:19.844 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T15:59:19.950 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T15:59:20.005 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T15:59:20.043 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 35/146 2024-09-13T15:59:20.104 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T15:59:20.296 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T15:59:20.377 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T15:59:20.416 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-13T15:59:20.509 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T15:59:20.564 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T15:59:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T15:59:20.624 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T15:59:20.627 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T15:59:20.701 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T15:59:20.746 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T15:59:20.779 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T15:59:20.833 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T15:59:20.859 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T15:59:20.907 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T15:59:20.943 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T15:59:21.010 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T15:59:21.071 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T15:59:21.121 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T15:59:21.185 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T15:59:21.287 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:59:21.291 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T15:59:21.337 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T15:59:21.380 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T15:59:21.430 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:59:21.463 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:59:21.497 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T15:59:21.541 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T15:59:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:59:21.603 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T15:59:21.619 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T15:59:21.643 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T15:59:21.671 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T15:59:21.712 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T15:59:21.745 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T15:59:21.782 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T15:59:21.824 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T15:59:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T15:59:21.863 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T15:59:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T15:59:21.905 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T15:59:21.918 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:59:21.947 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T15:59:21.999 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T15:59:22.031 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T15:59:22.032 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:59:22.061 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T15:59:22.066 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T15:59:22.117 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T15:59:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T15:59:22.305 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T15:59:22.309 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T15:59:22.466 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T15:59:22.585 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:59:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:59:23.098 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:59:23.140 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T15:59:23.183 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T15:59:23.184 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T15:59:23.264 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T15:59:23.266 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T15:59:23.308 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T15:59:23.316 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T15:59:23.342 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T15:59:23.428 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T15:59:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T15:59:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T15:59:23.485 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T15:59:23.529 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T15:59:23.575 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T15:59:23.655 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T15:59:23.691 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 27/146 2024-09-13T15:59:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T15:59:23.735 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 28/146 2024-09-13T15:59:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T15:59:23.821 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 29/146 2024-09-13T15:59:23.830 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T15:59:23.992 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T15:59:24.050 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T15:59:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T15:59:24.708 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T15:59:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T15:59:24.809 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T15:59:24.856 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T15:59:24.894 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 35/146 2024-09-13T15:59:24.946 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T15:59:25.119 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T15:59:25.186 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T15:59:25.315 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T15:59:25.356 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T15:59:25.416 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T15:59:25.500 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T15:59:25.574 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T15:59:25.610 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T15:59:25.668 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T15:59:25.721 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T15:59:25.771 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T15:59:25.938 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T15:59:25.988 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T15:59:26.031 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T15:59:26.349 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T15:59:26.438 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T15:59:26.474 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T15:59:26.508 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T15:59:26.509 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T15:59:26.555 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T15:59:26.598 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T15:59:26.627 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T15:59:26.655 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T15:59:26.688 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T15:59:26.731 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T15:59:26.776 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T15:59:26.814 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T15:59:26.844 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T15:59:26.851 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T15:59:26.886 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T15:59:26.919 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T15:59:26.974 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T15:59:27.007 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T15:59:27.042 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T15:59:27.101 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T15:59:27.222 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T15:59:27.235 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T15:59:27.289 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T15:59:27.347 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T15:59:27.383 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 85/146 2024-09-13T15:59:27.432 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T15:59:27.874 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T15:59:27.913 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T15:59:28.004 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T15:59:28.032 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 89/146 2024-09-13T15:59:28.153 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T15:59:28.233 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T15:59:28.267 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T15:59:28.379 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T15:59:28.418 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T15:59:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T15:59:28.684 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T15:59:28.785 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T15:59:29.582 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T15:59:29.740 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T15:59:30.380 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:59:30.421 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:59:31.053 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:59:31.099 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T15:59:31.238 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T15:59:31.238 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T15:59:31.238 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T15:59:31.238 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T15:59:31.300 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T15:59:31.313 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T15:59:31.417 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T15:59:31.453 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T15:59:31.486 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T15:59:31.824 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T15:59:32.062 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T15:59:32.225 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T15:59:32.253 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 85/146 2024-09-13T15:59:32.302 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T15:59:32.740 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T15:59:32.767 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T15:59:32.891 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T15:59:32.928 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 89/146 2024-09-13T15:59:35.215 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:59:35.258 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:59:35.863 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:59:35.903 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T15:59:36.048 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T15:59:36.048 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T15:59:36.048 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T15:59:36.049 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T15:59:36.096 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T15:59:43.707 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T15:59:43.707 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /sys 2024-09-13T15:59:43.707 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /proc 2024-09-13T15:59:43.707 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /mnt 2024-09-13T15:59:43.707 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /var/tmp 2024-09-13T15:59:43.707 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /home 2024-09-13T15:59:43.708 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /root 2024-09-13T15:59:43.708 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /tmp 2024-09-13T15:59:43.708 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T15:59:43.913 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T15:59:43.949 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T15:59:43.949 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:59:43.949 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T15:59:43.949 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T15:59:45.541 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T15:59:45.600 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T15:59:45.600 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:59:45.600 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T15:59:45.600 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T15:59:45.600 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T15:59:45.600 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T15:59:45.834 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T15:59:45.884 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T15:59:45.885 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:59:45.885 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T15:59:45.885 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T15:59:45.885 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T15:59:45.885 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T15:59:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T15:59:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T15:59:46.427 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:59:46.427 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T15:59:46.427 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T15:59:46.427 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T15:59:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T15:59:46.559 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T15:59:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T15:59:46.683 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T15:59:46.916 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T15:59:47.010 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T15:59:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T15:59:47.199 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T15:59:47.366 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T15:59:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T15:59:47.452 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T15:59:47.478 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T15:59:47.977 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T15:59:48.028 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T15:59:48.082 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 109/146 2024-09-13T15:59:48.151 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 110/146 2024-09-13T15:59:48.183 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T15:59:48.629 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T15:59:48.629 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2024-09-13T15:59:48.629 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2024-09-13T15:59:48.629 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2024-09-13T15:59:48.629 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2024-09-13T15:59:48.629 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2024-09-13T15:59:48.629 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /root 2024-09-13T15:59:48.630 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2024-09-13T15:59:48.630 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T15:59:48.818 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T15:59:48.853 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T15:59:48.853 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:59:48.853 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T15:59:48.853 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T15:59:49.398 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T15:59:49.435 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T15:59:50.430 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T15:59:50.487 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T15:59:50.487 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:59:50.488 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T15:59:50.488 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T15:59:50.488 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T15:59:50.488 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T15:59:50.517 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T15:59:50.543 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T15:59:50.684 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T15:59:50.731 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T15:59:50.781 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T15:59:50.781 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:59:50.781 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T15:59:50.782 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T15:59:50.782 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T15:59:50.782 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T15:59:50.851 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 114/146 2024-09-13T15:59:50.887 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T15:59:50.938 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T15:59:50.938 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:59:50.939 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T15:59:50.939 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T15:59:50.939 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T15:59:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T15:59:50.988 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T15:59:51.014 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T15:59:51.131 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 117/146 2024-09-13T15:59:51.200 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 118/146 2024-09-13T15:59:51.273 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T15:59:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T15:59:51.325 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:59:51.325 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T15:59:51.325 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T15:59:51.325 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T15:59:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T15:59:51.448 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T15:59:51.507 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T15:59:51.572 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T15:59:51.796 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T15:59:51.861 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T15:59:51.963 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T15:59:51.983 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T15:59:52.016 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T15:59:52.066 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T15:59:52.067 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:59:52.067 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T15:59:52.067 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:59:52.067 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:59:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T15:59:52.073 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T15:59:52.116 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T15:59:52.166 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T15:59:52.166 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:59:52.166 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T15:59:52.166 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T15:59:52.225 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T15:59:52.236 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T15:59:52.276 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T15:59:52.276 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:59:52.276 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T15:59:52.276 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:59:52.276 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:59:52.277 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T15:59:52.286 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T15:59:52.334 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T15:59:52.359 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T15:59:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T15:59:52.652 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T15:59:52.652 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:59:52.652 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T15:59:52.652 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T15:59:52.652 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T15:59:52.653 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T15:59:52.916 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T15:59:52.951 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T15:59:52.988 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 109/146 2024-09-13T15:59:53.058 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 110/146 2024-09-13T15:59:53.090 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T15:59:54.292 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T15:59:54.342 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T15:59:55.424 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T15:59:55.459 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T15:59:55.594 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T15:59:55.767 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 114/146 2024-09-13T15:59:55.794 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T15:59:55.845 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T15:59:55.846 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:59:55.846 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T15:59:55.846 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T15:59:55.846 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T15:59:55.846 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T15:59:55.903 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T15:59:55.930 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T15:59:56.036 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 117/146 2024-09-13T15:59:56.107 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 118/146 2024-09-13T15:59:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 124/146 2024-09-13T15:59:56.680 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 125/146 2024-09-13T15:59:56.723 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 126/146 2024-09-13T15:59:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T15:59:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T15:59:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T15:59:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T15:59:56.998 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T15:59:56.998 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:59:56.998 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T15:59:56.998 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:59:56.998 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:59:56.998 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T15:59:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T15:59:57.040 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T15:59:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 130/146 2024-09-13T15:59:57.090 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T15:59:57.091 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:59:57.091 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T15:59:57.091 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T15:59:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T15:59:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T15:59:57.157 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T15:59:57.209 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T15:59:57.209 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:59:57.209 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T15:59:57.209 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:59:57.209 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:59:57.209 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T15:59:57.541 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T15:59:57.593 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T15:59:57.593 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:59:57.593 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T15:59:57.593 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T15:59:57.593 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T15:59:57.593 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T15:59:57.921 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:59:57.972 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:59:58.013 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:59:59.276 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 134/146 2024-09-13T15:59:59.395 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T15:59:59.448 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T15:59:59.559 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T15:59:59.597 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T15:59:59.622 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T15:59:59.658 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T15:59:59.659 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T15:59:59.766 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T15:59:59.766 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T15:59:59.875 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T15:59:59.900 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T15:59:59.916 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:59:59.916 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T16:00:00.152 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T16:00:00.152 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T16:00:00.262 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T16:00:00.335 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T16:00:00.549 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T16:00:00.549 INFO:teuthology.orchestra.run.smithi070.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-13T16:00:00.549 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:01.580 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 124/146 2024-09-13T16:00:01.621 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 125/146 2024-09-13T16:00:01.665 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 126/146 2024-09-13T16:00:01.694 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T16:00:01.925 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T16:00:01.984 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T16:00:02.014 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 130/146 2024-09-13T16:00:02.050 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T16:00:02.097 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T16:00:02.981 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T16:00:03.021 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T16:00:03.063 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T16:00:04.321 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 134/146 2024-09-13T16:00:04.436 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T16:00:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T16:00:04.608 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T16:00:04.647 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T16:00:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T16:00:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T16:00:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T16:00:04.850 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T16:00:04.850 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T16:00:04.984 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T16:00:05.008 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T16:00:05.025 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T16:00:05.025 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T16:00:05.269 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T16:00:05.270 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T16:00:05.363 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T16:00:05.436 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T16:00:05.665 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T16:00:05.665 INFO:teuthology.orchestra.run.smithi107.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-13T16:00:05.665 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 1/146 2024-09-13T16:00:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2/146 2024-09-13T16:00:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 3/146 2024-09-13T16:00:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 4/146 2024-09-13T16:00:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 5/146 2024-09-13T16:00:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 6/146 2024-09-13T16:00:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 7/146 2024-09-13T16:00:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T16:00:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T16:00:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T16:00:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 11/146 2024-09-13T16:00:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 12/146 2024-09-13T16:00:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T16:00:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 14/146 2024-09-13T16:00:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 15/146 2024-09-13T16:00:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 16/146 2024-09-13T16:00:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 17/146 2024-09-13T16:00:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 18/146 2024-09-13T16:00:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 19/146 2024-09-13T16:00:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 20/146 2024-09-13T16:00:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 21/146 2024-09-13T16:00:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 22/146 2024-09-13T16:00:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 23/146 2024-09-13T16:00:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 24/146 2024-09-13T16:00:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 25/146 2024-09-13T16:00:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 26/146 2024-09-13T16:00:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 27/146 2024-09-13T16:00:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 28/146 2024-09-13T16:00:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 29/146 2024-09-13T16:00:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 30/146 2024-09-13T16:00:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 31/146 2024-09-13T16:00:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 32/146 2024-09-13T16:00:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 33/146 2024-09-13T16:00:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 34/146 2024-09-13T16:00:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 35/146 2024-09-13T16:00:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 36/146 2024-09-13T16:00:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 37/146 2024-09-13T16:00:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 38/146 2024-09-13T16:00:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T16:00:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T16:00:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T16:00:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T16:00:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T16:00:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T16:00:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T16:00:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T16:00:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T16:00:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T16:00:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T16:00:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T16:00:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T16:00:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T16:00:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T16:00:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T16:00:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T16:00:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T16:00:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T16:00:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T16:00:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T16:00:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T16:00:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T16:00:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T16:00:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T16:00:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T16:00:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T16:00:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T16:00:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T16:00:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T16:00:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T16:00:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T16:00:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T16:00:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T16:00:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T16:00:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T16:00:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T16:00:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T16:00:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T16:00:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T16:00:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T16:00:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T16:00:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T16:00:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T16:00:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T16:00:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T16:00:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T16:00:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T16:00:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T16:00:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T16:00:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T16:00:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T16:00:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T16:00:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T16:00:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T16:00:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T16:00:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T16:00:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T16:00:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T16:00:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T16:00:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T16:00:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T16:00:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T16:00:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T16:00:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T16:00:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T16:00:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T16:00:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T16:00:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T16:00:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T16:00:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T16:00:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T16:00:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T16:00:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T16:00:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T16:00:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T16:00:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T16:00:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T16:00:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T16:00:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T16:00:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T16:00:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T16:00:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T16:00:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T16:00:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T16:00:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T16:00:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T16:00:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T16:00:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T16:00:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T16:00:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T16:00:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T16:00:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 131/146 2024-09-13T16:00:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T16:00:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 133/146 2024-09-13T16:00:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T16:00:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T16:00:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T16:00:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T16:00:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T16:00:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T16:00:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T16:00:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T16:00:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T16:00:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T16:00:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T16:00:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T16:00:08.078 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T16:00:08.078 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:08.078 INFO:teuthology.orchestra.run.smithi070.stdout:Upgraded: 2024-09-13T16:00:08.078 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T16:00:08.078 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T16:00:08.078 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T16:00:08.078 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T16:00:08.078 INFO:teuthology.orchestra.run.smithi070.stdout: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.078 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.078 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T16:00:08.079 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T16:00:08.079 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-13T16:00:08.079 INFO:teuthology.orchestra.run.smithi070.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T16:00:08.079 INFO:teuthology.orchestra.run.smithi070.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T16:00:08.079 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T16:00:08.079 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.079 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.079 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.079 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.079 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:08.079 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.079 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.079 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.079 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:08.080 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:08.080 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:08.080 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:08.080 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:08.080 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.080 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.080 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:08.080 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.080 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.080 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.080 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:08.081 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:08.081 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.081 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:08.081 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T16:00:08.081 INFO:teuthology.orchestra.run.smithi070.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T16:00:08.081 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T16:00:08.081 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T16:00:08.081 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T16:00:08.081 INFO:teuthology.orchestra.run.smithi070.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T16:00:08.081 INFO:teuthology.orchestra.run.smithi070.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T16:00:08.081 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T16:00:08.081 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T16:00:08.081 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T16:00:08.081 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T16:00:08.082 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.082 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.082 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.082 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T16:00:08.082 INFO:teuthology.orchestra.run.smithi070.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T16:00:08.082 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T16:00:08.082 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T16:00:08.082 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T16:00:08.082 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.082 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.082 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T16:00:08.082 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.082 INFO:teuthology.orchestra.run.smithi070.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T16:00:08.083 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T16:00:08.083 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T16:00:08.083 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T16:00:08.083 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T16:00:08.083 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T16:00:08.083 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T16:00:08.083 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T16:00:08.083 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T16:00:08.083 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T16:00:08.083 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T16:00:08.083 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T16:00:08.083 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T16:00:08.083 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T16:00:08.084 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T16:00:08.084 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T16:00:08.084 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T16:00:08.084 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.084 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.084 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.084 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T16:00:08.084 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T16:00:08.084 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T16:00:08.084 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T16:00:08.084 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T16:00:08.084 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T16:00:08.084 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T16:00:08.084 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T16:00:08.085 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T16:00:08.085 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T16:00:08.085 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T16:00:08.085 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T16:00:08.085 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T16:00:08.085 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T16:00:08.085 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T16:00:08.085 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T16:00:08.085 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T16:00:08.085 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T16:00:08.085 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T16:00:08.085 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T16:00:08.085 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T16:00:08.085 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T16:00:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T16:00:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T16:00:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T16:00:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T16:00:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T16:00:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T16:00:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T16:00:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T16:00:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T16:00:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T16:00:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T16:00:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T16:00:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T16:00:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T16:00:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T16:00:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T16:00:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T16:00:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T16:00:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T16:00:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T16:00:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T16:00:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T16:00:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T16:00:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T16:00:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T16:00:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T16:00:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T16:00:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T16:00:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T16:00:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T16:00:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T16:00:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T16:00:08.089 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T16:00:08.089 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:08.089 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-13T16:00:08.692 DEBUG:teuthology.parallel:result is None 2024-09-13T16:00:10.945 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 1/146 2024-09-13T16:00:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2/146 2024-09-13T16:00:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 3/146 2024-09-13T16:00:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 4/146 2024-09-13T16:00:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 5/146 2024-09-13T16:00:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 6/146 2024-09-13T16:00:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 7/146 2024-09-13T16:00:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T16:00:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T16:00:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T16:00:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 11/146 2024-09-13T16:00:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 12/146 2024-09-13T16:00:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T16:00:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 14/146 2024-09-13T16:00:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 15/146 2024-09-13T16:00:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 16/146 2024-09-13T16:00:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 17/146 2024-09-13T16:00:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 18/146 2024-09-13T16:00:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 19/146 2024-09-13T16:00:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 20/146 2024-09-13T16:00:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 21/146 2024-09-13T16:00:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 22/146 2024-09-13T16:00:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 23/146 2024-09-13T16:00:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 24/146 2024-09-13T16:00:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 25/146 2024-09-13T16:00:10.957 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 26/146 2024-09-13T16:00:10.958 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 27/146 2024-09-13T16:00:10.958 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 28/146 2024-09-13T16:00:10.958 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 29/146 2024-09-13T16:00:10.958 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 30/146 2024-09-13T16:00:10.958 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 31/146 2024-09-13T16:00:10.958 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 32/146 2024-09-13T16:00:10.958 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 33/146 2024-09-13T16:00:10.958 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 34/146 2024-09-13T16:00:10.958 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 35/146 2024-09-13T16:00:10.958 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 36/146 2024-09-13T16:00:10.958 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 37/146 2024-09-13T16:00:10.958 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 38/146 2024-09-13T16:00:10.959 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T16:00:10.959 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T16:00:10.959 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T16:00:10.959 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T16:00:10.959 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T16:00:10.959 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T16:00:10.959 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T16:00:10.959 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T16:00:10.959 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T16:00:10.959 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T16:00:10.959 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T16:00:10.959 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T16:00:10.960 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T16:00:10.960 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T16:00:10.960 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T16:00:10.960 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T16:00:10.960 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T16:00:10.960 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T16:00:10.960 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T16:00:10.960 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T16:00:10.960 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T16:00:10.960 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T16:00:10.960 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T16:00:10.960 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T16:00:10.960 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T16:00:10.961 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T16:00:10.961 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T16:00:10.961 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T16:00:10.961 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T16:00:10.961 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T16:00:10.961 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T16:00:10.961 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T16:00:10.961 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T16:00:10.961 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T16:00:10.961 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T16:00:10.961 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T16:00:10.961 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T16:00:10.962 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T16:00:10.962 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T16:00:10.962 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T16:00:10.962 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T16:00:10.962 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T16:00:10.962 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T16:00:10.962 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T16:00:10.962 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T16:00:10.962 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T16:00:10.963 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T16:00:10.963 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T16:00:10.963 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T16:00:10.963 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T16:00:10.963 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T16:00:10.963 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T16:00:10.963 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T16:00:10.963 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T16:00:10.963 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T16:00:10.963 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T16:00:10.963 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T16:00:10.963 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T16:00:10.963 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T16:00:10.963 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T16:00:10.964 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T16:00:10.964 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T16:00:10.964 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T16:00:10.964 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T16:00:10.964 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T16:00:10.964 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T16:00:10.964 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T16:00:10.964 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T16:00:10.964 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T16:00:10.965 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T16:00:10.965 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T16:00:10.965 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T16:00:10.965 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T16:00:10.965 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T16:00:10.965 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T16:00:10.965 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T16:00:10.965 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T16:00:10.965 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T16:00:10.965 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T16:00:10.965 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T16:00:10.965 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T16:00:10.965 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T16:00:10.966 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T16:00:10.966 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T16:00:10.966 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T16:00:10.966 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T16:00:10.966 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T16:00:10.966 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T16:00:10.966 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T16:00:10.966 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T16:00:10.966 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T16:00:10.966 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T16:00:10.966 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 131/146 2024-09-13T16:00:10.966 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T16:00:10.966 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 133/146 2024-09-13T16:00:10.967 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T16:00:10.967 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T16:00:10.967 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T16:00:10.967 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T16:00:10.967 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T16:00:10.967 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T16:00:10.967 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T16:00:10.967 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T16:00:10.967 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T16:00:10.967 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T16:00:10.967 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T16:00:10.967 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T16:00:12.993 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T16:00:12.993 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:12.994 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2024-09-13T16:00:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T16:00:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T16:00:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T16:00:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T16:00:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T16:00:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T16:00:12.994 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-13T16:00:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T16:00:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T16:00:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T16:00:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:00:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T16:00:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T16:00:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T16:00:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T16:00:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T16:00:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T16:00:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T16:00:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T16:00:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T16:00:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T16:00:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T16:00:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T16:00:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T16:00:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T16:00:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T16:00:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T16:00:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T16:00:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T16:00:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T16:00:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T16:00:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T16:00:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T16:00:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T16:00:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T16:00:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T16:00:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T16:00:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T16:00:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T16:00:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T16:00:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T16:00:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T16:00:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T16:00:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T16:00:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T16:00:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T16:00:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T16:00:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T16:00:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T16:00:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T16:00:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T16:00:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T16:00:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T16:00:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T16:00:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T16:00:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T16:00:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T16:00:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T16:00:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T16:00:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T16:00:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T16:00:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T16:00:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T16:00:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T16:00:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T16:00:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T16:00:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T16:00:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T16:00:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T16:00:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T16:00:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T16:00:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T16:00:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T16:00:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T16:00:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T16:00:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T16:00:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T16:00:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T16:00:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T16:00:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T16:00:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T16:00:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T16:00:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T16:00:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T16:00:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T16:00:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T16:00:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T16:00:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T16:00:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T16:00:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T16:00:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T16:00:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T16:00:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T16:00:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:00:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T16:00:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T16:00:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T16:00:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T16:00:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T16:00:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T16:00:13.005 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T16:00:13.005 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:13.005 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-13T16:00:13.641 DEBUG:teuthology.parallel:result is None 2024-09-13T16:00:13.641 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:00:13.794 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T16:00:13.845 INFO:teuthology.orchestra.run.smithi070.stdout:18.2.4-850.g50bbe7f3.el9 2024-09-13T16:00:13.845 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-850.g50bbe7f3.el9 2024-09-13T16:00:13.845 INFO:teuthology.task.install:The correct ceph version 18.2.4-850.g50bbe7f3 is installed. 2024-09-13T16:00:13.847 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:00:13.996 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T16:00:14.043 INFO:teuthology.orchestra.run.smithi107.stdout:18.2.4-850.g50bbe7f3.el9 2024-09-13T16:00:14.043 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-850.g50bbe7f3.el9 2024-09-13T16:00:14.043 INFO:teuthology.task.install:The correct ceph version 18.2.4-850.g50bbe7f3 is installed. 2024-09-13T16:00:14.045 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T16:00:14.045 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:14.045 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T16:00:14.109 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:14.110 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T16:00:14.174 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T16:00:14.174 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:14.175 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T16:00:14.232 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T16:00:14.327 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:14.327 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T16:00:14.385 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T16:00:14.483 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T16:00:14.484 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:14.484 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T16:00:14.538 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T16:00:14.633 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:14.633 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T16:00:14.690 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T16:00:14.787 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T16:00:14.787 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:14.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T16:00:14.842 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T16:00:14.940 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:14.940 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T16:00:14.996 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T16:00:15.092 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T16:00:15.175 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T16:00:15.175 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /var/log/ceph 2024-09-13T16:00:15.179 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2024-09-13T16:00:15.234 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T16:00:15.234 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T16:00:15.238 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T16:00:15.293 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T16:00:15.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T16:00:15.298 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T16:00:15.360 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-13T16:00:15.360 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-13T16:00:15.360 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-13T16:00:15.360 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:15.360 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T16:00:15.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T16:00:15.570 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-13T16:00:15.626 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:15.626 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T16:00:15.661 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T16:00:15.842 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-13T16:00:15.903 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T16:00:15.904 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds.a'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T16:00:15.904 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903774', 'branch': 'wip-rishabh-testing-20240910.095512-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/cap-flush}', 'email': None, 'first_in_suite': False, 'job_id': '7903774', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.095512-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds.a'], 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.095512-reef', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1152, 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'sleep_before_teardown': 0, 'subset': '984/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.095512-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi070.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBg389IDn6KPhZGUeTjqOjobFEAhuqorQiIVojfzabedejj808zKr46Khk0crzdggIeuKSG5LIR5sKf3dwEhRps=', 'smithi107.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFfMXDy79iTNVaD2PiJ7NhmR3uXOTx1MICvLx47HwKQl3nfYnsTm2rbZviSQnGTRDQmiWO5L7eu8ZoMABBA1YOE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds.a'], 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_cap_flush']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:36:41', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T16:00:15.905 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T16:00:15.909 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T16:00:15.943 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T16:00:15.984 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T16:00:16.039 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:16.039 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T16:00:16.074 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T16:00:16.075 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-09-13T16:00:16.149 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T16:00:16.149 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:00:16.149 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-09-13T16:00:16.150 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:00:16.150 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:00:16.150 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-13 16:00:00.917860667 +0000 2024-09-13T16:00:16.150 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-13 15:58:07.151599445 +0000 2024-09-13T16:00:16.150 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-13 15:58:07.151599445 +0000 2024-09-13T16:00:16.150 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-13 15:58:07.151599445 +0000 2024-09-13T16:00:16.150 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T16:00:16.242 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-13T16:00:16.242 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-13T16:00:16.242 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000196269 s, 2.6 MB/s 2024-09-13T16:00:16.245 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T16:00:16.281 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-09-13T16:00:16.356 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T16:00:16.357 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:00:16.357 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-09-13T16:00:16.357 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:00:16.357 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:00:16.357 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-13 16:00:00.917860667 +0000 2024-09-13T16:00:16.357 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-13 15:58:07.588586235 +0000 2024-09-13T16:00:16.357 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-13 15:58:07.588586235 +0000 2024-09-13T16:00:16.357 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-13 15:58:07.588586235 +0000 2024-09-13T16:00:16.358 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T16:00:16.449 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-13T16:00:16.449 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-13T16:00:16.449 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000154349 s, 3.3 MB/s 2024-09-13T16:00:16.451 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T16:00:16.488 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-09-13T16:00:16.564 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T16:00:16.564 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:00:16.565 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-09-13T16:00:16.565 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:00:16.565 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:00:16.565 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-13 16:00:00.919860607 +0000 2024-09-13T16:00:16.565 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-13 15:58:08.034572752 +0000 2024-09-13T16:00:16.565 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-13 15:58:08.034572752 +0000 2024-09-13T16:00:16.565 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-13 15:58:08.034572752 +0000 2024-09-13T16:00:16.565 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T16:00:16.657 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-13T16:00:16.657 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-13T16:00:16.657 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000158074 s, 3.2 MB/s 2024-09-13T16:00:16.659 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T16:00:16.696 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-09-13T16:00:16.772 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T16:00:16.772 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:00:16.772 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-09-13T16:00:16.772 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:00:16.772 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:00:16.772 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-13 16:00:00.919860607 +0000 2024-09-13T16:00:16.772 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-13 15:58:08.514558242 +0000 2024-09-13T16:00:16.773 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-13 15:58:08.514558242 +0000 2024-09-13T16:00:16.773 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-13 15:58:08.514558242 +0000 2024-09-13T16:00:16.773 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T16:00:16.864 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-13T16:00:16.865 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-13T16:00:16.865 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000173441 s, 3.0 MB/s 2024-09-13T16:00:16.867 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T16:00:16.904 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T16:00:16.904 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:16.904 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T16:00:16.944 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T16:00:16.944 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-09-13T16:00:17.022 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T16:00:17.022 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:00:17.022 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 638 Links: 1 2024-09-13T16:00:17.022 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:00:17.022 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:00:17.022 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-13 16:00:06.018991708 +0000 2024-09-13T16:00:17.022 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-13 15:58:06.151293188 +0000 2024-09-13T16:00:17.022 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-13 15:58:06.151293188 +0000 2024-09-13T16:00:17.022 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-13 15:58:06.151293188 +0000 2024-09-13T16:00:17.023 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T16:00:17.117 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-13T16:00:17.117 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-13T16:00:17.117 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000295744 s, 1.7 MB/s 2024-09-13T16:00:17.120 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T16:00:17.157 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-09-13T16:00:17.232 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T16:00:17.232 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:00:17.232 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 658 Links: 1 2024-09-13T16:00:17.232 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:00:17.232 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:00:17.232 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-13 16:00:06.019991690 +0000 2024-09-13T16:00:17.232 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-13 15:58:06.621285294 +0000 2024-09-13T16:00:17.232 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-13 15:58:06.621285294 +0000 2024-09-13T16:00:17.233 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-13 15:58:06.621285294 +0000 2024-09-13T16:00:17.233 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T16:00:17.324 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-13T16:00:17.324 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-13T16:00:17.324 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000276911 s, 1.8 MB/s 2024-09-13T16:00:17.326 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T16:00:17.363 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-09-13T16:00:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T16:00:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:00:17.438 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 677 Links: 1 2024-09-13T16:00:17.438 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:00:17.438 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:00:17.438 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-13 16:00:06.020991673 +0000 2024-09-13T16:00:17.438 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-13 15:58:07.089277434 +0000 2024-09-13T16:00:17.438 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-13 15:58:07.089277434 +0000 2024-09-13T16:00:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-13 15:58:07.089277434 +0000 2024-09-13T16:00:17.439 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T16:00:17.530 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-13T16:00:17.531 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-13T16:00:17.531 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000269115 s, 1.9 MB/s 2024-09-13T16:00:17.533 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T16:00:17.569 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-09-13T16:00:17.644 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T16:00:17.644 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:00:17.644 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 695 Links: 1 2024-09-13T16:00:17.644 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:00:17.644 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:00:17.644 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-13 16:00:06.020991673 +0000 2024-09-13T16:00:17.644 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-13 15:58:07.565269439 +0000 2024-09-13T16:00:17.644 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-13 15:58:07.565269439 +0000 2024-09-13T16:00:17.644 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-13 15:58:07.565269439 +0000 2024-09-13T16:00:17.645 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T16:00:17.736 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-13T16:00:17.736 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-13T16:00:17.737 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000274458 s, 1.9 MB/s 2024-09-13T16:00:17.739 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T16:00:17.775 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T16:00:17.776 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T16:00:17.776 INFO:tasks.ceph:Generating config... 2024-09-13T16:00:17.777 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T16:00:17.777 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T16:00:17.777 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T16:00:17.777 INFO:tasks.ceph:[client] pid file = 2024-09-13T16:00:17.777 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T16:00:17.777 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T16:00:17.778 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-13T16:00:17.778 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T16:00:17.778 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T16:00:17.778 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T16:00:17.778 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T16:00:17.778 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T16:00:17.778 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T16:00:17.778 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T16:00:17.778 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T16:00:17.778 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T16:00:17.778 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T16:00:17.778 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-13T16:00:17.778 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T16:00:17.778 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T16:00:17.779 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T16:00:17.779 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T16:00:17.779 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T16:00:17.779 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T16:00:17.779 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T16:00:17.779 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-13T16:00:17.779 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-13T16:00:17.779 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-13T16:00:17.779 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T16:00:17.779 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T16:00:17.779 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-13T16:00:17.779 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-13T16:00:17.779 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T16:00:17.779 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T16:00:17.779 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-13T16:00:17.780 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T16:00:17.780 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T16:00:17.780 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T16:00:17.780 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T16:00:17.780 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T16:00:17.780 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T16:00:17.780 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T16:00:17.780 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T16:00:17.882 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T16:00:17.888 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T16:00:17.974 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T16:00:18.029 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.70'), ('mon.b', '172.21.15.107'), ('mon.c', '[v2:172.21.15.107:3301,v1:172.21.15.107:6790]')] 2024-09-13T16:00:18.029 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.70,172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T16:00:18.030 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:18.030 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T16:00:18.065 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.70 --add b 172.21.15.107 --addv c '[v2:172.21.15.107:3301,v1:172.21.15.107:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T16:00:18.180 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T16:00:18.180 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: generated fsid f906ab4b-6171-41ec-a825-cd0f700d3930 2024-09-13T16:00:18.180 INFO:teuthology.orchestra.run.smithi070.stdout:setting min_mon_release = pacific 2024-09-13T16:00:18.180 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 0 2024-09-13T16:00:18.180 INFO:teuthology.orchestra.run.smithi070.stdout:fsid f906ab4b-6171-41ec-a825-cd0f700d3930 2024-09-13T16:00:18.180 INFO:teuthology.orchestra.run.smithi070.stdout:last_changed 2024-09-13T16:00:18.179870+0000 2024-09-13T16:00:18.180 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-09-13T16:00:18.179870+0000 2024-09-13T16:00:18.181 INFO:teuthology.orchestra.run.smithi070.stdout:min_mon_release 16 (pacific) 2024-09-13T16:00:18.181 INFO:teuthology.orchestra.run.smithi070.stdout:election_strategy: 1 2024-09-13T16:00:18.181 INFO:teuthology.orchestra.run.smithi070.stdout:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-13T16:00:18.181 INFO:teuthology.orchestra.run.smithi070.stdout:1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.b 2024-09-13T16:00:18.181 INFO:teuthology.orchestra.run.smithi070.stdout:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-13T16:00:18.181 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T16:00:18.183 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T16:00:18.217 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f906ab4b-6171-41ec-a825-cd0f700d3930... 2024-09-13T16:00:18.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T16:00:18.262 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T16:00:18.354 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-09-13T16:00:18.354 INFO:teuthology.orchestra.run.smithi070.stdout: chdir = "" 2024-09-13T16:00:18.354 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T16:00:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: auth supported = cephx 2024-09-13T16:00:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: filestore xattr use omap = true 2024-09-13T16:00:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: mon clock drift allowed = 1.000 2024-09-13T16:00:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: osd crush chooseleaf type = 0 2024-09-13T16:00:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: auth debug = true 2024-09-13T16:00:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on old message = true 2024-09-13T16:00:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on bug = true 2024-09-13T16:00:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T16:00:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn max object skew = 0 2024-09-13T16:00:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T16:00:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T16:00:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default size = 2 2024-09-13T16:00:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow primary affinity = true 2024-09-13T16:00:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow pg remap = true 2024-09-13T16:00:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on legacy crush tunables = false 2024-09-13T16:00:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on crush straw calc version zero = false 2024-09-13T16:00:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on no sortbitwise = false 2024-09-13T16:00:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on osd down out interval zero = false 2024-09-13T16:00:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on too few osds = false 2024-09-13T16:00:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T16:00:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T16:00:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: mon_allow_pool_size_one = true 2024-09-13T16:00:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T16:00:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: osd default data pool replay window = 5 2024-09-13T16:00:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: mon allow pool delete = true 2024-09-13T16:00:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: mon cluster log file level = debug 2024-09-13T16:00:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: debug asserts on shutdown = true 2024-09-13T16:00:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: mon health detail to clog = false 2024-09-13T16:00:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: mon host = "172.21.15.70,172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790]" 2024-09-13T16:00:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on skipped message = False 2024-09-13T16:00:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = f906ab4b-6171-41ec-a825-cd0f700d3930 2024-09-13T16:00:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.358 INFO:teuthology.orchestra.run.smithi070.stdout:[osd] 2024-09-13T16:00:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: osd journal size = 100 2024-09-13T16:00:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub load threshold = 5.0 2024-09-13T16:00:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub max interval = 600 2024-09-13T16:00:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock profile = high_recovery_ops 2024-09-13T16:00:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: osd recover clone overlap = true 2024-09-13T16:00:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: osd recovery max chunk = 1048576 2024-09-13T16:00:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug shutdown = true 2024-09-13T16:00:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug op order = true 2024-09-13T16:00:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify stray on activate = true 2024-09-13T16:00:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: osd open classes on start = true 2024-09-13T16:00:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug pg log writeout = true 2024-09-13T16:00:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: osd deep scrub update digest min age = 30 2024-09-13T16:00:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: osd map max advance = 10 2024-09-13T16:00:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: journal zero on create = true 2024-09-13T16:00:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: filestore ondisk finisher threads = 3 2024-09-13T16:00:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: filestore apply finisher threads = 3 2024-09-13T16:00:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: bdev debug aio = true 2024-09-13T16:00:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug misdirected ops = true 2024-09-13T16:00:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: bdev async discard = True 2024-09-13T16:00:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: bdev enable discard = True 2024-09-13T16:00:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore allocator = bitmap 2024-09-13T16:00:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore block size = 96636764160 2024-09-13T16:00:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore fsck on mount = True 2024-09-13T16:00:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluefs = 1/20 2024-09-13T16:00:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluestore = 1/20 2024-09-13T16:00:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-13T16:00:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: debug osd = 20 2024-09-13T16:00:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: debug rocksdb = 4/10 2024-09-13T16:00:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T16:00:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd full ratio = 0.9 2024-09-13T16:00:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd nearfull ratio = 0.8 2024-09-13T16:00:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: osd failsafe full ratio = 0.95 2024-09-13T16:00:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: osd objectstore = bluestore 2024-09-13T16:00:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: osd op complaint time = 180 2024-09-13T16:00:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.361 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr] 2024-09-13T16:00:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-13T16:00:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: debug mgr = 20 2024-09-13T16:00:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-09-13T16:00:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-09-13T16:00:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-09-13T16:00:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-09-13T16:00:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: mgr/telemetry/nag = false 2024-09-13T16:00:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: debug client = 20 2024-09-13T16:00:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.362 INFO:teuthology.orchestra.run.smithi070.stdout:[mon] 2024-09-13T16:00:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-13T16:00:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-09-13T16:00:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: debug paxos = 20 2024-09-13T16:00:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-09-13T16:00:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: mon data avail warn = 5 2024-09-13T16:00:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: mon mgr mkfs grace = 240 2024-09-13T16:00:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-09-13T16:00:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd reporter subtree level = osd 2024-09-13T16:00:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd prime pg temp = true 2024-09-13T16:00:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-09-13T16:00:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T16:00:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T16:00:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T16:00:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T16:00:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T16:00:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T16:00:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: # 1m isn't quite enough 2024-09-13T16:00:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: mon_down_mkfs_grace = 2m 2024-09-13T16:00:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_filestore_osds = false 2024-09-13T16:00:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: mon op complaint time = 120 2024-09-13T16:00:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on pool no app = False 2024-09-13T16:00:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:18.364 INFO:teuthology.orchestra.run.smithi070.stdout:[client] 2024-09-13T16:00:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: rgw cache enabled = true 2024-09-13T16:00:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable ops log = true 2024-09-13T16:00:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable usage log = true 2024-09-13T16:00:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T16:00:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T16:00:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: client mount timeout = 600 2024-09-13T16:00:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: debug client = 20 2024-09-13T16:00:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-13T16:00:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = "" 2024-09-13T16:00:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: rados mon op timeout = 900 2024-09-13T16:00:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: rados osd op timeout = 900 2024-09-13T16:00:18.364 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.a] 2024-09-13T16:00:18.364 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.b] 2024-09-13T16:00:18.365 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.c] 2024-09-13T16:00:18.365 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a] 2024-09-13T16:00:18.365 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.c] 2024-09-13T16:00:18.365 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.b] 2024-09-13T16:00:18.365 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.d] 2024-09-13T16:00:18.365 INFO:teuthology.orchestra.run.smithi070.stdout:[mds] 2024-09-13T16:00:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: debug mds = 20 2024-09-13T16:00:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: debug mds balancer = 20 2024-09-13T16:00:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-13T16:00:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: mds debug frag = True 2024-09-13T16:00:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: mds debug scatterstat = True 2024-09-13T16:00:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: mds op complaint time = 180 2024-09-13T16:00:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: mds verify scatter = True 2024-09-13T16:00:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: osd op complaint time = 180 2024-09-13T16:00:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: rados mon op timeout = 900 2024-09-13T16:00:18.366 INFO:teuthology.orchestra.run.smithi070.stdout: rados osd op timeout = 900 2024-09-13T16:00:18.366 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2024-09-13T16:00:18.366 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2024-09-13T16:00:18.366 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T16:00:18.366 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2024-09-13T16:00:18.366 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.366 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2024-09-13T16:00:18.366 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.367 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2024-09-13T16:00:18.367 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.367 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2024-09-13T16:00:18.367 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2024-09-13T16:00:18.367 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.367 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2024-09-13T16:00:18.367 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2024-09-13T16:00:18.367 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.367 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T16:00:18.367 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2024-09-13T16:00:18.367 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.367 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T16:00:18.367 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T16:00:18.367 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.368 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2024-09-13T16:00:18.368 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.368 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2024-09-13T16:00:18.368 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2024-09-13T16:00:18.368 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2024-09-13T16:00:18.368 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2024-09-13T16:00:18.368 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2024-09-13T16:00:18.368 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2024-09-13T16:00:18.368 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2024-09-13T16:00:18.368 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T16:00:18.368 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T16:00:18.368 INFO:teuthology.orchestra.run.smithi107.stdout: mon_allow_pool_size_one = true 2024-09-13T16:00:18.368 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.368 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T16:00:18.369 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.369 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2024-09-13T16:00:18.369 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.369 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2024-09-13T16:00:18.369 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.369 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2024-09-13T16:00:18.369 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2024-09-13T16:00:18.369 INFO:teuthology.orchestra.run.smithi107.stdout: mon health detail to clog = false 2024-09-13T16:00:18.369 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = "172.21.15.70,172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790]" 2024-09-13T16:00:18.369 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on skipped message = False 2024-09-13T16:00:18.369 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = f906ab4b-6171-41ec-a825-cd0f700d3930 2024-09-13T16:00:18.369 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.369 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2024-09-13T16:00:18.369 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2024-09-13T16:00:18.370 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.370 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2024-09-13T16:00:18.370 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2024-09-13T16:00:18.370 INFO:teuthology.orchestra.run.smithi107.stdout: osd mclock profile = high_recovery_ops 2024-09-13T16:00:18.370 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.370 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2024-09-13T16:00:18.370 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2024-09-13T16:00:18.370 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.370 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2024-09-13T16:00:18.370 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2024-09-13T16:00:18.370 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2024-09-13T16:00:18.370 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.370 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2024-09-13T16:00:18.370 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2024-09-13T16:00:18.370 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.371 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2024-09-13T16:00:18.371 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.371 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2024-09-13T16:00:18.371 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.371 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2024-09-13T16:00:18.371 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.371 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2024-09-13T16:00:18.371 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2024-09-13T16:00:18.371 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.371 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2024-09-13T16:00:18.371 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2024-09-13T16:00:18.371 INFO:teuthology.orchestra.run.smithi107.stdout: bdev async discard = True 2024-09-13T16:00:18.371 INFO:teuthology.orchestra.run.smithi107.stdout: bdev enable discard = True 2024-09-13T16:00:18.371 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore allocator = bitmap 2024-09-13T16:00:18.372 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2024-09-13T16:00:18.372 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2024-09-13T16:00:18.372 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 1/20 2024-09-13T16:00:18.372 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 1/20 2024-09-13T16:00:18.372 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-09-13T16:00:18.372 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 20 2024-09-13T16:00:18.372 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 4/10 2024-09-13T16:00:18.372 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T16:00:18.372 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2024-09-13T16:00:18.372 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2024-09-13T16:00:18.372 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2024-09-13T16:00:18.372 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2024-09-13T16:00:18.372 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2024-09-13T16:00:18.372 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.373 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2024-09-13T16:00:18.373 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-09-13T16:00:18.373 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2024-09-13T16:00:18.373 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-09-13T16:00:18.373 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-09-13T16:00:18.373 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-09-13T16:00:18.373 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-09-13T16:00:18.373 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2024-09-13T16:00:18.373 INFO:teuthology.orchestra.run.smithi107.stdout: debug client = 20 2024-09-13T16:00:18.373 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.373 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2024-09-13T16:00:18.373 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-09-13T16:00:18.373 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-09-13T16:00:18.373 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2024-09-13T16:00:18.373 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-09-13T16:00:18.374 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2024-09-13T16:00:18.374 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2024-09-13T16:00:18.374 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-09-13T16:00:18.374 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2024-09-13T16:00:18.374 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2024-09-13T16:00:18.374 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-09-13T16:00:18.374 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.374 INFO:teuthology.orchestra.run.smithi107.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T16:00:18.374 INFO:teuthology.orchestra.run.smithi107.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T16:00:18.374 INFO:teuthology.orchestra.run.smithi107.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T16:00:18.374 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.374 INFO:teuthology.orchestra.run.smithi107.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T16:00:18.374 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T16:00:18.374 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T16:00:18.375 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.375 INFO:teuthology.orchestra.run.smithi107.stdout: # 1m isn't quite enough 2024-09-13T16:00:18.375 INFO:teuthology.orchestra.run.smithi107.stdout: mon_down_mkfs_grace = 2m 2024-09-13T16:00:18.375 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.375 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_filestore_osds = false 2024-09-13T16:00:18.375 INFO:teuthology.orchestra.run.smithi107.stdout: mon op complaint time = 120 2024-09-13T16:00:18.375 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on pool no app = False 2024-09-13T16:00:18.375 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-13T16:00:18.375 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2024-09-13T16:00:18.375 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2024-09-13T16:00:18.375 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = true 2024-09-13T16:00:18.375 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2024-09-13T16:00:18.375 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T16:00:18.375 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T16:00:18.375 INFO:teuthology.orchestra.run.smithi107.stdout: client mount timeout = 600 2024-09-13T16:00:18.376 INFO:teuthology.orchestra.run.smithi107.stdout: debug client = 20 2024-09-13T16:00:18.376 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-09-13T16:00:18.376 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = "" 2024-09-13T16:00:18.376 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2024-09-13T16:00:18.376 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2024-09-13T16:00:18.376 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2024-09-13T16:00:18.376 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.b] 2024-09-13T16:00:18.376 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.c] 2024-09-13T16:00:18.376 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-09-13T16:00:18.376 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2024-09-13T16:00:18.376 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2024-09-13T16:00:18.376 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2024-09-13T16:00:18.376 INFO:teuthology.orchestra.run.smithi107.stdout:[mds] 2024-09-13T16:00:18.376 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds = 20 2024-09-13T16:00:18.376 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds balancer = 20 2024-09-13T16:00:18.377 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-09-13T16:00:18.377 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug frag = True 2024-09-13T16:00:18.377 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug scatterstat = True 2024-09-13T16:00:18.377 INFO:teuthology.orchestra.run.smithi107.stdout: mds op complaint time = 180 2024-09-13T16:00:18.377 INFO:teuthology.orchestra.run.smithi107.stdout: mds verify scatter = True 2024-09-13T16:00:18.377 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2024-09-13T16:00:18.377 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2024-09-13T16:00:18.377 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2024-09-13T16:00:18.385 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T16:00:18.385 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T16:00:18.481 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T16:00:18.481 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:18.481 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T16:00:18.517 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:18.517 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T16:00:18.592 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi070.front.sepia.ceph.com 2024-09-13T16:00:18.593 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:18.593 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T16:00:18.593 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T16:00:18.710 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:18.710 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T16:00:18.784 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2024-09-13T16:00:18.785 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:18.785 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T16:00:18.785 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T16:00:18.864 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:18.864 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T16:00:18.938 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T16:00:18.939 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T16:00:18.939 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T16:00:19.041 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T16:00:19.047 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T16:00:19.161 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T16:00:19.167 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T16:00:19.167 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T16:00:19.270 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T16:00:19.276 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T16:00:19.331 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T16:00:19.435 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T16:00:19.440 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-13T16:00:19.496 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T16:00:19.599 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T16:00:19.604 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-13T16:00:19.660 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T16:00:19.762 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T16:00:19.767 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-13T16:00:19.822 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T16:00:19.822 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T16:00:19.904 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T16:00:19.932 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-13T16:00:20.012 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-13T16:00:20.039 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T16:00:20.121 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-13T16:00:20.148 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-13T16:00:20.227 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-13T16:00:20.254 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T16:00:20.254 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T16:00:20.255 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T16:00:20.310 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T16:00:20.310 INFO:tasks.ceph:role: osd.0 2024-09-13T16:00:20.310 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-13T16:00:20.310 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T16:00:20.364 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T16:00:20.364 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T16:00:20.364 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T16:00:20.364 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T16:00:20.364 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T16:00:20.364 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-13T16:00:20.364 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T16:00:20.364 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T16:00:20.364 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T16:00:20.364 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T16:00:20.398 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-13T16:00:20.402 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-13T16:00:20.402 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T16:00:20.483 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T16:00:20.546 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T16:00:20.602 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T16:00:20.602 INFO:tasks.ceph:role: osd.1 2024-09-13T16:00:20.602 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-13T16:00:20.602 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T16:00:20.662 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T16:00:20.662 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T16:00:20.662 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T16:00:20.662 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T16:00:20.663 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T16:00:20.663 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-13T16:00:20.663 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T16:00:20.663 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T16:00:20.663 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T16:00:20.663 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T16:00:20.696 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-13T16:00:20.701 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-13T16:00:20.701 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T16:00:20.782 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T16:00:20.844 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T16:00:20.900 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T16:00:20.900 INFO:tasks.ceph:role: osd.2 2024-09-13T16:00:20.900 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-13T16:00:20.900 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T16:00:20.957 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T16:00:20.957 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T16:00:20.957 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T16:00:20.957 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T16:00:20.957 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T16:00:20.957 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-13T16:00:20.957 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T16:00:20.957 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T16:00:20.957 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T16:00:20.957 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T16:00:20.990 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-13T16:00:20.994 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-13T16:00:20.994 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T16:00:21.076 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T16:00:21.139 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T16:00:21.195 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T16:00:21.196 INFO:tasks.ceph:role: osd.3 2024-09-13T16:00:21.196 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-13T16:00:21.196 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T16:00:21.259 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T16:00:21.259 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T16:00:21.259 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T16:00:21.259 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T16:00:21.259 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T16:00:21.260 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-13T16:00:21.260 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T16:00:21.260 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T16:00:21.260 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T16:00:21.260 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T16:00:21.293 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-13T16:00:21.297 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-13T16:00:21.297 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T16:00:21.378 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T16:00:21.439 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T16:00:21.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:21.542+0000 7fa698c1a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T16:00:21.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:21.543+0000 7fa698c1a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T16:00:21.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:21.543+0000 7fa698c1a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T16:00:21.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:21.543+0000 7fa698c1a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T16:00:21.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:21.543+0000 7fa698c1a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T16:00:21.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:21.545+0000 7fa698c1a640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T16:00:24.484 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T16:00:24.541 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T16:00:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:24.632+0000 7fc53e619640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T16:00:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:24.632+0000 7fc53e619640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T16:00:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:24.632+0000 7fc53e619640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T16:00:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:24.632+0000 7fc53e619640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T16:00:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:24.632+0000 7fc53e619640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T16:00:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:24.634+0000 7fc53e619640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T16:00:27.548 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T16:00:27.604 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T16:00:27.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:27.694+0000 7f361a82c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T16:00:27.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:27.695+0000 7f361a82c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T16:00:27.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:27.695+0000 7f361a82c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T16:00:27.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:27.695+0000 7f361a82c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T16:00:27.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:27.695+0000 7f361a82c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T16:00:27.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:27.696+0000 7f361a82c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T16:00:30.626 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T16:00:30.683 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T16:00:30.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:30.772+0000 7fb7f4bdd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T16:00:30.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:30.772+0000 7fb7f4bdd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T16:00:30.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:30.772+0000 7fb7f4bdd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T16:00:30.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:30.772+0000 7fb7f4bdd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T16:00:30.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:30.772+0000 7fb7f4bdd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T16:00:30.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:30.774+0000 7fb7f4bdd640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T16:00:33.707 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T16:00:33.764 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T16:00:33.827 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T16:00:33.828 INFO:tasks.ceph:role: osd.4 2024-09-13T16:00:33.828 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-13T16:00:33.828 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T16:00:33.893 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T16:00:33.893 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T16:00:33.893 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T16:00:33.893 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T16:00:33.894 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T16:00:33.894 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-09-13T16:00:33.894 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T16:00:33.894 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T16:00:33.894 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T16:00:33.894 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T16:00:34.289 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-09-13T16:00:34.293 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-09-13T16:00:34.293 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T16:00:34.416 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T16:00:34.479 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T16:00:34.538 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T16:00:34.538 INFO:tasks.ceph:role: osd.5 2024-09-13T16:00:34.538 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-13T16:00:34.538 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T16:00:34.604 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T16:00:34.604 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T16:00:34.604 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T16:00:34.604 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T16:00:34.604 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T16:00:34.605 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-09-13T16:00:34.605 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T16:00:34.605 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T16:00:34.605 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T16:00:34.605 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T16:00:34.961 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-09-13T16:00:34.965 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-09-13T16:00:34.965 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T16:00:35.051 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T16:00:35.114 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T16:00:35.170 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T16:00:35.170 INFO:tasks.ceph:role: osd.6 2024-09-13T16:00:35.170 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-13T16:00:35.171 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T16:00:35.234 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T16:00:35.234 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T16:00:35.235 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T16:00:35.235 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T16:00:35.235 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T16:00:35.235 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-09-13T16:00:35.235 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T16:00:35.235 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T16:00:35.235 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T16:00:35.235 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T16:00:35.624 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-09-13T16:00:35.628 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-09-13T16:00:35.628 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T16:00:35.727 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T16:00:35.789 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T16:00:35.845 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T16:00:35.845 INFO:tasks.ceph:role: osd.7 2024-09-13T16:00:35.845 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-13T16:00:35.846 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T16:00:35.909 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T16:00:35.909 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T16:00:35.909 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T16:00:35.909 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T16:00:35.909 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T16:00:35.909 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-09-13T16:00:35.910 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T16:00:35.910 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T16:00:35.910 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T16:00:35.910 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T16:00:36.298 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-09-13T16:00:36.302 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-09-13T16:00:36.302 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T16:00:36.438 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T16:00:36.501 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T16:00:36.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:36.639+0000 7fb0e5c87640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T16:00:36.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:36.643+0000 7fb0e5c87640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T16:00:36.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:36.643+0000 7fb0e5c87640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T16:00:36.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:36.643+0000 7fb0e5c87640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T16:00:36.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:36.643+0000 7fb0e5c87640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T16:00:36.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:36.650+0000 7fb0e5c87640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T16:00:39.575 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T16:00:39.632 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T16:00:39.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:39.720+0000 7f30ceb56640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T16:00:39.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:39.721+0000 7f30ceb56640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T16:00:39.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:39.721+0000 7f30ceb56640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T16:00:39.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:39.721+0000 7f30ceb56640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T16:00:39.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:39.721+0000 7f30ceb56640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T16:00:39.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:39.723+0000 7f30ceb56640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T16:00:42.668 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T16:00:42.729 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T16:00:42.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:42.820+0000 7f3876624640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T16:00:42.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:42.821+0000 7f3876624640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T16:00:42.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:42.821+0000 7f3876624640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T16:00:42.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:42.821+0000 7f3876624640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T16:00:42.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:42.821+0000 7f3876624640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T16:00:42.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:42.823+0000 7f3876624640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T16:00:45.771 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T16:00:45.828 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T16:00:45.905 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T16:00:45.910 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T16:00:45.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:45.916+0000 7f0993eb0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T16:00:45.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:45.917+0000 7f0993eb0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T16:00:45.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:45.917+0000 7f0993eb0640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T16:00:45.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:45.917+0000 7f0993eb0640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T16:00:45.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:45.917+0000 7f0993eb0640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T16:00:45.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:45.919+0000 7f0993eb0640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T16:00:48.833 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T16:00:48.889 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T16:00:48.890 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:48.890 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T16:00:48.952 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:48.952 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T16:00:49.050 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:49.050 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-13T16:00:49.147 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:49.147 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T16:00:49.242 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:49.243 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T16:00:49.339 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:49.339 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T16:00:49.434 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:49.435 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T16:00:49.531 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:49.531 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T16:00:49.587 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:49.587 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-13T16:00:49.682 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:49.682 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-13T16:00:49.776 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:49.777 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T16:00:49.872 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:49.872 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T16:00:49.967 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:49.968 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T16:00:50.064 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:50.064 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T16:00:50.159 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:50.160 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T16:00:50.196 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:50.196 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-13T16:00:50.272 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:50.273 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-13T16:00:50.308 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:50.308 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-13T16:00:50.383 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T16:00:50.383 DEBUG:teuthology.orchestra.run.smithi070:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T16:00:50.389 DEBUG:teuthology.orchestra.run.smithi107:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T16:00:50.437 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.y] 2024-09-13T16:00:50.438 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCTYeRmfdx6AhAA1qfblyX/kJpcJpTK/qWShg== 2024-09-13T16:00:50.438 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a] 2024-09-13T16:00:50.438 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCTYeRmf0EeEBAANOwP4Rx6m7JQr0S+co+pbg== 2024-09-13T16:00:50.438 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.c] 2024-09-13T16:00:50.438 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCTYeRmdzvuGRAA7i5QwfdmKJt//sbJl3gi2g== 2024-09-13T16:00:50.438 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.0] 2024-09-13T16:00:50.438 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCVYeRmDV9lIBAA4dYsVKkrk5yU1UEtZQ7WBw== 2024-09-13T16:00:50.438 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.1] 2024-09-13T16:00:50.438 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCYYeRmhJW7JRAA9IDJ1UsNzY7xB0EPEZqKPw== 2024-09-13T16:00:50.438 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.2] 2024-09-13T16:00:50.438 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCbYeRmyghwKRAAICRndBNYIgljsFAVQ/IxUw== 2024-09-13T16:00:50.439 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.3] 2024-09-13T16:00:50.439 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCeYeRmKCIjLhAA82aqewcz+IA6a5F/lSVphw== 2024-09-13T16:00:50.439 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.x] 2024-09-13T16:00:50.439 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCTYeRmkeaWCRAAhsqaCBOmlWijduzPWf48hg== 2024-09-13T16:00:50.439 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.b] 2024-09-13T16:00:50.439 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCTYeRmOzq6IxAAOTeumxLZLNyzPmRpXSMBNg== 2024-09-13T16:00:50.439 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.d] 2024-09-13T16:00:50.439 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCTYeRmUkNvLRAAuacRjRLrybeG5Nq4QRYpSA== 2024-09-13T16:00:50.439 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.4] 2024-09-13T16:00:50.439 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCkYeRmi7UrJhAAuyExOGdyt2XsCjMnMu3PuA== 2024-09-13T16:00:50.439 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.5] 2024-09-13T16:00:50.439 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCnYeRmi04EKxAA1ugmJrtQTm0u+fDSfCFAQw== 2024-09-13T16:00:50.439 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.6] 2024-09-13T16:00:50.440 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCqYeRmyaj8MBAATkdC1At+nAkXFz6Z23+rAg== 2024-09-13T16:00:50.440 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.7] 2024-09-13T16:00:50.440 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCtYeRm+nO0NhAAnZYoojpcPIdkG316fKLNCA== 2024-09-13T16:00:50.440 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-09-13T16:00:50.440 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCTYeRm1wjoNRAARZVmRL3tKm7pe0PP5XE64w== 2024-09-13T16:00:50.440 INFO:teuthology.orchestra.run.smithi070.stdout:[client.2] 2024-09-13T16:00:50.440 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCUYeRmEJq0ABAAigg7mMIYxx3g8o7GUuQERg== 2024-09-13T16:00:50.440 INFO:teuthology.orchestra.run.smithi070.stdout:[client.1] 2024-09-13T16:00:50.440 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCUYeRmw9QzBxAA1rIpPA82YNNW53B3qn1ulQ== 2024-09-13T16:00:50.440 INFO:teuthology.orchestra.run.smithi070.stdout:[client.3] 2024-09-13T16:00:50.440 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCUYeRm+SGQDRAAyWXGqr8yOqIl174YyTUd6w== 2024-09-13T16:00:50.475 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.y] 2024-09-13T16:00:50.475 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCTYeRmfdx6AhAA1qfblyX/kJpcJpTK/qWShg== 2024-09-13T16:00:50.475 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-09-13T16:00:50.475 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCTYeRmf0EeEBAANOwP4Rx6m7JQr0S+co+pbg== 2024-09-13T16:00:50.475 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2024-09-13T16:00:50.475 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCTYeRmdzvuGRAA7i5QwfdmKJt//sbJl3gi2g== 2024-09-13T16:00:50.475 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.0] 2024-09-13T16:00:50.475 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCVYeRmDV9lIBAA4dYsVKkrk5yU1UEtZQ7WBw== 2024-09-13T16:00:50.475 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.1] 2024-09-13T16:00:50.476 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCYYeRmhJW7JRAA9IDJ1UsNzY7xB0EPEZqKPw== 2024-09-13T16:00:50.476 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.2] 2024-09-13T16:00:50.476 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCbYeRmyghwKRAAICRndBNYIgljsFAVQ/IxUw== 2024-09-13T16:00:50.476 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.3] 2024-09-13T16:00:50.476 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCeYeRmKCIjLhAA82aqewcz+IA6a5F/lSVphw== 2024-09-13T16:00:50.476 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.x] 2024-09-13T16:00:50.476 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCTYeRmkeaWCRAAhsqaCBOmlWijduzPWf48hg== 2024-09-13T16:00:50.476 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2024-09-13T16:00:50.476 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCTYeRmOzq6IxAAOTeumxLZLNyzPmRpXSMBNg== 2024-09-13T16:00:50.476 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2024-09-13T16:00:50.476 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCTYeRmUkNvLRAAuacRjRLrybeG5Nq4QRYpSA== 2024-09-13T16:00:50.476 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.4] 2024-09-13T16:00:50.476 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCkYeRmi7UrJhAAuyExOGdyt2XsCjMnMu3PuA== 2024-09-13T16:00:50.476 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.5] 2024-09-13T16:00:50.477 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCnYeRmi04EKxAA1ugmJrtQTm0u+fDSfCFAQw== 2024-09-13T16:00:50.477 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.6] 2024-09-13T16:00:50.477 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCqYeRmyaj8MBAATkdC1At+nAkXFz6Z23+rAg== 2024-09-13T16:00:50.477 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.7] 2024-09-13T16:00:50.477 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCtYeRm+nO0NhAAnZYoojpcPIdkG316fKLNCA== 2024-09-13T16:00:50.477 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2024-09-13T16:00:50.477 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCTYeRm1wjoNRAARZVmRL3tKm7pe0PP5XE64w== 2024-09-13T16:00:50.477 INFO:teuthology.orchestra.run.smithi107.stdout:[client.2] 2024-09-13T16:00:50.477 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCUYeRmEJq0ABAAigg7mMIYxx3g8o7GUuQERg== 2024-09-13T16:00:50.477 INFO:teuthology.orchestra.run.smithi107.stdout:[client.1] 2024-09-13T16:00:50.477 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCUYeRmw9QzBxAA1rIpPA82YNNW53B3qn1ulQ== 2024-09-13T16:00:50.477 INFO:teuthology.orchestra.run.smithi107.stdout:[client.3] 2024-09-13T16:00:50.477 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCUYeRm+SGQDRAAyWXGqr8yOqIl174YyTUd6w== 2024-09-13T16:00:50.478 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T16:00:50.486 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T16:00:50.612 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T16:00:50.617 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T16:00:50.711 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T16:00:50.715 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T16:00:50.811 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T16:00:50.815 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T16:00:50.907 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T16:00:50.912 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T16:00:51.004 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T16:00:51.008 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T16:00:51.101 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T16:00:51.105 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T16:00:51.197 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T16:00:51.201 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T16:00:51.294 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T16:00:51.299 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T16:00:51.394 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T16:00:51.398 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T16:00:51.494 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T16:00:51.498 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T16:00:51.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T16:00:51.594 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T16:00:51.687 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T16:00:51.691 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T16:00:51.784 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T16:00:51.788 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T16:00:51.880 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T16:00:51.885 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T16:00:51.980 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T16:00:51.984 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T16:00:52.078 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T16:00:52.083 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T16:00:52.177 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T16:00:52.181 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T16:00:52.277 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T16:00:52.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T16:00:52.332 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T16:00:52.438 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T16:00:52.493 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T16:00:52.549 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T16:00:52.657 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T16:00:52.712 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T16:00:52.768 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T16:00:52.876 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T16:00:52.931 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T16:00:52.935 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T16:00:52.970 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T16:00:52.970 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T16:00:52.970 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T16:00:53.012 INFO:tasks.ceph.mon.a:Started 2024-09-13T16:00:53.013 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T16:00:53.013 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T16:00:53.017 INFO:tasks.ceph.mon.b:Started 2024-09-13T16:00:53.017 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T16:00:53.017 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T16:00:53.020 INFO:tasks.ceph.mon.c:Started 2024-09-13T16:00:53.021 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T16:00:53.021 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T16:00:53.021 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T16:00:53.024 INFO:tasks.ceph.mgr.y:Started 2024-09-13T16:00:53.025 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T16:00:53.025 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T16:00:53.028 INFO:tasks.ceph.mgr.x:Started 2024-09-13T16:00:53.028 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T16:00:53.029 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T16:00:53.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.180+0000 7f0229800640 1 Processor -- start 2024-09-13T16:00:53.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.181+0000 7f0229800640 1 -- start start 2024-09-13T16:00:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.182+0000 7f0229800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02240b4ca0 0x7f02240ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.182+0000 7f0229800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f02240cd4b0 0x7f022415ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.182+0000 7f0229800640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02240cdca0 con 0x7f022415c870 2024-09-13T16:00:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.182+0000 7f0229800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022415dfb0 con 0x7f02240cd4b0 2024-09-13T16:00:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.182+0000 7f0229800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022415e290 con 0x7f02240b4ca0 2024-09-13T16:00:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.182+0000 7f0223e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f022415c870 0x7f02240b4590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35304/0 (socket says 172.21.15.70:35304) 2024-09-13T16:00:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.182+0000 7f0223e00640 1 -- 172.21.15.70:0/323469030 learned_addr learned my addr 172.21.15.70:0/323469030 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:00:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.183+0000 7f021b400640 1 --2- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02240b4ca0 0x7f02240ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.183+0000 7f0228e00640 1 --2- 172.21.15.70:0/323469030 >> v2:172.21.15.107:3300/0 conn(0x7f02240cd4b0 0x7f022415ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.183+0000 7f021b400640 1 -- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02240b4ca0 msgr2=0x7f02240ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T16:00:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.183+0000 7f021b400640 1 -- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02240b4ca0 msgr2=0x7f02240ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T16:00:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.183+0000 7f021b400640 1 --2- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02240b4ca0 0x7f02240ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T16:00:53.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.183+0000 7f0228e00640 1 -- 172.21.15.70:0/323469030 >> v2:172.21.15.107:3300/0 conn(0x7f02240cd4b0 msgr2=0x7f022415ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T16:00:53.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.183+0000 7f0228e00640 1 -- 172.21.15.70:0/323469030 >> v2:172.21.15.107:3300/0 conn(0x7f02240cd4b0 msgr2=0x7f022415ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T16:00:53.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.183+0000 7f0228e00640 1 --2- 172.21.15.70:0/323469030 >> v2:172.21.15.107:3300/0 conn(0x7f02240cd4b0 0x7f022415ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T16:00:53.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.183+0000 7f0228e00640 1 --2- 172.21.15.70:0/323469030 >> v2:172.21.15.107:3300/0 conn(0x7f02240cd4b0 0x7f022415ed70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:00:53.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.183+0000 7f021b400640 1 --2- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02240b4ca0 0x7f02240ccf70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:00:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.384+0000 7f0228e00640 1 --2- 172.21.15.70:0/323469030 >> v2:172.21.15.107:3300/0 conn(0x7f02240cd4b0 0x7f022415ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.384+0000 7f021b400640 1 --2- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02240b4ca0 0x7f02240ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.384+0000 7f0228e00640 1 -- 172.21.15.70:0/323469030 >> v2:172.21.15.107:3300/0 conn(0x7f02240cd4b0 msgr2=0x7f022415ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T16:00:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.384+0000 7f0228e00640 1 -- 172.21.15.70:0/323469030 >> v2:172.21.15.107:3300/0 conn(0x7f02240cd4b0 msgr2=0x7f022415ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T16:00:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.384+0000 7f0228e00640 1 --2- 172.21.15.70:0/323469030 >> v2:172.21.15.107:3300/0 conn(0x7f02240cd4b0 0x7f022415ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T16:00:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.384+0000 7f0228e00640 1 --2- 172.21.15.70:0/323469030 >> v2:172.21.15.107:3300/0 conn(0x7f02240cd4b0 0x7f022415ed70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T16:00:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.384+0000 7f021b400640 1 -- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02240b4ca0 msgr2=0x7f02240ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T16:00:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.384+0000 7f021b400640 1 -- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02240b4ca0 msgr2=0x7f02240ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T16:00:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.384+0000 7f021b400640 1 --2- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02240b4ca0 0x7f02240ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T16:00:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.384+0000 7f021b400640 1 --2- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02240b4ca0 0x7f02240ccf70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T16:00:53.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.387+0000 7f0223400640 1 -- 172.21.15.70:0/323469030 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892279006 0 0) 0x7f02240cdca0 con 0x7f022415c870 2024-09-13T16:00:53.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.387+0000 7f0223400640 1 -- 172.21.15.70:0/323469030 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0208003520 con 0x7f022415c870 2024-09-13T16:00:53.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.387+0000 7f0223400640 1 -- 172.21.15.70:0/323469030 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3595412376 0 0) 0x7f0208003520 con 0x7f022415c870 2024-09-13T16:00:53.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.387+0000 7f0223400640 1 -- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02240b4ca0 msgr2=0x7f02240ccf70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:00:53.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.387+0000 7f0223400640 1 --2- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02240b4ca0 0x7f02240ccf70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:53.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.387+0000 7f0223400640 1 -- 172.21.15.70:0/323469030 >> v2:172.21.15.107:3300/0 conn(0x7f02240cd4b0 msgr2=0x7f022415ed70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:00:53.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.387+0000 7f0223400640 1 --2- 172.21.15.70:0/323469030 >> v2:172.21.15.107:3300/0 conn(0x7f02240cd4b0 0x7f022415ed70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:53.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.387+0000 7f0223400640 1 -- 172.21.15.70:0/323469030 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022415e570 con 0x7f022415c870 2024-09-13T16:00:53.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.387+0000 7f0223400640 1 -- 172.21.15.70:0/323469030 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f0214001670 con 0x7f022415c870 2024-09-13T16:00:53.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.387+0000 7f0223400640 1 -- 172.21.15.70:0/323469030 >> v1:172.21.15.70:6789/0 conn(0x7f022415c870 legacy=0x7f02240b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:53.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.387+0000 7f0223400640 1 --2- 172.21.15.70:0/323469030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0208003970 0x7f0208003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:53.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.387+0000 7f0223400640 1 --2- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02240b4ca0 0x7f02080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:53.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.387+0000 7f0223400640 1 --2- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0208004d00 0x7f0208005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:53.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.387+0000 7f0223400640 1 -- 172.21.15.70:0/323469030 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022415dfb0 con 0x7f0208003970 2024-09-13T16:00:53.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.387+0000 7f0223400640 1 -- 172.21.15.70:0/323469030 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022415e290 con 0x7f0208004d00 2024-09-13T16:00:53.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.387+0000 7f0223400640 1 -- 172.21.15.70:0/323469030 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020800bab0 con 0x7f02240b4ca0 2024-09-13T16:00:53.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.388+0000 7f0223e00640 1 --2- 172.21.15.70:0/323469030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0208003970 0x7f0208003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:53.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.388+0000 7f0223e00640 1 -- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02240b4ca0 msgr2=0x7f02080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:53.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.388+0000 7f0228e00640 1 --2- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0208004d00 0x7f0208005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:53.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.388+0000 7f0223e00640 1 --2- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02240b4ca0 0x7f02080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:53.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.388+0000 7f0223e00640 1 -- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0208004d00 msgr2=0x7f0208005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:53.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.388+0000 7f0223e00640 1 --2- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0208004d00 0x7f0208005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:53.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.388+0000 7f0223e00640 1 -- 172.21.15.70:0/323469030 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0208003520 con 0x7f0208003970 2024-09-13T16:00:53.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.388+0000 7f0228e00640 1 --2- 172.21.15.70:0/323469030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0208004d00 0x7f0208005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:00:53.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.389+0000 7f0223e00640 1 --2- 172.21.15.70:0/323469030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0208003970 0x7f0208003d90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f021400c160 tx=0x7f02080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e31015b0e0ae12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:53.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.390+0000 7f0223400640 1 -- 172.21.15.70:0/323469030 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214005ad0 con 0x7f0208003970 2024-09-13T16:00:53.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.390+0000 7f0223400640 1 -- 172.21.15.70:0/323469030 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021402d070 con 0x7f0208003970 2024-09-13T16:00:53.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.390+0000 7f0223400640 1 -- 172.21.15.70:0/323469030 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214005e70 con 0x7f0208003970 2024-09-13T16:00:53.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.390+0000 7f0229800640 1 -- 172.21.15.70:0/323469030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0208003970 msgr2=0x7f0208003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:53.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.390+0000 7f0229800640 1 --2- 172.21.15.70:0/323469030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0208003970 0x7f0208003d90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f021400c160 tx=0x7f02080057f0 comp rx=0 tx=0).stop 2024-09-13T16:00:53.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.390+0000 7f0228e00640 1 -- 172.21.15.70:0/323469030 reap_dead start 2024-09-13T16:00:53.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.391+0000 7f0229800640 1 -- 172.21.15.70:0/323469030 shutdown_connections 2024-09-13T16:00:53.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.391+0000 7f0229800640 1 -- 172.21.15.70:0/323469030 >> 172.21.15.70:0/323469030 conn(0x7f02240cf5b0 msgr2=0x7f02240cf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:53.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.391+0000 7f0229800640 1 -- 172.21.15.70:0/323469030 shutdown_connections 2024-09-13T16:00:53.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.391+0000 7f0229800640 1 -- 172.21.15.70:0/323469030 wait complete. 2024-09-13T16:00:53.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.393+0000 7f0229800640 1 Processor -- start 2024-09-13T16:00:53.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.393+0000 7f0229800640 1 -- start start 2024-09-13T16:00:53.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.394+0000 7f0229800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0208003970 0x7f022414fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:53.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.394+0000 7f0229800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0224154370 0x7f0224150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:53.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.394+0000 7f0229800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0224150980 0x7f02241f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:53.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.394+0000 7f0229800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0224150e30 con 0x7f0224150980 2024-09-13T16:00:53.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.394+0000 7f0229800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0224154870 con 0x7f0208003970 2024-09-13T16:00:53.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.394+0000 7f0229800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0224152250 con 0x7f0224154370 2024-09-13T16:00:53.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.394+0000 7f0228e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0224150980 0x7f02241f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:53.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.394+0000 7f0223e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0208003970 0x7f022414fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:53.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.394+0000 7f021b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0224154370 0x7f0224150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:53.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.394+0000 7f0228e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0224150980 0x7f02241f5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40852/0 (socket says 172.21.15.70:40852) 2024-09-13T16:00:53.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.394+0000 7f0228e00640 1 -- 172.21.15.70:0/2265145059 learned_addr learned my addr 172.21.15.70:0/2265145059 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:00:53.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.395+0000 7f021b400640 1 -- 172.21.15.70:0/2265145059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0208003970 msgr2=0x7f022414fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:53.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.395+0000 7f021b400640 1 --2- 172.21.15.70:0/2265145059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0208003970 0x7f022414fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:53.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.395+0000 7f021b400640 1 -- 172.21.15.70:0/2265145059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0224150980 msgr2=0x7f02241f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:53.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.395+0000 7f021b400640 1 --2- 172.21.15.70:0/2265145059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0224150980 0x7f02241f5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:53.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.395+0000 7f021b400640 1 -- 172.21.15.70:0/2265145059 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0224152530 con 0x7f0224154370 2024-09-13T16:00:53.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.395+0000 7f0228e00640 1 --2- 172.21.15.70:0/2265145059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0224150980 0x7f02241f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:00:53.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.395+0000 7f021b400640 1 --2- 172.21.15.70:0/2265145059 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0224154370 0x7f0224150440 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f020c009ce0 tx=0x7f020c007700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:53.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.395+0000 7f0220c00640 1 -- 172.21.15.70:0/2265145059 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c014410 con 0x7f0224154370 2024-09-13T16:00:53.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.395+0000 7f0220c00640 1 -- 172.21.15.70:0/2265145059 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c00f050 con 0x7f0224154370 2024-09-13T16:00:53.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.395+0000 7f0220c00640 1 -- 172.21.15.70:0/2265145059 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c0147d0 con 0x7f0224154370 2024-09-13T16:00:53.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.395+0000 7f0229800640 1 -- 172.21.15.70:0/2265145059 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0224152810 con 0x7f0224154370 2024-09-13T16:00:53.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.395+0000 7f0229800640 1 -- 172.21.15.70:0/2265145059 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0224151130 con 0x7f0224154370 2024-09-13T16:00:53.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.396+0000 7f0220c00640 1 -- 172.21.15.70:0/2265145059 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f020c014930 con 0x7f0224154370 2024-09-13T16:00:53.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.396+0000 7f0220c00640 1 -- 172.21.15.70:0/2265145059 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f020c01ea00 con 0x7f0224154370 2024-09-13T16:00:53.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.397+0000 7f0229800640 1 -- 172.21.15.70:0/2265145059 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0224067360 con 0x7f0224154370 2024-09-13T16:00:53.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.400+0000 7f0220c00640 1 -- 172.21.15.70:0/2265145059 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f020c014d70 con 0x7f0224154370 2024-09-13T16:00:53.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.465+0000 7f0229800640 1 -- 172.21.15.70:0/2265145059 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f0224152390 con 0x7f0224154370 2024-09-13T16:00:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.473+0000 7f0220c00640 1 -- 172.21.15.70:0/2265145059 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0224152390 con 0x7f0224154370 2024-09-13T16:00:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:adjusted tunables profile to default 2024-09-13T16:00:53.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.474+0000 7f0229800640 1 -- 172.21.15.70:0/2265145059 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0224154370 msgr2=0x7f0224150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:53.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.474+0000 7f0229800640 1 --2- 172.21.15.70:0/2265145059 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0224154370 0x7f0224150440 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f020c009ce0 tx=0x7f020c007700 comp rx=0 tx=0).stop 2024-09-13T16:00:53.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.475+0000 7f0229800640 1 -- 172.21.15.70:0/2265145059 shutdown_connections 2024-09-13T16:00:53.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.475+0000 7f0229800640 1 --2- 172.21.15.70:0/2265145059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0224150980 0x7f02241f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:53.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.475+0000 7f0229800640 1 --2- 172.21.15.70:0/2265145059 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0224154370 0x7f0224150440 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:53.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.475+0000 7f0229800640 1 --2- 172.21.15.70:0/2265145059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0208003970 0x7f022414fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:53.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.475+0000 7f0229800640 1 -- 172.21.15.70:0/2265145059 >> 172.21.15.70:0/2265145059 conn(0x7f02240cf5b0 msgr2=0x7f0224159c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:53.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.475+0000 7f0229800640 1 -- 172.21.15.70:0/2265145059 shutdown_connections 2024-09-13T16:00:53.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:53.475+0000 7f0229800640 1 -- 172.21.15.70:0/2265145059 wait complete. 2024-09-13T16:00:53.490 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T16:00:53.490 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T16:00:53.491 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:53.491 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T16:00:53.512 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:53.511+0000 7f01f8723040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T16:00:53.546 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:53.547 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T16:00:53.562 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:53.561+0000 7f01f8723040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T16:00:53.617 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:53.617 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T16:00:53.712 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:00:53.712 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T16:00:53.747 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:53.746+0000 7f01f8723040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T16:00:53.803 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:53.804 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T16:00:53.809 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:53.808+0000 7f01f8723040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T16:00:53.860 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:53.861 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T16:00:53.900 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:53.898+0000 7f4a8ac49040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T16:00:53.950 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:53.949+0000 7f4a8ac49040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T16:00:53.956 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:53.956 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T16:00:53.983 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:53.982+0000 7f01f8723040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:00:54.052 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:00:54.052 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T16:00:54.108 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:54.107+0000 7f01f8723040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T16:00:54.130 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:54.129+0000 7f4a8ac49040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T16:00:54.149 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 8dec6c32-1d39-4787-b3df-55ce88a5c1cf 0 2024-09-13T16:00:54.194 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:54.191+0000 7f4a8ac49040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T16:00:54.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.336+0000 7f0438c00640 1 Processor -- start 2024-09-13T16:00:54.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.336+0000 7f0438c00640 1 -- start start 2024-09-13T16:00:54.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.337+0000 7f0438c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f043415ca40 0x7f04340d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.338+0000 7f0438c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04340d1b90 0x7f04340d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.338+0000 7f0438c00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f04340ccf20 0x7f04340cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.338+0000 7f0438c00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04340b1ce0 con 0x7f04340ccf20 2024-09-13T16:00:54.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.338+0000 7f0438c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04340cd8f0 con 0x7f043415ca40 2024-09-13T16:00:54.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.338+0000 7f0438c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04340d06e0 con 0x7f04340d1b90 2024-09-13T16:00:54.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.338+0000 7f0433400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f043415ca40 0x7f04340d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.338+0000 7f0433400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f043415ca40 0x7f04340d1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36548/0 (socket says 172.21.15.107:36548) 2024-09-13T16:00:54.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.338+0000 7f0433400640 1 -- 172.21.15.107:0/1718732543 learned_addr learned my addr 172.21.15.107:0/1718732543 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-13T16:00:54.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.338+0000 7f0433e00640 1 --2- 172.21.15.107:0/1718732543 >> v2:172.21.15.70:3300/0 conn(0x7f04340ccf20 0x7f04340cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.338+0000 7f042be00640 1 --2- 172.21.15.107:0/1718732543 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04340d1b90 0x7f04340d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.338+0000 7f0433400640 1 -- 172.21.15.107:0/1718732543 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04340d1b90 msgr2=0x7f04340d1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:54.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.338+0000 7f0433400640 1 --2- 172.21.15.107:0/1718732543 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04340d1b90 0x7f04340d1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.338+0000 7f0433400640 1 -- 172.21.15.107:0/1718732543 >> v2:172.21.15.70:3300/0 conn(0x7f04340ccf20 msgr2=0x7f04340cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:54.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.338+0000 7f0433400640 1 --2- 172.21.15.107:0/1718732543 >> v2:172.21.15.70:3300/0 conn(0x7f04340ccf20 0x7f04340cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.338+0000 7f0433400640 1 -- 172.21.15.107:0/1718732543 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04340d2510 con 0x7f043415ca40 2024-09-13T16:00:54.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.338+0000 7f042be00640 1 --2- 172.21.15.107:0/1718732543 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04340d1b90 0x7f04340d1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:00:54.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.339+0000 7f0433400640 1 --2- 172.21.15.107:0/1718732543 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f043415ca40 0x7f04340d1410 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f04340676e0 tx=0x7f042402a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c36035e1b5655094 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:54.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.340+0000 7f0432a00640 1 -- 172.21.15.107:0/1718732543 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042402ae90 con 0x7f043415ca40 2024-09-13T16:00:54.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.340+0000 7f0432a00640 1 -- 172.21.15.107:0/1718732543 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0424032440 con 0x7f043415ca40 2024-09-13T16:00:54.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.340+0000 7f0432a00640 1 -- 172.21.15.107:0/1718732543 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04240327d0 con 0x7f043415ca40 2024-09-13T16:00:54.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.340+0000 7f0438c00640 1 -- 172.21.15.107:0/1718732543 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f043415ca40 msgr2=0x7f04340d1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:54.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.340+0000 7f0438c00640 1 --2- 172.21.15.107:0/1718732543 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f043415ca40 0x7f04340d1410 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f04340676e0 tx=0x7f042402a140 comp rx=0 tx=0).stop 2024-09-13T16:00:54.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.341+0000 7f0438c00640 1 -- 172.21.15.107:0/1718732543 shutdown_connections 2024-09-13T16:00:54.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.341+0000 7f0438c00640 1 --2- 172.21.15.107:0/1718732543 >> v2:172.21.15.70:3300/0 conn(0x7f04340ccf20 0x7f04340cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.341+0000 7f0438c00640 1 --2- 172.21.15.107:0/1718732543 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04340d1b90 0x7f04340d1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.341+0000 7f0438c00640 1 --2- 172.21.15.107:0/1718732543 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f043415ca40 0x7f04340d1410 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.341+0000 7f0438c00640 1 -- 172.21.15.107:0/1718732543 >> 172.21.15.107:0/1718732543 conn(0x7f04340cf560 msgr2=0x7f04340cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:54.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.341+0000 7f0438c00640 1 -- 172.21.15.107:0/1718732543 shutdown_connections 2024-09-13T16:00:54.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.341+0000 7f0438c00640 1 -- 172.21.15.107:0/1718732543 wait complete. 2024-09-13T16:00:54.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.342+0000 7f0438c00640 1 Processor -- start 2024-09-13T16:00:54.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.342+0000 7f0438c00640 1 -- start start 2024-09-13T16:00:54.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.343+0000 7f0438c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04340ccf20 0x7f0434153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.343+0000 7f0438c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04340d1b90 0x7f043415e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.343+0000 7f0438c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f043415ca40 0x7f04340b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.343+0000 7f0438c00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04341f1f50 con 0x7f04340ccf20 2024-09-13T16:00:54.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.343+0000 7f0438c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04340c69e0 con 0x7f04340d1b90 2024-09-13T16:00:54.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.343+0000 7f0438c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0434156470 con 0x7f043415ca40 2024-09-13T16:00:54.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.344+0000 7f0433e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f043415ca40 0x7f04340b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.344+0000 7f042be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04340d1b90 0x7f043415e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.344+0000 7f0433400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04340ccf20 0x7f0434153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.344+0000 7f0433400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04340ccf20 0x7f0434153720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.107:41398/0 (socket says 172.21.15.107:41398) 2024-09-13T16:00:54.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.344+0000 7f0433e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f043415ca40 0x7f04340b32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:57552/0 (socket says 172.21.15.107:57552) 2024-09-13T16:00:54.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.344+0000 7f0433400640 1 -- 172.21.15.107:0/2930350064 learned_addr learned my addr 172.21.15.107:0/2930350064 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-13T16:00:54.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.344+0000 7f0433400640 1 -- 172.21.15.107:0/2930350064 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f043415ca40 msgr2=0x7f04340b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:54.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.344+0000 7f0433400640 1 --2- 172.21.15.107:0/2930350064 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f043415ca40 0x7f04340b32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.344+0000 7f0433400640 1 -- 172.21.15.107:0/2930350064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04340d1b90 msgr2=0x7f043415e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:54.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.344+0000 7f0433400640 1 --2- 172.21.15.107:0/2930350064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04340d1b90 0x7f043415e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.344+0000 7f0433400640 1 -- 172.21.15.107:0/2930350064 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04240094d0 con 0x7f04340ccf20 2024-09-13T16:00:54.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.344+0000 7f042be00640 1 --2- 172.21.15.107:0/2930350064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04340d1b90 0x7f043415e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:00:54.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.344+0000 7f0433400640 1 --2- 172.21.15.107:0/2930350064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04340ccf20 0x7f0434153720 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f042402a180 tx=0x7f04240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:54.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.345+0000 7f042b400640 1 -- 172.21.15.107:0/2930350064 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042403d830 con 0x7f04340ccf20 2024-09-13T16:00:54.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.345+0000 7f042b400640 1 -- 172.21.15.107:0/2930350064 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042403d990 con 0x7f04340ccf20 2024-09-13T16:00:54.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.345+0000 7f0438c00640 1 -- 172.21.15.107:0/2930350064 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0434153d00 con 0x7f04340ccf20 2024-09-13T16:00:54.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.345+0000 7f042b400640 1 -- 172.21.15.107:0/2930350064 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042403dd40 con 0x7f04340ccf20 2024-09-13T16:00:54.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.345+0000 7f0438c00640 1 -- 172.21.15.107:0/2930350064 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04340c6390 con 0x7f04340ccf20 2024-09-13T16:00:54.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.345+0000 7f042b400640 1 -- 172.21.15.107:0/2930350064 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0424039040 con 0x7f04340ccf20 2024-09-13T16:00:54.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.345+0000 7f042b400640 1 -- 172.21.15.107:0/2930350064 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f042403b7d0 con 0x7f04340ccf20 2024-09-13T16:00:54.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.346+0000 7f0438c00640 1 -- 172.21.15.107:0/2930350064 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04340c61f0 con 0x7f04340ccf20 2024-09-13T16:00:54.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.349+0000 7f042b400640 1 -- 172.21.15.107:0/2930350064 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f04340c61f0 con 0x7f04340ccf20 2024-09-13T16:00:54.389 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:54.387+0000 7f4a8ac49040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:00:54.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.421+0000 7f0438c00640 1 -- 172.21.15.107:0/2930350064 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8dec6c32-1d39-4787-b3df-55ce88a5c1cf", "id": 0} v 0) v1 -- 0x7f04340d1fd0 con 0x7f04340ccf20 2024-09-13T16:00:54.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.423+0000 7f042b400640 1 -- 172.21.15.107:0/2930350064 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8dec6c32-1d39-4787-b3df-55ce88a5c1cf", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f042404b060 con 0x7f04340ccf20 2024-09-13T16:00:54.425 INFO:teuthology.orchestra.run.smithi107.stdout:0 2024-09-13T16:00:54.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.425+0000 7f0438c00640 1 -- 172.21.15.107:0/2930350064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04340ccf20 msgr2=0x7f0434153720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:54.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.425+0000 7f0438c00640 1 --2- 172.21.15.107:0/2930350064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04340ccf20 0x7f0434153720 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f042402a180 tx=0x7f04240046c0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.425+0000 7f0438c00640 1 -- 172.21.15.107:0/2930350064 shutdown_connections 2024-09-13T16:00:54.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.425+0000 7f0438c00640 1 --2- 172.21.15.107:0/2930350064 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f043415ca40 0x7f04340b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.425+0000 7f0438c00640 1 --2- 172.21.15.107:0/2930350064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04340d1b90 0x7f043415e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.425+0000 7f0438c00640 1 --2- 172.21.15.107:0/2930350064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04340ccf20 0x7f0434153720 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.425+0000 7f0438c00640 1 -- 172.21.15.107:0/2930350064 >> 172.21.15.107:0/2930350064 conn(0x7f04340cf560 msgr2=0x7f04340b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:54.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.425+0000 7f0438c00640 1 -- 172.21.15.107:0/2930350064 shutdown_connections 2024-09-13T16:00:54.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.425+0000 7f0438c00640 1 -- 172.21.15.107:0/2930350064 wait complete. 2024-09-13T16:00:54.447 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 050c6d8a-a187-49cb-866a-0067bb72db0a 1 2024-09-13T16:00:54.460 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:54.460+0000 7f01f8723040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T16:00:54.516 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:54.515+0000 7f01f8723040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T16:00:54.530 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:54.529+0000 7f4a8ac49040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T16:00:54.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.597+0000 7fcbd5600640 1 Processor -- start 2024-09-13T16:00:54.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.597+0000 7fcbd5600640 1 -- start start 2024-09-13T16:00:54.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.598+0000 7fcbd5600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd015c9e0 0x7fcbd00cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.598+0000 7fcbd5600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcbd00cd400 0x7fcbd00d0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.598+0000 7fcbd5600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd00ce7a0 con 0x7fcbd00d11e0 2024-09-13T16:00:54.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.598+0000 7fcbd5600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd00d1690 con 0x7fcbd00cd400 2024-09-13T16:00:54.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.598+0000 7fcbd5600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd00d0230 con 0x7fcbd015c9e0 2024-09-13T16:00:54.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.598+0000 7fcbce000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcbd00cd400 0x7fcbd00d0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.598+0000 7fcbcea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd015c9e0 0x7fcbd00cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.598+0000 7fcbce000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcbd00cd400 0x7fcbd00d0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36574/0 (socket says 172.21.15.107:36574) 2024-09-13T16:00:54.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.598+0000 7fcbce000640 1 -- 172.21.15.107:0/1903776838 learned_addr learned my addr 172.21.15.107:0/1903776838 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-13T16:00:54.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.598+0000 7fcbcea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd015c9e0 0x7fcbd00cfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:57560/0 (socket says 172.21.15.107:57560) 2024-09-13T16:00:54.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.599+0000 7fcbce000640 1 -- 172.21.15.107:0/1903776838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd015c9e0 msgr2=0x7fcbd00cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:54.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.599+0000 7fcbce000640 1 --2- 172.21.15.107:0/1903776838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd015c9e0 0x7fcbd00cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.599+0000 7fcbce000640 1 -- 172.21.15.107:0/1903776838 >> v1:172.21.15.70:6789/0 conn(0x7fcbd00d11e0 legacy=0x7fcbd00d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:54.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.599+0000 7fcbce000640 1 -- 172.21.15.107:0/1903776838 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd00cec30 con 0x7fcbd00cd400 2024-09-13T16:00:54.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.599+0000 7fcbcea00640 1 --2- 172.21.15.107:0/1903776838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd015c9e0 0x7fcbd00cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:00:54.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.600+0000 7fcbce000640 1 --2- 172.21.15.107:0/1903776838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd00cd400 0x7fcbd00d0ca0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc009870 tx=0x7fcbbc02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=643f0f27befd46fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:54.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.600+0000 7fcbcd600640 1 -- 172.21.15.107:0/1903776838 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc032440 con 0x7fcbd00cd400 2024-09-13T16:00:54.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.600+0000 7fcbcd600640 1 -- 172.21.15.107:0/1903776838 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbbc0325a0 con 0x7fcbd00cd400 2024-09-13T16:00:54.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.600+0000 7fcbcd600640 1 -- 172.21.15.107:0/1903776838 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc032930 con 0x7fcbd00cd400 2024-09-13T16:00:54.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.600+0000 7fcbd5600640 1 -- 172.21.15.107:0/1903776838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd00cd400 msgr2=0x7fcbd00d0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:54.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.600+0000 7fcbd5600640 1 --2- 172.21.15.107:0/1903776838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd00cd400 0x7fcbd00d0ca0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc009870 tx=0x7fcbbc02a250 comp rx=0 tx=0).stop 2024-09-13T16:00:54.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.601+0000 7fcbd5600640 1 -- 172.21.15.107:0/1903776838 shutdown_connections 2024-09-13T16:00:54.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.601+0000 7fcbd5600640 1 --2- 172.21.15.107:0/1903776838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd00cd400 0x7fcbd00d0ca0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.601+0000 7fcbd5600640 1 --2- 172.21.15.107:0/1903776838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd015c9e0 0x7fcbd00cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.601+0000 7fcbd5600640 1 -- 172.21.15.107:0/1903776838 >> 172.21.15.107:0/1903776838 conn(0x7fcbd008bfc0 msgr2=0x7fcbd008c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:54.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.601+0000 7fcbd5600640 1 -- 172.21.15.107:0/1903776838 shutdown_connections 2024-09-13T16:00:54.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.601+0000 7fcbd5600640 1 -- 172.21.15.107:0/1903776838 wait complete. 2024-09-13T16:00:54.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.602+0000 7fcbd5600640 1 Processor -- start 2024-09-13T16:00:54.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.602+0000 7fcbd5600640 1 -- start start 2024-09-13T16:00:54.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.603+0000 7fcbd5600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd00cd400 0x7fcbd0159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.603+0000 7fcbd5600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd00d11e0 0x7fcbd0158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.603+0000 7fcbd5600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd015c9e0 0x7fcbd00b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.603+0000 7fcbd5600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd015de20 con 0x7fcbd00d11e0 2024-09-13T16:00:54.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.603+0000 7fcbd5600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd00b80d0 con 0x7fcbd015c9e0 2024-09-13T16:00:54.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.603+0000 7fcbd5600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd0159ad0 con 0x7fcbd00cd400 2024-09-13T16:00:54.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.603+0000 7fcbcea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd00cd400 0x7fcbd0159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.603+0000 7fcbcea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd00cd400 0x7fcbd0159250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:57568/0 (socket says 172.21.15.107:57568) 2024-09-13T16:00:54.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.603+0000 7fcbcea00640 1 -- 172.21.15.107:0/1664717133 learned_addr learned my addr 172.21.15.107:0/1664717133 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-13T16:00:54.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.603+0000 7fcbce000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd00d11e0 0x7fcbd0158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.603+0000 7fcbcf400640 1 --2- 172.21.15.107:0/1664717133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd015c9e0 0x7fcbd00b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.604+0000 7fcbcea00640 1 -- 172.21.15.107:0/1664717133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd015c9e0 msgr2=0x7fcbd00b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:54.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.604+0000 7fcbcea00640 1 --2- 172.21.15.107:0/1664717133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd015c9e0 0x7fcbd00b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.604+0000 7fcbcea00640 1 -- 172.21.15.107:0/1664717133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd00d11e0 msgr2=0x7fcbd0158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:54.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.604+0000 7fcbcea00640 1 --2- 172.21.15.107:0/1664717133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd00d11e0 0x7fcbd0158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.604+0000 7fcbcea00640 1 -- 172.21.15.107:0/1664717133 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc0009400 con 0x7fcbd00cd400 2024-09-13T16:00:54.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.604+0000 7fcbcf400640 1 --2- 172.21.15.107:0/1664717133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd015c9e0 0x7fcbd00b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:00:54.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.604+0000 7fcbcea00640 1 --2- 172.21.15.107:0/1664717133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd00cd400 0x7fcbd0159250 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000e960 tx=0x7fcbc000ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:54.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.604+0000 7fcbc6a00640 1 -- 172.21.15.107:0/1664717133 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc000ca00 con 0x7fcbd00cd400 2024-09-13T16:00:54.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.605+0000 7fcbc6a00640 1 -- 172.21.15.107:0/1664717133 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc000cb60 con 0x7fcbd00cd400 2024-09-13T16:00:54.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.605+0000 7fcbc6a00640 1 -- 172.21.15.107:0/1664717133 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0013470 con 0x7fcbd00cd400 2024-09-13T16:00:54.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.605+0000 7fcbd5600640 1 -- 172.21.15.107:0/1664717133 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbbc0094d0 con 0x7fcbd00cd400 2024-09-13T16:00:54.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.605+0000 7fcbd5600640 1 -- 172.21.15.107:0/1664717133 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd00b7b10 con 0x7fcbd00cd400 2024-09-13T16:00:54.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.605+0000 7fcbc6a00640 1 -- 172.21.15.107:0/1664717133 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fcbc0005c90 con 0x7fcbd00cd400 2024-09-13T16:00:54.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.605+0000 7fcbc6a00640 1 -- 172.21.15.107:0/1664717133 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fcbc0013980 con 0x7fcbd00cd400 2024-09-13T16:00:54.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.606+0000 7fcbd5600640 1 -- 172.21.15.107:0/1664717133 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd00667c0 con 0x7fcbd00cd400 2024-09-13T16:00:54.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.608+0000 7fcbc6a00640 1 -- 172.21.15.107:0/1664717133 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fcbc0021060 con 0x7fcbd00cd400 2024-09-13T16:00:54.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.678+0000 7fcbd5600640 1 -- 172.21.15.107:0/1664717133 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd new", "uuid": "050c6d8a-a187-49cb-866a-0067bb72db0a", "id": 1} v 0) v1 -- 0x7fcbd00cd840 con 0x7fcbd00cd400 2024-09-13T16:00:54.680 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:54.679+0000 7f01f8723040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T16:00:54.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.683+0000 7fcbc6a00640 1 -- 172.21.15.107:0/1664717133 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "050c6d8a-a187-49cb-866a-0067bb72db0a", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcbc0029020 con 0x7fcbd00cd400 2024-09-13T16:00:54.684 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-09-13T16:00:54.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.684+0000 7fcbd5600640 1 -- 172.21.15.107:0/1664717133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd00cd400 msgr2=0x7fcbd0159250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:54.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.684+0000 7fcbd5600640 1 --2- 172.21.15.107:0/1664717133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd00cd400 0x7fcbd0159250 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000e960 tx=0x7fcbc000ee20 comp rx=0 tx=0).stop 2024-09-13T16:00:54.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.684+0000 7fcbd5600640 1 -- 172.21.15.107:0/1664717133 shutdown_connections 2024-09-13T16:00:54.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.684+0000 7fcbd5600640 1 --2- 172.21.15.107:0/1664717133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd015c9e0 0x7fcbd00b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.684+0000 7fcbd5600640 1 --2- 172.21.15.107:0/1664717133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd00d11e0 0x7fcbd0158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.684+0000 7fcbd5600640 1 --2- 172.21.15.107:0/1664717133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd00cd400 0x7fcbd0159250 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.684+0000 7fcbd5600640 1 -- 172.21.15.107:0/1664717133 >> 172.21.15.107:0/1664717133 conn(0x7fcbd008bfc0 msgr2=0x7fcbd00cee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:54.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.684+0000 7fcbd5600640 1 -- 172.21.15.107:0/1664717133 shutdown_connections 2024-09-13T16:00:54.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.684+0000 7fcbd5600640 1 -- 172.21.15.107:0/1664717133 wait complete. 2024-09-13T16:00:54.699 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8 2 2024-09-13T16:00:54.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.845+0000 7f5e88c00640 1 Processor -- start 2024-09-13T16:00:54.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.846+0000 7f5e88c00640 1 -- start start 2024-09-13T16:00:54.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.847+0000 7f5e88c00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5e8415fbd0 0x7f5e840cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.847+0000 7f5e88c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5e840b5c50 0x7f5e8415ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.847+0000 7f5e88c00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e840d1540 con 0x7f5e840d10b0 2024-09-13T16:00:54.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.847+0000 7f5e88c00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e840d0c60 con 0x7f5e8415fbd0 2024-09-13T16:00:54.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.847+0000 7f5e88c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e840d1d10 con 0x7f5e840b5c50 2024-09-13T16:00:54.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.847+0000 7f5e83e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5e840b5c50 0x7f5e8415ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.847+0000 7f5e83e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5e840b5c50 0x7f5e8415ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36592/0 (socket says 172.21.15.107:36592) 2024-09-13T16:00:54.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.847+0000 7f5e83e00640 1 -- 172.21.15.107:0/3579593025 learned_addr learned my addr 172.21.15.107:0/3579593025 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-13T16:00:54.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.847+0000 7f5e83400640 1 --2- 172.21.15.107:0/3579593025 >> v2:172.21.15.70:3300/0 conn(0x7f5e8415fbd0 0x7f5e840cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.848+0000 7f5e83e00640 1 -- 172.21.15.107:0/3579593025 >> v2:172.21.15.70:3300/0 conn(0x7f5e8415fbd0 msgr2=0x7f5e840cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:54.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.848+0000 7f5e83e00640 1 --2- 172.21.15.107:0/3579593025 >> v2:172.21.15.70:3300/0 conn(0x7f5e8415fbd0 0x7f5e840cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.848+0000 7f5e83e00640 1 -- 172.21.15.107:0/3579593025 >> v1:172.21.15.70:6789/0 conn(0x7f5e840d10b0 legacy=0x7f5e840b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:54.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.848+0000 7f5e83e00640 1 -- 172.21.15.107:0/3579593025 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e840d1ff0 con 0x7f5e840b5c50 2024-09-13T16:00:54.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.848+0000 7f5e83e00640 1 --2- 172.21.15.107:0/3579593025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e840b5c50 0x7f5e8415ffb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5e84161390 tx=0x7f5e7c02a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6d21b24dca39702 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:54.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.849+0000 7f5e82000640 1 -- 172.21.15.107:0/3579593025 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c031600 con 0x7f5e840b5c50 2024-09-13T16:00:54.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.849+0000 7f5e82000640 1 -- 172.21.15.107:0/3579593025 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c02d050 con 0x7f5e840b5c50 2024-09-13T16:00:54.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.849+0000 7f5e82000640 1 -- 172.21.15.107:0/3579593025 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c031980 con 0x7f5e840b5c50 2024-09-13T16:00:54.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.849+0000 7f5e88c00640 1 -- 172.21.15.107:0/3579593025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e840b5c50 msgr2=0x7f5e8415ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:54.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.849+0000 7f5e88c00640 1 --2- 172.21.15.107:0/3579593025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e840b5c50 0x7f5e8415ffb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5e84161390 tx=0x7f5e7c02a730 comp rx=0 tx=0).stop 2024-09-13T16:00:54.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.849+0000 7f5e88c00640 1 -- 172.21.15.107:0/3579593025 shutdown_connections 2024-09-13T16:00:54.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.849+0000 7f5e88c00640 1 --2- 172.21.15.107:0/3579593025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e840b5c50 0x7f5e8415ffb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.849+0000 7f5e88c00640 1 --2- 172.21.15.107:0/3579593025 >> v2:172.21.15.70:3300/0 conn(0x7f5e8415fbd0 0x7f5e840cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.849+0000 7f5e88c00640 1 -- 172.21.15.107:0/3579593025 >> 172.21.15.107:0/3579593025 conn(0x7f5e840b4100 msgr2=0x7f5e840b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:54.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.850+0000 7f5e88c00640 1 -- 172.21.15.107:0/3579593025 shutdown_connections 2024-09-13T16:00:54.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.850+0000 7f5e88c00640 1 -- 172.21.15.107:0/3579593025 wait complete. 2024-09-13T16:00:54.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.851+0000 7f5e88c00640 1 Processor -- start 2024-09-13T16:00:54.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.851+0000 7f5e88c00640 1 -- start start 2024-09-13T16:00:54.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.852+0000 7f5e88c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e840b5c50 0x7f5e840cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.852+0000 7f5e88c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e840d10b0 0x7f5e841e5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.852+0000 7f5e88c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e8415fbd0 0x7f5e8415e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.852+0000 7f5e88c00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e841e69a0 con 0x7f5e8415fbd0 2024-09-13T16:00:54.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.852+0000 7f5e88c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e841e6c80 con 0x7f5e840b5c50 2024-09-13T16:00:54.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.852+0000 7f5e88c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e841e6f60 con 0x7f5e840d10b0 2024-09-13T16:00:54.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.852+0000 7f5e83400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e840b5c50 0x7f5e840cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.853+0000 7f5e82a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e840d10b0 0x7f5e841e5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.853+0000 7f5e83e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e8415fbd0 0x7f5e8415e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.853+0000 7f5e83400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e840b5c50 0x7f5e840cb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36606/0 (socket says 172.21.15.107:36606) 2024-09-13T16:00:54.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.853+0000 7f5e83400640 1 -- 172.21.15.107:0/963332609 learned_addr learned my addr 172.21.15.107:0/963332609 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-13T16:00:54.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.853+0000 7f5e83400640 1 -- 172.21.15.107:0/963332609 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e840d10b0 msgr2=0x7f5e841e5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:54.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.853+0000 7f5e83400640 1 --2- 172.21.15.107:0/963332609 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e840d10b0 0x7f5e841e5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.853+0000 7f5e83400640 1 -- 172.21.15.107:0/963332609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e8415fbd0 msgr2=0x7f5e8415e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:54.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.853+0000 7f5e83400640 1 --2- 172.21.15.107:0/963332609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e8415fbd0 0x7f5e8415e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.853+0000 7f5e83400640 1 -- 172.21.15.107:0/963332609 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c009b30 con 0x7f5e840b5c50 2024-09-13T16:00:54.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.853+0000 7f5e82a00640 1 --2- 172.21.15.107:0/963332609 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e840d10b0 0x7f5e841e5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:00:54.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.853+0000 7f5e83400640 1 --2- 172.21.15.107:0/963332609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e840b5c50 0x7f5e840cb3f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400e870 tx=0x7f5e7400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:54.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.854+0000 7f5e7b400640 1 -- 172.21.15.107:0/963332609 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e740094f0 con 0x7f5e840b5c50 2024-09-13T16:00:54.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.854+0000 7f5e7b400640 1 -- 172.21.15.107:0/963332609 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7400c940 con 0x7f5e840b5c50 2024-09-13T16:00:54.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.854+0000 7f5e7b400640 1 -- 172.21.15.107:0/963332609 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7400ccf0 con 0x7f5e840b5c50 2024-09-13T16:00:54.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.854+0000 7f5e88c00640 1 -- 172.21.15.107:0/963332609 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e841e7240 con 0x7f5e840b5c50 2024-09-13T16:00:54.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.854+0000 7f5e88c00640 1 -- 172.21.15.107:0/963332609 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e841e6520 con 0x7f5e840b5c50 2024-09-13T16:00:54.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.854+0000 7f5e7b400640 1 -- 172.21.15.107:0/963332609 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5e74005c90 con 0x7f5e840b5c50 2024-09-13T16:00:54.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.854+0000 7f5e7b400640 1 -- 172.21.15.107:0/963332609 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f5e740067f0 con 0x7f5e840b5c50 2024-09-13T16:00:54.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.855+0000 7f5e88c00640 1 -- 172.21.15.107:0/963332609 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e841e6740 con 0x7f5e840b5c50 2024-09-13T16:00:54.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.857+0000 7f5e7b400640 1 -- 172.21.15.107:0/963332609 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f5e74021060 con 0x7f5e840b5c50 2024-09-13T16:00:54.912 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:54.910+0000 7f4a8ac49040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T16:00:54.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.928+0000 7f5e88c00640 1 -- 172.21.15.107:0/963332609 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8", "id": 2} v 0) v1 -- 0x7f5e840d18b0 con 0x7f5e840b5c50 2024-09-13T16:00:54.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.932+0000 7f5e7b400640 1 -- 172.21.15.107:0/963332609 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5e74029020 con 0x7f5e840b5c50 2024-09-13T16:00:54.933 INFO:teuthology.orchestra.run.smithi107.stdout:2 2024-09-13T16:00:54.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.933+0000 7f5e88c00640 1 -- 172.21.15.107:0/963332609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e840b5c50 msgr2=0x7f5e840cb3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:54.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.933+0000 7f5e88c00640 1 --2- 172.21.15.107:0/963332609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e840b5c50 0x7f5e840cb3f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400e870 tx=0x7f5e7400ed30 comp rx=0 tx=0).stop 2024-09-13T16:00:54.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.933+0000 7f5e88c00640 1 -- 172.21.15.107:0/963332609 shutdown_connections 2024-09-13T16:00:54.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.933+0000 7f5e88c00640 1 --2- 172.21.15.107:0/963332609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e8415fbd0 0x7f5e8415e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.933+0000 7f5e88c00640 1 --2- 172.21.15.107:0/963332609 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e840d10b0 0x7f5e841e5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.933+0000 7f5e88c00640 1 --2- 172.21.15.107:0/963332609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e840b5c50 0x7f5e840cb3f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.933+0000 7f5e88c00640 1 -- 172.21.15.107:0/963332609 >> 172.21.15.107:0/963332609 conn(0x7f5e840b4100 msgr2=0x7f5e840b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:54.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.933+0000 7f5e88c00640 1 -- 172.21.15.107:0/963332609 shutdown_connections 2024-09-13T16:00:54.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:54.933+0000 7f5e88c00640 1 -- 172.21.15.107:0/963332609 wait complete. 2024-09-13T16:00:54.949 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new aed25332-b55f-46b9-9f74-2d313b8a41cc 3 2024-09-13T16:00:54.971 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:54.969+0000 7f4a8ac49040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T16:00:55.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.098+0000 7f3a7a200640 1 Processor -- start 2024-09-13T16:00:55.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.098+0000 7f3a7a200640 1 -- start start 2024-09-13T16:00:55.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.099+0000 7f3a7a200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3a7415ca40 0x7f3a740d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.099+0000 7f3a7a200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3a740d1b90 0x7f3a740d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.099+0000 7f3a7a200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a740ccf20 0x7f3a740cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.099+0000 7f3a7a200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a740b1ce0 con 0x7f3a7415ca40 2024-09-13T16:00:55.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.099+0000 7f3a7a200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a740cd910 con 0x7f3a740d1b90 2024-09-13T16:00:55.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.099+0000 7f3a7a200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a740d06e0 con 0x7f3a740ccf20 2024-09-13T16:00:55.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.100+0000 7f3a73e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3a740d1b90 0x7f3a740d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.100+0000 7f3a79800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a740ccf20 0x7f3a740cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.100+0000 7f3a73e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3a740d1b90 0x7f3a740d1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36616/0 (socket says 172.21.15.107:36616) 2024-09-13T16:00:55.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.100+0000 7f3a73e00640 1 -- 172.21.15.107:0/2824686003 learned_addr learned my addr 172.21.15.107:0/2824686003 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-13T16:00:55.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.100+0000 7f3a78e00640 1 --2- 172.21.15.107:0/2824686003 >> v2:172.21.15.70:3300/0 conn(0x7f3a7415ca40 0x7f3a740d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.100+0000 7f3a73e00640 1 -- 172.21.15.107:0/2824686003 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a740ccf20 msgr2=0x7f3a740cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:55.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.100+0000 7f3a73e00640 1 --2- 172.21.15.107:0/2824686003 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a740ccf20 0x7f3a740cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.100+0000 7f3a73e00640 1 -- 172.21.15.107:0/2824686003 >> v2:172.21.15.70:3300/0 conn(0x7f3a7415ca40 msgr2=0x7f3a740d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:55.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.100+0000 7f3a73e00640 1 --2- 172.21.15.107:0/2824686003 >> v2:172.21.15.70:3300/0 conn(0x7f3a7415ca40 0x7f3a740d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.100+0000 7f3a73e00640 1 -- 172.21.15.107:0/2824686003 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a740d2510 con 0x7f3a740d1b90 2024-09-13T16:00:55.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.101+0000 7f3a73e00640 1 --2- 172.21.15.107:0/2824686003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a740d1b90 0x7f3a740d1fd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3a740cec50 tx=0x7f3a6002a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b563418b393e1c13 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:55.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.101+0000 7f3a73400640 1 -- 172.21.15.107:0/2824686003 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6002ae90 con 0x7f3a740d1b90 2024-09-13T16:00:55.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.101+0000 7f3a73400640 1 -- 172.21.15.107:0/2824686003 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a60032440 con 0x7f3a740d1b90 2024-09-13T16:00:55.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.101+0000 7f3a73400640 1 -- 172.21.15.107:0/2824686003 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a600327d0 con 0x7f3a740d1b90 2024-09-13T16:00:55.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.102+0000 7f3a7a200640 1 -- 172.21.15.107:0/2824686003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a740d1b90 msgr2=0x7f3a740d1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.102+0000 7f3a7a200640 1 --2- 172.21.15.107:0/2824686003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a740d1b90 0x7f3a740d1fd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3a740cec50 tx=0x7f3a6002a140 comp rx=0 tx=0).stop 2024-09-13T16:00:55.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.102+0000 7f3a7a200640 1 -- 172.21.15.107:0/2824686003 shutdown_connections 2024-09-13T16:00:55.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.102+0000 7f3a7a200640 1 --2- 172.21.15.107:0/2824686003 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a740ccf20 0x7f3a740cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.102+0000 7f3a7a200640 1 --2- 172.21.15.107:0/2824686003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a740d1b90 0x7f3a740d1fd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.102+0000 7f3a7a200640 1 --2- 172.21.15.107:0/2824686003 >> v2:172.21.15.70:3300/0 conn(0x7f3a7415ca40 0x7f3a740d1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.102+0000 7f3a7a200640 1 -- 172.21.15.107:0/2824686003 >> 172.21.15.107:0/2824686003 conn(0x7f3a740cf560 msgr2=0x7f3a740cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:55.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.102+0000 7f3a7a200640 1 -- 172.21.15.107:0/2824686003 shutdown_connections 2024-09-13T16:00:55.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.102+0000 7f3a7a200640 1 -- 172.21.15.107:0/2824686003 wait complete. 2024-09-13T16:00:55.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.104+0000 7f3a7a200640 1 Processor -- start 2024-09-13T16:00:55.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.104+0000 7f3a7a200640 1 -- start start 2024-09-13T16:00:55.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.105+0000 7f3a7a200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a740ccf20 0x7f3a74159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.105+0000 7f3a7a200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a740d1b90 0x7f3a7415db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.105+0000 7f3a7a200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a7415ca40 0x7f3a740ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.105+0000 7f3a7a200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a741f25c0 con 0x7f3a740d1b90 2024-09-13T16:00:55.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.105+0000 7f3a7a200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a741e58c0 con 0x7f3a740ccf20 2024-09-13T16:00:55.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.105+0000 7f3a7a200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a741e5ba0 con 0x7f3a7415ca40 2024-09-13T16:00:55.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.105+0000 7f3a78e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a740ccf20 0x7f3a74159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.105+0000 7f3a78e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a740ccf20 0x7f3a74159760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36628/0 (socket says 172.21.15.107:36628) 2024-09-13T16:00:55.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.105+0000 7f3a78e00640 1 -- 172.21.15.107:0/1805093960 learned_addr learned my addr 172.21.15.107:0/1805093960 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-13T16:00:55.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.105+0000 7f3a79800640 1 --2- 172.21.15.107:0/1805093960 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a7415ca40 0x7f3a740ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.105+0000 7f3a73e00640 1 --2- 172.21.15.107:0/1805093960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a740d1b90 0x7f3a7415db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.105+0000 7f3a78e00640 1 -- 172.21.15.107:0/1805093960 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a7415ca40 msgr2=0x7f3a740ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.105+0000 7f3a78e00640 1 --2- 172.21.15.107:0/1805093960 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a7415ca40 0x7f3a740ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.105+0000 7f3a78e00640 1 -- 172.21.15.107:0/1805093960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a740d1b90 msgr2=0x7f3a7415db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.105+0000 7f3a78e00640 1 --2- 172.21.15.107:0/1805093960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a740d1b90 0x7f3a7415db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.105+0000 7f3a78e00640 1 -- 172.21.15.107:0/1805093960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a600094d0 con 0x7f3a740ccf20 2024-09-13T16:00:55.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.106+0000 7f3a78e00640 1 --2- 172.21.15.107:0/1805093960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a740ccf20 0x7f3a74159760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800d5f0 tx=0x7f3a6800dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:55.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.106+0000 7f3a70c00640 1 -- 172.21.15.107:0/1805093960 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a680125f0 con 0x7f3a740ccf20 2024-09-13T16:00:55.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.106+0000 7f3a70c00640 1 -- 172.21.15.107:0/1805093960 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a68012750 con 0x7f3a740ccf20 2024-09-13T16:00:55.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.106+0000 7f3a7a200640 1 -- 172.21.15.107:0/1805093960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a740cb180 con 0x7f3a740ccf20 2024-09-13T16:00:55.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.106+0000 7f3a70c00640 1 -- 172.21.15.107:0/1805093960 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a68012b00 con 0x7f3a740ccf20 2024-09-13T16:00:55.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.106+0000 7f3a7a200640 1 -- 172.21.15.107:0/1805093960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a741e5e80 con 0x7f3a740ccf20 2024-09-13T16:00:55.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.106+0000 7f3a70c00640 1 -- 172.21.15.107:0/1805093960 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3a6801e460 con 0x7f3a740ccf20 2024-09-13T16:00:55.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.107+0000 7f3a70c00640 1 -- 172.21.15.107:0/1805093960 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f3a6801ec00 con 0x7f3a740ccf20 2024-09-13T16:00:55.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.107+0000 7f3a7a200640 1 -- 172.21.15.107:0/1805093960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a740d1fd0 con 0x7f3a740ccf20 2024-09-13T16:00:55.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.110+0000 7f3a70c00640 1 -- 172.21.15.107:0/1805093960 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f3a6801edc0 con 0x7f3a740ccf20 2024-09-13T16:00:55.150 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:55.148+0000 7f4a8ac49040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T16:00:55.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.181+0000 7f3a7a200640 1 -- 172.21.15.107:0/1805093960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "aed25332-b55f-46b9-9f74-2d313b8a41cc", "id": 3} v 0) v1 -- 0x7f3a740b8640 con 0x7f3a740ccf20 2024-09-13T16:00:55.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.184+0000 7f3a70c00640 1 -- 172.21.15.107:0/1805093960 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aed25332-b55f-46b9-9f74-2d313b8a41cc", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3a6801e840 con 0x7f3a740ccf20 2024-09-13T16:00:55.186 INFO:teuthology.orchestra.run.smithi107.stdout:3 2024-09-13T16:00:55.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.185+0000 7f3a7a200640 1 -- 172.21.15.107:0/1805093960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a740ccf20 msgr2=0x7f3a74159760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.185+0000 7f3a7a200640 1 --2- 172.21.15.107:0/1805093960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a740ccf20 0x7f3a74159760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800d5f0 tx=0x7f3a6800dab0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.185+0000 7f3a7a200640 1 -- 172.21.15.107:0/1805093960 shutdown_connections 2024-09-13T16:00:55.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.185+0000 7f3a7a200640 1 --2- 172.21.15.107:0/1805093960 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3a7415ca40 0x7f3a740ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.185+0000 7f3a7a200640 1 --2- 172.21.15.107:0/1805093960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a740d1b90 0x7f3a7415db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.185+0000 7f3a7a200640 1 --2- 172.21.15.107:0/1805093960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a740ccf20 0x7f3a74159760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.185+0000 7f3a7a200640 1 -- 172.21.15.107:0/1805093960 >> 172.21.15.107:0/1805093960 conn(0x7f3a740cf560 msgr2=0x7f3a740cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:55.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.186+0000 7f3a7a200640 1 -- 172.21.15.107:0/1805093960 shutdown_connections 2024-09-13T16:00:55.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.186+0000 7f3a7a200640 1 -- 172.21.15.107:0/1805093960 wait complete. 2024-09-13T16:00:55.201 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new e877320e-4e3f-4f62-af07-4331b6a0a2fa 4 2024-09-13T16:00:55.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.388+0000 7ff432800640 1 Processor -- start 2024-09-13T16:00:55.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.389+0000 7ff432800640 1 -- start start 2024-09-13T16:00:55.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.390+0000 7ff432800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff42c15ca40 0x7ff42c0d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.390+0000 7ff432800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff42c0cd630 0x7ff42c0d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.390+0000 7ff432800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42c0d06e0 con 0x7ff42c0d1b90 2024-09-13T16:00:55.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.390+0000 7ff432800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42c0b1ce0 con 0x7ff42c0cd630 2024-09-13T16:00:55.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.390+0000 7ff432800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42c0d2510 con 0x7ff42c15ca40 2024-09-13T16:00:55.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.390+0000 7ff431400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff42c15ca40 0x7ff42c0d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.390+0000 7ff431400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff42c15ca40 0x7ff42c0d1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36644/0 (socket says 172.21.15.107:36644) 2024-09-13T16:00:55.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.390+0000 7ff431400640 1 -- 172.21.15.107:0/485128302 learned_addr learned my addr 172.21.15.107:0/485128302 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-13T16:00:55.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.390+0000 7ff431e00640 1 --2- 172.21.15.107:0/485128302 >> v2:172.21.15.70:3300/0 conn(0x7ff42c0cd630 0x7ff42c0d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.390+0000 7ff431400640 1 -- 172.21.15.107:0/485128302 >> v2:172.21.15.70:3300/0 conn(0x7ff42c0cd630 msgr2=0x7ff42c0d1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:55.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.390+0000 7ff431400640 1 --2- 172.21.15.107:0/485128302 >> v2:172.21.15.70:3300/0 conn(0x7ff42c0cd630 0x7ff42c0d1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.390+0000 7ff431400640 1 -- 172.21.15.107:0/485128302 >> v1:172.21.15.107:6789/0 conn(0x7ff42c0d1b90 legacy=0x7ff42c0ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.391+0000 7ff42be00640 1 -- 172.21.15.107:0/485128302 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 131433032 0 0) 0x7ff42c0d06e0 con 0x7ff42c0d1b90 2024-09-13T16:00:55.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.391+0000 7ff431400640 1 -- 172.21.15.107:0/485128302 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c0cdb30 con 0x7ff42c15ca40 2024-09-13T16:00:55.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.391+0000 7ff431400640 1 --2- 172.21.15.107:0/485128302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff42c15ca40 0x7ff42c0d1410 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0676e0 tx=0x7ff42002a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c79e7159c7e73d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:55.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.392+0000 7ff42be00640 1 -- 172.21.15.107:0/485128302 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420032440 con 0x7ff42c15ca40 2024-09-13T16:00:55.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.392+0000 7ff42be00640 1 -- 172.21.15.107:0/485128302 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4200325a0 con 0x7ff42c15ca40 2024-09-13T16:00:55.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.392+0000 7ff42be00640 1 -- 172.21.15.107:0/485128302 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420032930 con 0x7ff42c15ca40 2024-09-13T16:00:55.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.392+0000 7ff432800640 1 -- 172.21.15.107:0/485128302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff42c15ca40 msgr2=0x7ff42c0d1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.392+0000 7ff432800640 1 --2- 172.21.15.107:0/485128302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff42c15ca40 0x7ff42c0d1410 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0676e0 tx=0x7ff42002a1e0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.392+0000 7ff432800640 1 -- 172.21.15.107:0/485128302 shutdown_connections 2024-09-13T16:00:55.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.392+0000 7ff432800640 1 --2- 172.21.15.107:0/485128302 >> v2:172.21.15.70:3300/0 conn(0x7ff42c0cd630 0x7ff42c0d1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.392+0000 7ff432800640 1 --2- 172.21.15.107:0/485128302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff42c15ca40 0x7ff42c0d1410 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.392+0000 7ff432800640 1 -- 172.21.15.107:0/485128302 >> 172.21.15.107:0/485128302 conn(0x7ff42c0cf560 msgr2=0x7ff42c0cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:55.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.393+0000 7ff432800640 1 -- 172.21.15.107:0/485128302 shutdown_connections 2024-09-13T16:00:55.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.393+0000 7ff432800640 1 -- 172.21.15.107:0/485128302 wait complete. 2024-09-13T16:00:55.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.394+0000 7ff432800640 1 Processor -- start 2024-09-13T16:00:55.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.394+0000 7ff432800640 1 -- start start 2024-09-13T16:00:55.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.395+0000 7ff432800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff42c0cd630 0x7ff42c0c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.395+0000 7ff432800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff42c0d1b90 0x7ff42c0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.395+0000 7ff432800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff42c15ca40 0x7ff42c15dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.395+0000 7ff432800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c157640 con 0x7ff42c15ca40 2024-09-13T16:00:55.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.395+0000 7ff432800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c15e420 con 0x7ff42c0d1b90 2024-09-13T16:00:55.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.395+0000 7ff432800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c0c9d70 con 0x7ff42c0cd630 2024-09-13T16:00:55.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.395+0000 7ff431400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff42c0cd630 0x7ff42c0c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.395+0000 7ff431400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff42c0cd630 0x7ff42c0c9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:57598/0 (socket says 172.21.15.107:57598) 2024-09-13T16:00:55.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.395+0000 7ff431400640 1 -- 172.21.15.107:0/970858877 learned_addr learned my addr 172.21.15.107:0/970858877 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-13T16:00:55.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.395+0000 7ff430a00640 1 --2- 172.21.15.107:0/970858877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff42c0d1b90 0x7ff42c0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.396+0000 7ff431e00640 1 --2- 172.21.15.107:0/970858877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff42c15ca40 0x7ff42c15dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.396+0000 7ff431400640 1 -- 172.21.15.107:0/970858877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff42c0d1b90 msgr2=0x7ff42c0cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.396+0000 7ff431400640 1 --2- 172.21.15.107:0/970858877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff42c0d1b90 0x7ff42c0cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.396+0000 7ff431400640 1 -- 172.21.15.107:0/970858877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff42c15ca40 msgr2=0x7ff42c15dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.396+0000 7ff431400640 1 --2- 172.21.15.107:0/970858877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff42c15ca40 0x7ff42c15dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.396+0000 7ff431400640 1 -- 172.21.15.107:0/970858877 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4200094d0 con 0x7ff42c0cd630 2024-09-13T16:00:55.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.396+0000 7ff431400640 1 --2- 172.21.15.107:0/970858877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff42c0cd630 0x7ff42c0c9790 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff420000c00 tx=0x7ff4200046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:55.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.396+0000 7ff429600640 1 -- 172.21.15.107:0/970858877 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420032440 con 0x7ff42c0cd630 2024-09-13T16:00:55.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.396+0000 7ff429600640 1 -- 172.21.15.107:0/970858877 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff420030980 con 0x7ff42c0cd630 2024-09-13T16:00:55.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.396+0000 7ff432800640 1 -- 172.21.15.107:0/970858877 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42c0ca050 con 0x7ff42c0cd630 2024-09-13T16:00:55.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.397+0000 7ff429600640 1 -- 172.21.15.107:0/970858877 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420030d30 con 0x7ff42c0cd630 2024-09-13T16:00:55.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.397+0000 7ff432800640 1 -- 172.21.15.107:0/970858877 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42c0ca610 con 0x7ff42c0cd630 2024-09-13T16:00:55.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.397+0000 7ff429600640 1 -- 172.21.15.107:0/970858877 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff420039040 con 0x7ff42c0cd630 2024-09-13T16:00:55.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.397+0000 7ff429600640 1 -- 172.21.15.107:0/970858877 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7ff420047c60 con 0x7ff42c0cd630 2024-09-13T16:00:55.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.398+0000 7ff432800640 1 -- 172.21.15.107:0/970858877 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42c0d1fd0 con 0x7ff42c0cd630 2024-09-13T16:00:55.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.400+0000 7ff429600640 1 -- 172.21.15.107:0/970858877 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7ff42004c060 con 0x7ff42c0cd630 2024-09-13T16:00:55.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.468+0000 7ff432800640 1 -- 172.21.15.107:0/970858877 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e877320e-4e3f-4f62-af07-4331b6a0a2fa", "id": 4} v 0) v1 -- 0x7ff42c0b8640 con 0x7ff42c0cd630 2024-09-13T16:00:55.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.473+0000 7ff429600640 1 -- 172.21.15.107:0/970858877 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e877320e-4e3f-4f62-af07-4331b6a0a2fa", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff420042070 con 0x7ff42c0cd630 2024-09-13T16:00:55.474 INFO:teuthology.orchestra.run.smithi107.stdout:4 2024-09-13T16:00:55.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.474+0000 7ff432800640 1 -- 172.21.15.107:0/970858877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff42c0cd630 msgr2=0x7ff42c0c9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.474+0000 7ff432800640 1 --2- 172.21.15.107:0/970858877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff42c0cd630 0x7ff42c0c9790 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff420000c00 tx=0x7ff4200046c0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.474+0000 7ff432800640 1 -- 172.21.15.107:0/970858877 shutdown_connections 2024-09-13T16:00:55.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.474+0000 7ff432800640 1 --2- 172.21.15.107:0/970858877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff42c15ca40 0x7ff42c15dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.474+0000 7ff432800640 1 --2- 172.21.15.107:0/970858877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff42c0d1b90 0x7ff42c0cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.474+0000 7ff432800640 1 --2- 172.21.15.107:0/970858877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff42c0cd630 0x7ff42c0c9790 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.474+0000 7ff432800640 1 -- 172.21.15.107:0/970858877 >> 172.21.15.107:0/970858877 conn(0x7ff42c0cf560 msgr2=0x7ff42c0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:55.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.474+0000 7ff432800640 1 -- 172.21.15.107:0/970858877 shutdown_connections 2024-09-13T16:00:55.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.474+0000 7ff432800640 1 -- 172.21.15.107:0/970858877 wait complete. 2024-09-13T16:00:55.489 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 9d3bca4f-e5dc-454d-be9a-e98f963ca7a7 5 2024-09-13T16:00:55.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.638+0000 7f4ebf200640 1 Processor -- start 2024-09-13T16:00:55.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.638+0000 7f4ebf200640 1 -- start start 2024-09-13T16:00:55.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.639+0000 7f4ebf200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4ec015a320 0x7f4ec00b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.639+0000 7f4ebf200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4ec00b2b80 0x7f4ec00cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.639+0000 7f4ebf200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ec00cdb30 0x7f4ec015df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.639+0000 7f4ebf200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec00cb970 con 0x7f4ec015a320 2024-09-13T16:00:55.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.639+0000 7f4ebf200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec006b740 con 0x7f4ec00b2b80 2024-09-13T16:00:55.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.639+0000 7f4ebf200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec00b1cb0 con 0x7f4ec00cdb30 2024-09-13T16:00:55.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.640+0000 7f4eb5400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4ec00b2b80 0x7f4ec00cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.640+0000 7f4ebe800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ec00cdb30 0x7f4ec015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.640+0000 7f4eb5400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4ec00b2b80 0x7f4ec00cd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36658/0 (socket says 172.21.15.107:36658) 2024-09-13T16:00:55.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.640+0000 7f4eb5400640 1 -- 172.21.15.107:0/576819523 learned_addr learned my addr 172.21.15.107:0/576819523 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-13T16:00:55.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.640+0000 7f4ebe800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ec00cdb30 0x7f4ec015df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:57614/0 (socket says 172.21.15.107:57614) 2024-09-13T16:00:55.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.640+0000 7f4ebde00640 1 --2- 172.21.15.107:0/576819523 >> v2:172.21.15.70:3300/0 conn(0x7f4ec015a320 0x7f4ec00b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.640+0000 7f4eb5400640 1 -- 172.21.15.107:0/576819523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ec00cdb30 msgr2=0x7f4ec015df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:55.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.640+0000 7f4eb5400640 1 --2- 172.21.15.107:0/576819523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ec00cdb30 0x7f4ec015df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.640+0000 7f4eb5400640 1 -- 172.21.15.107:0/576819523 >> v2:172.21.15.70:3300/0 conn(0x7f4ec015a320 msgr2=0x7f4ec00b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:55.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.640+0000 7f4eb5400640 1 --2- 172.21.15.107:0/576819523 >> v2:172.21.15.70:3300/0 conn(0x7f4ec015a320 0x7f4ec00b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.640+0000 7f4eb5400640 1 -- 172.21.15.107:0/576819523 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec00cbb50 con 0x7f4ec00b2b80 2024-09-13T16:00:55.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.641+0000 7f4eb5400640 1 --2- 172.21.15.107:0/576819523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ec00b2b80 0x7f4ec00cd5f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4ec00cb140 tx=0x7f4ea802a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a53a72d4abaa640 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:55.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.641+0000 7f4ebd400640 1 -- 172.21.15.107:0/576819523 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea802ae90 con 0x7f4ec00b2b80 2024-09-13T16:00:55.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.641+0000 7f4ebd400640 1 -- 172.21.15.107:0/576819523 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea8032440 con 0x7f4ec00b2b80 2024-09-13T16:00:55.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.641+0000 7f4ebd400640 1 -- 172.21.15.107:0/576819523 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea80327d0 con 0x7f4ec00b2b80 2024-09-13T16:00:55.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.642+0000 7f4ebf200640 1 -- 172.21.15.107:0/576819523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ec00b2b80 msgr2=0x7f4ec00cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.642+0000 7f4ebf200640 1 --2- 172.21.15.107:0/576819523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ec00b2b80 0x7f4ec00cd5f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4ec00cb140 tx=0x7f4ea802a140 comp rx=0 tx=0).stop 2024-09-13T16:00:55.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.642+0000 7f4ebf200640 1 -- 172.21.15.107:0/576819523 shutdown_connections 2024-09-13T16:00:55.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.642+0000 7f4ebf200640 1 --2- 172.21.15.107:0/576819523 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ec00cdb30 0x7f4ec015df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.642+0000 7f4ebf200640 1 --2- 172.21.15.107:0/576819523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ec00b2b80 0x7f4ec00cd5f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.642+0000 7f4ebf200640 1 --2- 172.21.15.107:0/576819523 >> v2:172.21.15.70:3300/0 conn(0x7f4ec015a320 0x7f4ec00b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.642+0000 7f4ebf200640 1 -- 172.21.15.107:0/576819523 >> 172.21.15.107:0/576819523 conn(0x7f4ec0069ed0 msgr2=0x7f4ec006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:55.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.642+0000 7f4ebf200640 1 -- 172.21.15.107:0/576819523 shutdown_connections 2024-09-13T16:00:55.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.642+0000 7f4ebf200640 1 -- 172.21.15.107:0/576819523 wait complete. 2024-09-13T16:00:55.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.644+0000 7f4ebf200640 1 Processor -- start 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.644+0000 7f4ebf200640 1 -- start start 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.645+0000 7f4ebf200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec00b2b80 0x7f4ec00af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.645+0000 7f4ebf200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ec00cdb30 0x7f4ec00c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.645+0000 7f4ebf200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ec015a320 0x7f4ec00c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.645+0000 7f4ebf200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec0154db0 con 0x7f4ec00b2b80 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.645+0000 7f4ebf200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec00c9ad0 con 0x7f4ec015a320 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.645+0000 7f4ebf200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec00c9db0 con 0x7f4ec00cdb30 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.645+0000 7f4eb5400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ec00cdb30 0x7f4ec00c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.645+0000 7f4ebe800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ec015a320 0x7f4ec00c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.645+0000 7f4ebde00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec00b2b80 0x7f4ec00af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.645+0000 7f4ebe800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ec015a320 0x7f4ec00c7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36668/0 (socket says 172.21.15.107:36668) 2024-09-13T16:00:55.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.645+0000 7f4ebe800640 1 -- 172.21.15.107:0/4276001683 learned_addr learned my addr 172.21.15.107:0/4276001683 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-13T16:00:55.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.645+0000 7f4ebe800640 1 -- 172.21.15.107:0/4276001683 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ec00cdb30 msgr2=0x7f4ec00c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.645+0000 7f4ebe800640 1 --2- 172.21.15.107:0/4276001683 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ec00cdb30 0x7f4ec00c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.645+0000 7f4ebe800640 1 -- 172.21.15.107:0/4276001683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec00b2b80 msgr2=0x7f4ec00af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.645+0000 7f4ebe800640 1 --2- 172.21.15.107:0/4276001683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec00b2b80 0x7f4ec00af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.645+0000 7f4ebe800640 1 -- 172.21.15.107:0/4276001683 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea80094d0 con 0x7f4ec015a320 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.645+0000 7f4eb5400640 1 --2- 172.21.15.107:0/4276001683 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ec00cdb30 0x7f4ec00c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.646+0000 7f4ebe800640 1 --2- 172.21.15.107:0/4276001683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ec015a320 0x7f4ec00c7220 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4eb800eed0 tx=0x7f4eb800b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.646+0000 7f4eb6a00640 1 -- 172.21.15.107:0/4276001683 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8010040 con 0x7f4ec015a320 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.646+0000 7f4eb6a00640 1 -- 172.21.15.107:0/4276001683 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb800bd20 con 0x7f4ec015a320 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.646+0000 7f4ebf200640 1 -- 172.21.15.107:0/4276001683 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec0155050 con 0x7f4ec015a320 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.646+0000 7f4eb6a00640 1 -- 172.21.15.107:0/4276001683 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8014640 con 0x7f4ec015a320 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.646+0000 7f4ebf200640 1 -- 172.21.15.107:0/4276001683 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec00afe20 con 0x7f4ec015a320 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.646+0000 7f4eb6a00640 1 -- 172.21.15.107:0/4276001683 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4eb8014aa0 con 0x7f4ec015a320 2024-09-13T16:00:55.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.646+0000 7f4eb6a00640 1 -- 172.21.15.107:0/4276001683 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f4eb8014d50 con 0x7f4ec015a320 2024-09-13T16:00:55.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.647+0000 7f4ebf200640 1 -- 172.21.15.107:0/4276001683 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec015de60 con 0x7f4ec015a320 2024-09-13T16:00:55.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.649+0000 7f4eb6a00640 1 -- 172.21.15.107:0/4276001683 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f4eb8018020 con 0x7f4ec015a320 2024-09-13T16:00:55.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.720+0000 7f4ebf200640 1 -- 172.21.15.107:0/4276001683 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9d3bca4f-e5dc-454d-be9a-e98f963ca7a7", "id": 5} v 0) v1 -- 0x7f4ec00b32e0 con 0x7f4ec015a320 2024-09-13T16:00:55.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.723+0000 7f4eb6a00640 1 -- 172.21.15.107:0/4276001683 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d3bca4f-e5dc-454d-be9a-e98f963ca7a7", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4eb801db30 con 0x7f4ec015a320 2024-09-13T16:00:55.725 INFO:teuthology.orchestra.run.smithi107.stdout:5 2024-09-13T16:00:55.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.724+0000 7f4ebf200640 1 -- 172.21.15.107:0/4276001683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ec015a320 msgr2=0x7f4ec00c7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.724+0000 7f4ebf200640 1 --2- 172.21.15.107:0/4276001683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ec015a320 0x7f4ec00c7220 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4eb800eed0 tx=0x7f4eb800b480 comp rx=0 tx=0).stop 2024-09-13T16:00:55.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.724+0000 7f4ebf200640 1 -- 172.21.15.107:0/4276001683 shutdown_connections 2024-09-13T16:00:55.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.724+0000 7f4ebf200640 1 --2- 172.21.15.107:0/4276001683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ec015a320 0x7f4ec00c7220 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.724+0000 7f4ebf200640 1 --2- 172.21.15.107:0/4276001683 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ec00cdb30 0x7f4ec00c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.724+0000 7f4ebf200640 1 --2- 172.21.15.107:0/4276001683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec00b2b80 0x7f4ec00af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.725+0000 7f4ebf200640 1 -- 172.21.15.107:0/4276001683 >> 172.21.15.107:0/4276001683 conn(0x7f4ec0069ed0 msgr2=0x7f4ec015aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:55.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.725+0000 7f4ebf200640 1 -- 172.21.15.107:0/4276001683 shutdown_connections 2024-09-13T16:00:55.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.725+0000 7f4ebf200640 1 -- 172.21.15.107:0/4276001683 wait complete. 2024-09-13T16:00:55.740 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new d48b87d8-4488-4713-952b-26d2fe528433 6 2024-09-13T16:00:55.767 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:55.767+0000 7f01f8723040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T16:00:55.827 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:55.826+0000 7f01f8723040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T16:00:55.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.890+0000 7fca00a00640 1 Processor -- start 2024-09-13T16:00:55.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.891+0000 7fca00a00640 1 -- start start 2024-09-13T16:00:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.892+0000 7fca00a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc9fc0d22a0 0x7fc9fc0d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.892+0000 7fca00a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9fc0ccf20 0x7fc9fc0cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.892+0000 7fca00a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9fc0d06e0 con 0x7fc9fc15ca40 2024-09-13T16:00:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.892+0000 7fca00a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9fc0b1ce0 con 0x7fc9fc0d22a0 2024-09-13T16:00:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.892+0000 7fca00a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc0cd910 con 0x7fc9fc0ccf20 2024-09-13T16:00:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.892+0000 7fc9f9e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc9fc0d22a0 0x7fc9fc0d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.892+0000 7fc9fb200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9fc0ccf20 0x7fc9fc0cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.892+0000 7fc9f9e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc9fc0d22a0 0x7fc9fc0d1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36674/0 (socket says 172.21.15.107:36674) 2024-09-13T16:00:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.892+0000 7fc9f9e00640 1 -- 172.21.15.107:0/1273030542 learned_addr learned my addr 172.21.15.107:0/1273030542 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-13T16:00:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.892+0000 7fc9fb200640 1 -- 172.21.15.107:0/1273030542 >> v2:172.21.15.107:3300/0 conn(0x7fc9fc0d22a0 msgr2=0x7fc9fc0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:55.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.892+0000 7fc9fb200640 1 --2- 172.21.15.107:0/1273030542 >> v2:172.21.15.107:3300/0 conn(0x7fc9fc0d22a0 0x7fc9fc0d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.892+0000 7fc9fb200640 1 -- 172.21.15.107:0/1273030542 >> v1:172.21.15.107:6789/0 conn(0x7fc9fc15ca40 legacy=0x7fc9fc0d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.892+0000 7fc9fb200640 1 -- 172.21.15.107:0/1273030542 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc0cdb30 con 0x7fc9fc0ccf20 2024-09-13T16:00:55.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.892+0000 7fc9f9e00640 1 --2- 172.21.15.107:0/1273030542 >> v2:172.21.15.107:3300/0 conn(0x7fc9fc0d22a0 0x7fc9fc0d1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:00:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.893+0000 7fc9fb200640 1 --2- 172.21.15.107:0/1273030542 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9fc0ccf20 0x7fc9fc0cd3d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4009d90 tx=0x7fc9f402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50ae511105e07b45 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.894+0000 7fc9f9400640 1 -- 172.21.15.107:0/1273030542 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4031600 con 0x7fc9fc0ccf20 2024-09-13T16:00:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.894+0000 7fc9f9400640 1 -- 172.21.15.107:0/1273030542 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f402d050 con 0x7fc9fc0ccf20 2024-09-13T16:00:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.894+0000 7fc9f9400640 1 -- 172.21.15.107:0/1273030542 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4031980 con 0x7fc9fc0ccf20 2024-09-13T16:00:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.894+0000 7fca00a00640 1 -- 172.21.15.107:0/1273030542 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9fc0ccf20 msgr2=0x7fc9fc0cd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.894+0000 7fca00a00640 1 --2- 172.21.15.107:0/1273030542 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9fc0ccf20 0x7fc9fc0cd3d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4009d90 tx=0x7fc9f402a5d0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.894+0000 7fca00a00640 1 -- 172.21.15.107:0/1273030542 shutdown_connections 2024-09-13T16:00:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.894+0000 7fca00a00640 1 --2- 172.21.15.107:0/1273030542 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9fc0ccf20 0x7fc9fc0cd3d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.894+0000 7fca00a00640 1 --2- 172.21.15.107:0/1273030542 >> v2:172.21.15.107:3300/0 conn(0x7fc9fc0d22a0 0x7fc9fc0d1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.894+0000 7fca00a00640 1 -- 172.21.15.107:0/1273030542 >> 172.21.15.107:0/1273030542 conn(0x7fc9fc0cf560 msgr2=0x7fc9fc0cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.894+0000 7fca00a00640 1 -- 172.21.15.107:0/1273030542 shutdown_connections 2024-09-13T16:00:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.894+0000 7fca00a00640 1 -- 172.21.15.107:0/1273030542 wait complete. 2024-09-13T16:00:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.896+0000 7fca00a00640 1 Processor -- start 2024-09-13T16:00:55.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.896+0000 7fca00a00640 1 -- start start 2024-09-13T16:00:55.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.897+0000 7fca00a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9fc0ccf20 0x7fc9fc158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.897+0000 7fca00a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9fc0d22a0 0x7fc9fc0abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.897+0000 7fca00a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9fc15ca40 0x7fc9fc0ac370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.897+0000 7fca00a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc1f2ac0 con 0x7fc9fc0d22a0 2024-09-13T16:00:55.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.897+0000 7fca00a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc1f2ee0 con 0x7fc9fc15ca40 2024-09-13T16:00:55.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.897+0000 7fca00a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc1f2120 con 0x7fc9fc0ccf20 2024-09-13T16:00:55.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.897+0000 7fc9fb200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9fc15ca40 0x7fc9fc0ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.897+0000 7fc9fa800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9fc0ccf20 0x7fc9fc158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.897+0000 7fc9fb200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9fc15ca40 0x7fc9fc0ac370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36686/0 (socket says 172.21.15.107:36686) 2024-09-13T16:00:55.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.897+0000 7fc9fb200640 1 -- 172.21.15.107:0/2879382886 learned_addr learned my addr 172.21.15.107:0/2879382886 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-13T16:00:55.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.897+0000 7fc9f9e00640 1 --2- 172.21.15.107:0/2879382886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9fc0d22a0 0x7fc9fc0abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.898+0000 7fc9fa800640 1 -- 172.21.15.107:0/2879382886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9fc15ca40 msgr2=0x7fc9fc0ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.898+0000 7fc9fa800640 1 --2- 172.21.15.107:0/2879382886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9fc15ca40 0x7fc9fc0ac370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.898+0000 7fc9fa800640 1 -- 172.21.15.107:0/2879382886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9fc0d22a0 msgr2=0x7fc9fc0abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.898+0000 7fc9fa800640 1 --2- 172.21.15.107:0/2879382886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9fc0d22a0 0x7fc9fc0abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.898+0000 7fc9fa800640 1 -- 172.21.15.107:0/2879382886 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e80094d0 con 0x7fc9fc0ccf20 2024-09-13T16:00:55.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.898+0000 7fc9fb200640 1 --2- 172.21.15.107:0/2879382886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9fc15ca40 0x7fc9fc0ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:00:55.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.898+0000 7fc9f9e00640 1 --2- 172.21.15.107:0/2879382886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9fc0d22a0 0x7fc9fc0abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:00:55.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.898+0000 7fc9fa800640 1 --2- 172.21.15.107:0/2879382886 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9fc0ccf20 0x7fc9fc158770 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00c390 tx=0x7fc9ec00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:55.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.898+0000 7fc9f2a00640 1 -- 172.21.15.107:0/2879382886 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0052d0 con 0x7fc9fc0ccf20 2024-09-13T16:00:55.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.898+0000 7fc9f2a00640 1 -- 172.21.15.107:0/2879382886 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ec005430 con 0x7fc9fc0ccf20 2024-09-13T16:00:55.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.898+0000 7fc9f2a00640 1 -- 172.21.15.107:0/2879382886 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec003830 con 0x7fc9fc0ccf20 2024-09-13T16:00:55.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.898+0000 7fca00a00640 1 -- 172.21.15.107:0/2879382886 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f4009a70 con 0x7fc9fc0ccf20 2024-09-13T16:00:55.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.898+0000 7fca00a00640 1 -- 172.21.15.107:0/2879382886 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9fc1f26e0 con 0x7fc9fc0ccf20 2024-09-13T16:00:55.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.898+0000 7fc9f2a00640 1 -- 172.21.15.107:0/2879382886 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc9ec003c90 con 0x7fc9fc0ccf20 2024-09-13T16:00:55.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.898+0000 7fc9f2a00640 1 -- 172.21.15.107:0/2879382886 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fc9ec011e00 con 0x7fc9fc0ccf20 2024-09-13T16:00:55.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.899+0000 7fca00a00640 1 -- 172.21.15.107:0/2879382886 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9fc0cd3d0 con 0x7fc9fc0ccf20 2024-09-13T16:00:55.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.902+0000 7fc9f2a00640 1 -- 172.21.15.107:0/2879382886 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fc9ec017070 con 0x7fc9fc0ccf20 2024-09-13T16:00:55.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.972+0000 7fca00a00640 1 -- 172.21.15.107:0/2879382886 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d48b87d8-4488-4713-952b-26d2fe528433", "id": 6} v 0) v1 -- 0x7fc9fc0b8640 con 0x7fc9fc0ccf20 2024-09-13T16:00:55.977 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.976+0000 7fc9f2a00640 1 -- 172.21.15.107:0/2879382886 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d48b87d8-4488-4713-952b-26d2fe528433", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc9ec011590 con 0x7fc9fc0ccf20 2024-09-13T16:00:55.977 INFO:teuthology.orchestra.run.smithi107.stdout:6 2024-09-13T16:00:55.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.977+0000 7fca00a00640 1 -- 172.21.15.107:0/2879382886 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9fc0ccf20 msgr2=0x7fc9fc158770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.977+0000 7fca00a00640 1 --2- 172.21.15.107:0/2879382886 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9fc0ccf20 0x7fc9fc158770 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00c390 tx=0x7fc9ec00c850 comp rx=0 tx=0).stop 2024-09-13T16:00:55.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.977+0000 7fca00a00640 1 -- 172.21.15.107:0/2879382886 shutdown_connections 2024-09-13T16:00:55.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.977+0000 7fca00a00640 1 --2- 172.21.15.107:0/2879382886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9fc15ca40 0x7fc9fc0ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.977+0000 7fca00a00640 1 --2- 172.21.15.107:0/2879382886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9fc0d22a0 0x7fc9fc0abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.977+0000 7fca00a00640 1 --2- 172.21.15.107:0/2879382886 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc9fc0ccf20 0x7fc9fc158770 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.977+0000 7fca00a00640 1 -- 172.21.15.107:0/2879382886 >> 172.21.15.107:0/2879382886 conn(0x7fc9fc0cf560 msgr2=0x7fc9fc0b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:55.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.977+0000 7fca00a00640 1 -- 172.21.15.107:0/2879382886 shutdown_connections 2024-09-13T16:00:55.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:55.977+0000 7fca00a00640 1 -- 172.21.15.107:0/2879382886 wait complete. 2024-09-13T16:00:55.993 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 97f8a857-5960-41a4-851f-c018456211e7 7 2024-09-13T16:00:56.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.140+0000 7f6b41000640 1 Processor -- start 2024-09-13T16:00:56.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.140+0000 7f6b41000640 1 -- start start 2024-09-13T16:00:56.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.141+0000 7f6b41000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b3c156f60 0x7f6b3c15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:56.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.141+0000 7f6b41000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6b3c0cafa0 0x7f6b3c070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:56.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.141+0000 7f6b41000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3c06f5f0 con 0x7f6b3c0714c0 2024-09-13T16:00:56.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.141+0000 7f6b41000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3c15aa30 con 0x7f6b3c0cafa0 2024-09-13T16:00:56.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.142+0000 7f6b41000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c071930 con 0x7f6b3c156f60 2024-09-13T16:00:56.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.142+0000 7f6b39e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b3c156f60 0x7f6b3c15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:56.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.142+0000 7f6b39e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b3c156f60 0x7f6b3c15a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:57636/0 (socket says 172.21.15.107:57636) 2024-09-13T16:00:56.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.142+0000 7f6b39e00640 1 -- 172.21.15.107:0/2943748923 learned_addr learned my addr 172.21.15.107:0/2943748923 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-13T16:00:56.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.142+0000 7f6b3a800640 1 --1- 172.21.15.107:0/2943748923 >> v1:172.21.15.107:6789/0 conn(0x7f6b3c0714c0 0x7f6b3c15d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:51582/0 (socket says 172.21.15.107:51582) 2024-09-13T16:00:56.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.142+0000 7f6b33e00640 1 --2- 172.21.15.107:0/2943748923 >> v2:172.21.15.107:3300/0 conn(0x7f6b3c0cafa0 0x7f6b3c070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:56.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.142+0000 7f6b39e00640 1 -- 172.21.15.107:0/2943748923 >> v2:172.21.15.107:3300/0 conn(0x7f6b3c0cafa0 msgr2=0x7f6b3c070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:56.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.142+0000 7f6b39e00640 1 --2- 172.21.15.107:0/2943748923 >> v2:172.21.15.107:3300/0 conn(0x7f6b3c0cafa0 0x7f6b3c070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:56.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.142+0000 7f6b39e00640 1 -- 172.21.15.107:0/2943748923 >> v1:172.21.15.107:6789/0 conn(0x7f6b3c0714c0 legacy=0x7f6b3c15d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:56.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.142+0000 7f6b39e00640 1 -- 172.21.15.107:0/2943748923 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c070450 con 0x7f6b3c156f60 2024-09-13T16:00:56.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.142+0000 7f6b33e00640 1 --2- 172.21.15.107:0/2943748923 >> v2:172.21.15.107:3300/0 conn(0x7f6b3c0cafa0 0x7f6b3c070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:00:56.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.143+0000 7f6b39e00640 1 --2- 172.21.15.107:0/2943748923 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b3c156f60 0x7f6b3c15a4f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009870 tx=0x7f6b2c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=526d7f005ba552cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:56.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.144+0000 7f6b39400640 1 -- 172.21.15.107:0/2943748923 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c032440 con 0x7f6b3c156f60 2024-09-13T16:00:56.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.144+0000 7f6b39400640 1 -- 172.21.15.107:0/2943748923 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c0325a0 con 0x7f6b3c156f60 2024-09-13T16:00:56.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.144+0000 7f6b39400640 1 -- 172.21.15.107:0/2943748923 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c032930 con 0x7f6b3c156f60 2024-09-13T16:00:56.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.144+0000 7f6b41000640 1 -- 172.21.15.107:0/2943748923 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b3c156f60 msgr2=0x7f6b3c15a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:56.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.144+0000 7f6b41000640 1 --2- 172.21.15.107:0/2943748923 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b3c156f60 0x7f6b3c15a4f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009870 tx=0x7f6b2c02a250 comp rx=0 tx=0).stop 2024-09-13T16:00:56.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.144+0000 7f6b41000640 1 -- 172.21.15.107:0/2943748923 shutdown_connections 2024-09-13T16:00:56.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.144+0000 7f6b41000640 1 --2- 172.21.15.107:0/2943748923 >> v2:172.21.15.107:3300/0 conn(0x7f6b3c0cafa0 0x7f6b3c070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:56.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.144+0000 7f6b41000640 1 --2- 172.21.15.107:0/2943748923 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b3c156f60 0x7f6b3c15a4f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:56.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.144+0000 7f6b41000640 1 -- 172.21.15.107:0/2943748923 >> 172.21.15.107:0/2943748923 conn(0x7f6b3c0b0580 msgr2=0x7f6b3c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:56.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.144+0000 7f6b41000640 1 -- 172.21.15.107:0/2943748923 shutdown_connections 2024-09-13T16:00:56.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.145+0000 7f6b41000640 1 -- 172.21.15.107:0/2943748923 wait complete. 2024-09-13T16:00:56.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.146+0000 7f6b41000640 1 Processor -- start 2024-09-13T16:00:56.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.146+0000 7f6b41000640 1 -- start start 2024-09-13T16:00:56.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.147+0000 7f6b41000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b3c0714c0 0x7f6b3c153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:56.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.147+0000 7f6b41000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b3c0cafa0 0x7f6b3c0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:56.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.147+0000 7f6b41000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b3c156f60 0x7f6b3c155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:56.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.147+0000 7f6b41000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c1513d0 con 0x7f6b3c156f60 2024-09-13T16:00:56.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.147+0000 7f6b41000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c153480 con 0x7f6b3c0714c0 2024-09-13T16:00:56.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.147+0000 7f6b41000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c150750 con 0x7f6b3c0cafa0 2024-09-13T16:00:56.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.147+0000 7f6b33e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b3c0cafa0 0x7f6b3c0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:56.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.147+0000 7f6b33e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b3c0cafa0 0x7f6b3c0c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:57642/0 (socket says 172.21.15.107:57642) 2024-09-13T16:00:56.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.147+0000 7f6b33e00640 1 -- 172.21.15.107:0/2438381366 learned_addr learned my addr 172.21.15.107:0/2438381366 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-13T16:00:56.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.147+0000 7f6b39e00640 1 --2- 172.21.15.107:0/2438381366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b3c0714c0 0x7f6b3c153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:56.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.148+0000 7f6b3a800640 1 --2- 172.21.15.107:0/2438381366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b3c156f60 0x7f6b3c155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:56.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.148+0000 7f6b33e00640 1 -- 172.21.15.107:0/2438381366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b3c0714c0 msgr2=0x7f6b3c153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:56.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.148+0000 7f6b33e00640 1 --2- 172.21.15.107:0/2438381366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b3c0714c0 0x7f6b3c153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:56.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.148+0000 7f6b33e00640 1 -- 172.21.15.107:0/2438381366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b3c156f60 msgr2=0x7f6b3c155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:56.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.148+0000 7f6b33e00640 1 --2- 172.21.15.107:0/2438381366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b3c156f60 0x7f6b3c155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:56.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.148+0000 7f6b33e00640 1 -- 172.21.15.107:0/2438381366 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b24009400 con 0x7f6b3c0cafa0 2024-09-13T16:00:56.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.148+0000 7f6b33e00640 1 --2- 172.21.15.107:0/2438381366 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b3c0cafa0 0x7f6b3c0c9e80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6b2400e980 tx=0x7f6b2400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:56.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.148+0000 7f6b32000640 1 -- 172.21.15.107:0/2438381366 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2400ca00 con 0x7f6b3c0cafa0 2024-09-13T16:00:56.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.148+0000 7f6b32000640 1 -- 172.21.15.107:0/2438381366 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2400cb60 con 0x7f6b3c0cafa0 2024-09-13T16:00:56.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.148+0000 7f6b32000640 1 -- 172.21.15.107:0/2438381366 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b24013470 con 0x7f6b3c0cafa0 2024-09-13T16:00:56.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.149+0000 7f6b41000640 1 -- 172.21.15.107:0/2438381366 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2c0094d0 con 0x7f6b3c0cafa0 2024-09-13T16:00:56.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.149+0000 7f6b41000640 1 -- 172.21.15.107:0/2438381366 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3c150d10 con 0x7f6b3c0cafa0 2024-09-13T16:00:56.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.149+0000 7f6b32000640 1 -- 172.21.15.107:0/2438381366 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6b24004320 con 0x7f6b3c0cafa0 2024-09-13T16:00:56.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.149+0000 7f6b32000640 1 -- 172.21.15.107:0/2438381366 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6b24006260 con 0x7f6b3c0cafa0 2024-09-13T16:00:56.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.150+0000 7f6b41000640 1 -- 172.21.15.107:0/2438381366 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b3c06fb00 con 0x7f6b3c0cafa0 2024-09-13T16:00:56.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.152+0000 7f6b32000640 1 -- 172.21.15.107:0/2438381366 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f6b3c06fb00 con 0x7f6b3c0cafa0 2024-09-13T16:00:56.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.223+0000 7f6b41000640 1 -- 172.21.15.107:0/2438381366 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd new", "uuid": "97f8a857-5960-41a4-851f-c018456211e7", "id": 7} v 0) v1 -- 0x7f6b3c070970 con 0x7f6b3c0cafa0 2024-09-13T16:00:56.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.227+0000 7f6b32000640 1 -- 172.21.15.107:0/2438381366 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "97f8a857-5960-41a4-851f-c018456211e7", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6b24021060 con 0x7f6b3c0cafa0 2024-09-13T16:00:56.228 INFO:teuthology.orchestra.run.smithi107.stdout:7 2024-09-13T16:00:56.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.228+0000 7f6b41000640 1 -- 172.21.15.107:0/2438381366 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b3c0cafa0 msgr2=0x7f6b3c0c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:56.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.228+0000 7f6b41000640 1 --2- 172.21.15.107:0/2438381366 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b3c0cafa0 0x7f6b3c0c9e80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6b2400e980 tx=0x7f6b2400ee40 comp rx=0 tx=0).stop 2024-09-13T16:00:56.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.228+0000 7f6b41000640 1 -- 172.21.15.107:0/2438381366 shutdown_connections 2024-09-13T16:00:56.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.228+0000 7f6b41000640 1 --2- 172.21.15.107:0/2438381366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b3c156f60 0x7f6b3c155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:56.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.228+0000 7f6b41000640 1 --2- 172.21.15.107:0/2438381366 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b3c0cafa0 0x7f6b3c0c9e80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:56.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.228+0000 7f6b41000640 1 --2- 172.21.15.107:0/2438381366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b3c0714c0 0x7f6b3c153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:56.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.228+0000 7f6b41000640 1 -- 172.21.15.107:0/2438381366 >> 172.21.15.107:0/2438381366 conn(0x7f6b3c0b0580 msgr2=0x7f6b3c151e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:56.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.228+0000 7f6b41000640 1 -- 172.21.15.107:0/2438381366 shutdown_connections 2024-09-13T16:00:56.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-13T16:00:56.228+0000 7f6b41000640 1 -- 172.21.15.107:0/2438381366 wait complete. 2024-09-13T16:00:56.243 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T16:00:56.244 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T16:00:56.247 INFO:tasks.ceph.osd.0:Started 2024-09-13T16:00:56.248 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T16:00:56.248 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T16:00:56.251 INFO:tasks.ceph.osd.1:Started 2024-09-13T16:00:56.252 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T16:00:56.252 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T16:00:56.257 INFO:tasks.ceph.osd.2:Started 2024-09-13T16:00:56.257 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T16:00:56.257 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T16:00:56.262 INFO:tasks.ceph.osd.3:Started 2024-09-13T16:00:56.262 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T16:00:56.262 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T16:00:56.263 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:56.260+0000 7f01f8723040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T16:00:56.267 INFO:tasks.ceph.osd.4:Started 2024-09-13T16:00:56.267 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T16:00:56.267 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T16:00:56.271 INFO:tasks.ceph.osd.5:Started 2024-09-13T16:00:56.271 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T16:00:56.272 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T16:00:56.275 INFO:tasks.ceph.osd.6:Started 2024-09-13T16:00:56.275 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T16:00:56.275 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T16:00:56.281 INFO:tasks.ceph.osd.7:Started 2024-09-13T16:00:56.281 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:00:56.334 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:56.333+0000 7f4a8ac49040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T16:00:56.396 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:56.394+0000 7f01f8723040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T16:00:56.403 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:56.402+0000 7f4a8ac49040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T16:00:56.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.482+0000 7f1533e00640 1 Processor -- start 2024-09-13T16:00:56.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.482+0000 7f1533e00640 1 -- start start 2024-09-13T16:00:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.484+0000 7f1533e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15340acf80 0x7f153415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.484+0000 7f1533e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f15340afe10 0x7f153415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.484+0000 7f1533e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15340b1e00 con 0x7f153415fa70 2024-09-13T16:00:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.484+0000 7f1533e00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f153415dbe0 con 0x7f15340afe10 2024-09-13T16:00:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.484+0000 7f1533e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15340b3230 con 0x7f15340acf80 2024-09-13T16:00:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.484+0000 7f1533400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f15340afe10 0x7f153415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.484+0000 7f1533400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f15340afe10 0x7f153415dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40882/0 (socket says 172.21.15.70:40882) 2024-09-13T16:00:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.484+0000 7f1533400640 1 -- 172.21.15.70:0/2469494346 learned_addr learned my addr 172.21.15.70:0/2469494346 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:00:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.484+0000 7f1532000640 1 --2- 172.21.15.70:0/2469494346 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15340acf80 0x7f153415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:56.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.484+0000 7f1533400640 1 -- 172.21.15.70:0/2469494346 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15340acf80 msgr2=0x7f153415d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:56.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.484+0000 7f1533400640 1 --2- 172.21.15.70:0/2469494346 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15340acf80 0x7f153415d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:56.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.484+0000 7f1533400640 1 -- 172.21.15.70:0/2469494346 >> v1:172.21.15.107:6789/0 conn(0x7f153415fa70 legacy=0x7f15340ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:56.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.484+0000 7f1533400640 1 -- 172.21.15.70:0/2469494346 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15340b1840 con 0x7f15340afe10 2024-09-13T16:00:56.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.485+0000 7f1533400640 1 --2- 172.21.15.70:0/2469494346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15340afe10 0x7f153415dd40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f152c009e50 tx=0x7f152c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0a7f3f3a2a1b86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:56.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.486+0000 7f1531600640 1 -- 172.21.15.70:0/2469494346 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c031600 con 0x7f15340afe10 2024-09-13T16:00:56.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.486+0000 7f1531600640 1 -- 172.21.15.70:0/2469494346 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152c02d050 con 0x7f15340afe10 2024-09-13T16:00:56.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.486+0000 7f1531600640 1 -- 172.21.15.70:0/2469494346 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c031980 con 0x7f15340afe10 2024-09-13T16:00:56.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.486+0000 7f1533e00640 1 -- 172.21.15.70:0/2469494346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15340afe10 msgr2=0x7f153415dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:56.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.486+0000 7f1533e00640 1 --2- 172.21.15.70:0/2469494346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15340afe10 0x7f153415dd40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f152c009e50 tx=0x7f152c02a5f0 comp rx=0 tx=0).stop 2024-09-13T16:00:56.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.486+0000 7f1533e00640 1 -- 172.21.15.70:0/2469494346 shutdown_connections 2024-09-13T16:00:56.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.486+0000 7f1533e00640 1 --2- 172.21.15.70:0/2469494346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15340afe10 0x7f153415dd40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:56.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.486+0000 7f1533e00640 1 --2- 172.21.15.70:0/2469494346 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15340acf80 0x7f153415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:56.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.486+0000 7f1533e00640 1 -- 172.21.15.70:0/2469494346 >> 172.21.15.70:0/2469494346 conn(0x7f15340ae310 msgr2=0x7f15340ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:56.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.486+0000 7f1533e00640 1 -- 172.21.15.70:0/2469494346 shutdown_connections 2024-09-13T16:00:56.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.486+0000 7f1533e00640 1 -- 172.21.15.70:0/2469494346 wait complete. 2024-09-13T16:00:56.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.488+0000 7f1533e00640 1 Processor -- start 2024-09-13T16:00:56.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.488+0000 7f1533e00640 1 -- start start 2024-09-13T16:00:56.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.489+0000 7f1533e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15340acf80 0x7f1534152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:56.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.489+0000 7f1533e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15340afe10 0x7f1534155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:56.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.489+0000 7f1533e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f153415fa70 0x7f1534070400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:56.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.489+0000 7f1533e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153415b4b0 con 0x7f15340afe10 2024-09-13T16:00:56.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.489+0000 7f1533e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153415b790 con 0x7f153415fa70 2024-09-13T16:00:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.489+0000 7f1533e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153415ba70 con 0x7f15340acf80 2024-09-13T16:00:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.489+0000 7f1532000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15340afe10 0x7f1534155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.489+0000 7f1532000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15340afe10 0x7f1534155480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40884/0 (socket says 172.21.15.70:40884) 2024-09-13T16:00:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.489+0000 7f1532000640 1 -- 172.21.15.70:0/3128738128 learned_addr learned my addr 172.21.15.70:0/3128738128 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:00:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.489+0000 7f1532a00640 1 --2- 172.21.15.70:0/3128738128 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15340acf80 0x7f1534152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.489+0000 7f1533400640 1 --2- 172.21.15.70:0/3128738128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f153415fa70 0x7f1534070400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.490+0000 7f1532000640 1 -- 172.21.15.70:0/3128738128 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15340acf80 msgr2=0x7f1534152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.490+0000 7f1532000640 1 --2- 172.21.15.70:0/3128738128 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15340acf80 0x7f1534152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.490+0000 7f1532000640 1 -- 172.21.15.70:0/3128738128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f153415fa70 msgr2=0x7f1534070400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.490+0000 7f1532000640 1 --2- 172.21.15.70:0/3128738128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f153415fa70 0x7f1534070400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.490+0000 7f1532000640 1 -- 172.21.15.70:0/3128738128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c009b30 con 0x7f15340afe10 2024-09-13T16:00:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.490+0000 7f1532000640 1 --2- 172.21.15.70:0/3128738128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15340afe10 0x7f1534155480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f152000e870 tx=0x7f152000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.490+0000 7f152b400640 1 -- 172.21.15.70:0/3128738128 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15200094f0 con 0x7f15340afe10 2024-09-13T16:00:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.490+0000 7f152b400640 1 -- 172.21.15.70:0/3128738128 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152000c940 con 0x7f15340afe10 2024-09-13T16:00:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.490+0000 7f152b400640 1 -- 172.21.15.70:0/3128738128 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152000ccf0 con 0x7f15340afe10 2024-09-13T16:00:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.490+0000 7f1533e00640 1 -- 172.21.15.70:0/3128738128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153415bd50 con 0x7f15340afe10 2024-09-13T16:00:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.490+0000 7f1533e00640 1 -- 172.21.15.70:0/3128738128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1534157240 con 0x7f15340afe10 2024-09-13T16:00:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.491+0000 7f152b400640 1 -- 172.21.15.70:0/3128738128 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f1520005c90 con 0x7f15340afe10 2024-09-13T16:00:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.491+0000 7f152b400640 1 -- 172.21.15.70:0/3128738128 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1520013b40 con 0x7f15340afe10 2024-09-13T16:00:56.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.492+0000 7f1533e00640 1 -- 172.21.15.70:0/3128738128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1534067360 con 0x7f15340afe10 2024-09-13T16:00:56.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.494+0000 7f152b400640 1 -- 172.21.15.70:0/3128738128 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f1520021060 con 0x7f15340afe10 2024-09-13T16:00:56.540 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:56.539+0000 7f01f8723040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:00:56.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.552+0000 7f1533e00640 1 -- 172.21.15.70:0/3128738128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f153415d600 con 0x7f15340afe10 2024-09-13T16:00:56.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.553+0000 7f152b400640 1 -- 172.21.15.70:0/3128738128 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1520017070 con 0x7f15340afe10 2024-09-13T16:00:56.554 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:00:56.554 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":10,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:00:56.225049+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:00:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.554+0000 7f1533e00640 1 -- 172.21.15.70:0/3128738128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15340afe10 msgr2=0x7f1534155480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:56.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.554+0000 7f1533e00640 1 --2- 172.21.15.70:0/3128738128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15340afe10 0x7f1534155480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f152000e870 tx=0x7f152000ed30 comp rx=0 tx=0).stop 2024-09-13T16:00:56.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.554+0000 7f1533e00640 1 -- 172.21.15.70:0/3128738128 shutdown_connections 2024-09-13T16:00:56.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.554+0000 7f1533e00640 1 --2- 172.21.15.70:0/3128738128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f153415fa70 0x7f1534070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:56.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.554+0000 7f1533e00640 1 --2- 172.21.15.70:0/3128738128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15340afe10 0x7f1534155480 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:56.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.554+0000 7f1533e00640 1 --2- 172.21.15.70:0/3128738128 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15340acf80 0x7f1534152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:56.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.554+0000 7f1533e00640 1 -- 172.21.15.70:0/3128738128 >> 172.21.15.70:0/3128738128 conn(0x7f15340ae310 msgr2=0x7f153406b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:56.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.554+0000 7f1533e00640 1 -- 172.21.15.70:0/3128738128 shutdown_connections 2024-09-13T16:00:56.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:00:56.554+0000 7f1533e00640 1 -- 172.21.15.70:0/3128738128 wait complete. 2024-09-13T16:00:56.571 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T16:00:56.571 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T16:00:56.596 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:56.595+0000 7f01f8723040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T16:00:56.722 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:56.721+0000 7f01f8723040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T16:00:56.785 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:56.784+0000 7f01f8723040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T16:00:56.836 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:56.835+0000 7f01f8723040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T16:00:56.845 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:56.844+0000 7f4a8ac49040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T16:00:56.927 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-09-13T16:00:56.926+0000 7fb29a818640 -1 Falling back to public interface 2024-09-13T16:00:56.937 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-13T16:00:56.936+0000 7f58f540d640 -1 Falling back to public interface 2024-09-13T16:00:56.943 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:56.942+0000 7f4a8ac49040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T16:00:56.954 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-13T16:00:56.953+0000 7fa695e1d640 -1 Falling back to public interface 2024-09-13T16:00:56.959 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:56.958+0000 7f01f8723040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T16:00:56.963 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-13T16:00:56.962+0000 7f972761a640 -1 Falling back to public interface 2024-09-13T16:00:56.966 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-09-13T16:00:56.965+0000 7f72069a8640 -1 Falling back to public interface 2024-09-13T16:00:56.966 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-09-13T16:00:56.965+0000 7fd903ddd640 -1 Falling back to public interface 2024-09-13T16:00:56.967 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-13T16:00:56.967+0000 7f0888810640 -1 Falling back to public interface 2024-09-13T16:00:56.969 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-13T16:00:56.969+0000 7f9725c00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6823/0: (98) Address already in use 2024-09-13T16:00:56.971 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-09-13T16:00:56.970+0000 7fb4449b2640 -1 Falling back to public interface 2024-09-13T16:00:57.025 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:57.024+0000 7f01f8723040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T16:00:57.067 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:57.066+0000 7f4a8ac49040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:00:57.083 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:57.082+0000 7f01f8723040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T16:00:57.120 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:57.119+0000 7f4a8ac49040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T16:00:57.160 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:57.158+0000 7f01f8723040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T16:00:57.211 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:57.210+0000 7f01f8723040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T16:00:57.246 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:57.244+0000 7f4a8ac49040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T16:00:57.265 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:57.264+0000 7f01f8723040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T16:00:57.309 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:57.308+0000 7f4a8ac49040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T16:00:57.361 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:57.360+0000 7f4a8ac49040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T16:00:57.378 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T16:00:57.486 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:57.485+0000 7f4a8ac49040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T16:00:57.513 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.511+0000 7fcbdaa00640 1 Processor -- start 2024-09-13T16:00:57.513 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.512+0000 7fcbdaa00640 1 -- start start 2024-09-13T16:00:57.514 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.513+0000 7fcbdaa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd40caa80 0x7fcbd40affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:57.514 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.513+0000 7fcbdaa00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcbd40b0510 0x7fcbd40cc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:57.514 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.513+0000 7fcbdaa00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd40716b0 con 0x7fcbd4143f50 2024-09-13T16:00:57.514 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.513+0000 7fcbdaa00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd40b09c0 con 0x7fcbd40b0510 2024-09-13T16:00:57.514 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.513+0000 7fcbdaa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd4071c60 con 0x7fcbd40caa80 2024-09-13T16:00:57.515 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.513+0000 7fcbda000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcbd40b0510 0x7fcbd40cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:57.515 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.513+0000 7fcbd8c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd40caa80 0x7fcbd40affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:57.515 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.513+0000 7fcbda000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcbd40b0510 0x7fcbd40cc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.70:50258/0 (socket says 172.21.15.70:50258) 2024-09-13T16:00:57.515 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.513+0000 7fcbda000640 1 -- 172.21.15.70:0/2256484125 learned_addr learned my addr 172.21.15.70:0/2256484125 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:00:57.515 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.513+0000 7fcbd9600640 1 --1- 172.21.15.70:0/2256484125 >> v1:172.21.15.107:6789/0 conn(0x7fcbd4143f50 0x7fcbd4070fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:55922/0 (socket says 172.21.15.70:55922) 2024-09-13T16:00:57.516 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.514+0000 7fcbda000640 1 -- 172.21.15.70:0/2256484125 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd40caa80 msgr2=0x7fcbd40affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:57.516 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.514+0000 7fcbda000640 1 --2- 172.21.15.70:0/2256484125 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd40caa80 0x7fcbd40affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:57.516 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.514+0000 7fcbda000640 1 -- 172.21.15.70:0/2256484125 >> v1:172.21.15.107:6789/0 conn(0x7fcbd4143f50 legacy=0x7fcbd4070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:57.516 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.514+0000 7fcbda000640 1 -- 172.21.15.70:0/2256484125 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd4071980 con 0x7fcbd40b0510 2024-09-13T16:00:57.516 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.514+0000 7fcbd8c00640 1 --2- 172.21.15.70:0/2256484125 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd40caa80 0x7fcbd40affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:00:57.516 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.515+0000 7fcbda000640 1 --2- 172.21.15.70:0/2256484125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd40b0510 0x7fcbd40cc000 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009870 tx=0x7fcbcc02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5af775c1eccbb3fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:57.516 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.515+0000 7fcbd3e00640 1 -- 172.21.15.70:0/2256484125 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc032440 con 0x7fcbd40b0510 2024-09-13T16:00:57.516 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.515+0000 7fcbd3e00640 1 -- 172.21.15.70:0/2256484125 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc0325a0 con 0x7fcbd40b0510 2024-09-13T16:00:57.516 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.515+0000 7fcbd3e00640 1 -- 172.21.15.70:0/2256484125 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc032930 con 0x7fcbd40b0510 2024-09-13T16:00:57.517 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.515+0000 7fcbdaa00640 1 -- 172.21.15.70:0/2256484125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd40b0510 msgr2=0x7fcbd40cc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:57.517 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.515+0000 7fcbdaa00640 1 --2- 172.21.15.70:0/2256484125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd40b0510 0x7fcbd40cc000 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009870 tx=0x7fcbcc02a250 comp rx=0 tx=0).stop 2024-09-13T16:00:57.517 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.515+0000 7fcbdaa00640 1 -- 172.21.15.70:0/2256484125 shutdown_connections 2024-09-13T16:00:57.517 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.516+0000 7fcbdaa00640 1 --2- 172.21.15.70:0/2256484125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd40b0510 0x7fcbd40cc000 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:57.517 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.516+0000 7fcbdaa00640 1 --2- 172.21.15.70:0/2256484125 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd40caa80 0x7fcbd40affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:57.518 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.516+0000 7fcbdaa00640 1 -- 172.21.15.70:0/2256484125 >> 172.21.15.70:0/2256484125 conn(0x7fcbd40660e0 msgr2=0x7fcbd406b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:57.518 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.516+0000 7fcbdaa00640 1 -- 172.21.15.70:0/2256484125 shutdown_connections 2024-09-13T16:00:57.518 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.516+0000 7fcbdaa00640 1 -- 172.21.15.70:0/2256484125 wait complete. 2024-09-13T16:00:57.518 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.517+0000 7fcbdaa00640 1 Processor -- start 2024-09-13T16:00:57.518 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.517+0000 7fcbdaa00640 1 -- start start 2024-09-13T16:00:57.519 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.518+0000 7fcbdaa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd40b0510 0x7fcbd413b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:57.520 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.518+0000 7fcbdaa00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd40caa80 0x7fcbd415a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:57.520 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.518+0000 7fcbdaa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd4143f50 0x7fcbd413bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:57.520 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.518+0000 7fcbdaa00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd413ad70 con 0x7fcbd40caa80 2024-09-13T16:00:57.520 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.518+0000 7fcbdaa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd413b6d0 con 0x7fcbd4143f50 2024-09-13T16:00:57.520 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.518+0000 7fcbdaa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd415a650 con 0x7fcbd40b0510 2024-09-13T16:00:57.520 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.519+0000 7fcbd9600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd40b0510 0x7fcbd413b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:57.520 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.519+0000 7fcbd8c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd40caa80 0x7fcbd415a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:57.520 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.519+0000 7fcbd9600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd40b0510 0x7fcbd413b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:39512/0 (socket says 172.21.15.70:39512) 2024-09-13T16:00:57.520 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.519+0000 7fcbda000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd4143f50 0x7fcbd413bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:57.520 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.519+0000 7fcbd9600640 1 -- 172.21.15.70:0/3070306841 learned_addr learned my addr 172.21.15.70:0/3070306841 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:00:57.521 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.519+0000 7fcbd9600640 1 -- 172.21.15.70:0/3070306841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd4143f50 msgr2=0x7fcbd413bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:57.522 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.519+0000 7fcbd9600640 1 --2- 172.21.15.70:0/3070306841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd4143f50 0x7fcbd413bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:57.522 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.519+0000 7fcbd9600640 1 -- 172.21.15.70:0/3070306841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd40caa80 msgr2=0x7fcbd415a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:57.522 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.519+0000 7fcbd9600640 1 --2- 172.21.15.70:0/3070306841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd40caa80 0x7fcbd415a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:57.522 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.519+0000 7fcbd9600640 1 -- 172.21.15.70:0/3070306841 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc0009400 con 0x7fcbd40b0510 2024-09-13T16:00:57.522 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.519+0000 7fcbda000640 1 --2- 172.21.15.70:0/3070306841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd4143f50 0x7fcbd413bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:00:57.522 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.519+0000 7fcbd9600640 1 --2- 172.21.15.70:0/3070306841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd40b0510 0x7fcbd413b190 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcbc800c7a0 tx=0x7fcbc800cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:57.522 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.519+0000 7fcbd1600640 1 -- 172.21.15.70:0/3070306841 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc800a640 con 0x7fcbd40b0510 2024-09-13T16:00:57.522 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.520+0000 7fcbd1600640 1 -- 172.21.15.70:0/3070306841 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc800a7a0 con 0x7fcbd40b0510 2024-09-13T16:00:57.522 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.520+0000 7fcbdaa00640 1 -- 172.21.15.70:0/3070306841 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbcc0094d0 con 0x7fcbd40b0510 2024-09-13T16:00:57.522 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.520+0000 7fcbd1600640 1 -- 172.21.15.70:0/3070306841 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc800ab10 con 0x7fcbd40b0510 2024-09-13T16:00:57.522 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.520+0000 7fcbdaa00640 1 -- 172.21.15.70:0/3070306841 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd40b2810 con 0x7fcbd40b0510 2024-09-13T16:00:57.522 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.520+0000 7fcbd1600640 1 -- 172.21.15.70:0/3070306841 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fcbc8007070 con 0x7fcbd40b0510 2024-09-13T16:00:57.522 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.520+0000 7fcbd1600640 1 -- 172.21.15.70:0/3070306841 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fcbc80079f0 con 0x7fcbd40b0510 2024-09-13T16:00:57.522 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.521+0000 7fcbdaa00640 1 -- 172.21.15.70:0/3070306841 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd4067320 con 0x7fcbd40b0510 2024-09-13T16:00:57.524 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.523+0000 7fcbd1600640 1 -- 172.21.15.70:0/3070306841 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fcbc8021060 con 0x7fcbd40b0510 2024-09-13T16:00:57.547 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:57.546+0000 7f4a8ac49040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T16:00:57.585 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.583+0000 7fcbdaa00640 1 -- 172.21.15.70:0/3070306841 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbd4067e80 con 0x7fcbd40b0510 2024-09-13T16:00:57.585 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.584+0000 7fcbd1600640 1 -- 172.21.15.70:0/3070306841 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fcbc8017070 con 0x7fcbd40b0510 2024-09-13T16:00:57.586 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-13T16:00:57.586 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":10,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:00:56.225049+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:00:57.587 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.585+0000 7fcbdaa00640 1 -- 172.21.15.70:0/3070306841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd40b0510 msgr2=0x7fcbd413b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:57.587 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.585+0000 7fcbdaa00640 1 --2- 172.21.15.70:0/3070306841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd40b0510 0x7fcbd413b190 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcbc800c7a0 tx=0x7fcbc800cc60 comp rx=0 tx=0).stop 2024-09-13T16:00:57.587 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.585+0000 7fcbdaa00640 1 -- 172.21.15.70:0/3070306841 shutdown_connections 2024-09-13T16:00:57.587 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.585+0000 7fcbdaa00640 1 --2- 172.21.15.70:0/3070306841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd4143f50 0x7fcbd413bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:57.587 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.585+0000 7fcbdaa00640 1 --2- 172.21.15.70:0/3070306841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd40caa80 0x7fcbd415a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:57.587 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.585+0000 7fcbdaa00640 1 --2- 172.21.15.70:0/3070306841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcbd40b0510 0x7fcbd413b190 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:57.587 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.585+0000 7fcbdaa00640 1 -- 172.21.15.70:0/3070306841 >> 172.21.15.70:0/3070306841 conn(0x7fcbd40660e0 msgr2=0x7fcbd40ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:57.587 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.586+0000 7fcbdaa00640 1 -- 172.21.15.70:0/3070306841 shutdown_connections 2024-09-13T16:00:57.587 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:00:57.586+0000 7fcbdaa00640 1 -- 172.21.15.70:0/3070306841 wait complete. 2024-09-13T16:00:57.598 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T16:00:57.607 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:57.606+0000 7f4a8ac49040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T16:00:57.683 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:57.682+0000 7f4a8ac49040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T16:00:57.734 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:57.733+0000 7f4a8ac49040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T16:00:57.787 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:57.785+0000 7f4a8ac49040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T16:00:58.004 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:58.003+0000 7f01f8723040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T16:00:58.521 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-13T16:00:58.520+0000 7f4a8ac49040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T16:00:59.024 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:59.023+0000 7f0198e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T16:00:59.025 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-13T16:00:59.024+0000 7f0198e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T16:01:00.444 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-13T16:01:00.443+0000 7f58f540d640 -1 osd.2 0 log_to_monitors true 2024-09-13T16:01:00.488 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-09-13T16:01:00.487+0000 7fb29a818640 -1 osd.4 0 log_to_monitors true 2024-09-13T16:01:00.535 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-13T16:01:00.534+0000 7fa695e1d640 -1 osd.3 0 log_to_monitors true 2024-09-13T16:01:00.583 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-13T16:01:00.582+0000 7f972761a640 -1 osd.1 0 log_to_monitors true 2024-09-13T16:01:00.589 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-13T16:01:00.587+0000 7f0888810640 -1 osd.0 0 log_to_monitors true 2024-09-13T16:01:00.635 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-09-13T16:01:00.634+0000 7f72069a8640 -1 osd.7 0 log_to_monitors true 2024-09-13T16:01:00.841 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-09-13T16:01:00.840+0000 7fd903ddd640 -1 osd.5 0 log_to_monitors true 2024-09-13T16:01:00.858 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-09-13T16:01:00.857+0000 7fb4449b2640 -1 osd.6 0 log_to_monitors true 2024-09-13T16:01:04.050 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-13T16:01:04.048+0000 7f58ef200640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T16:01:04.063 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-13T16:01:04.062+0000 7f58e5c00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:01:04.066 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-13T16:01:04.064+0000 7fa68fe00640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T16:01:04.073 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-13T16:01:04.071+0000 7fa686800640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:01:04.076 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-13T16:01:04.074+0000 7f9721600640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T16:01:04.093 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-13T16:01:04.091+0000 7f9718000640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:01:04.100 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-13T16:01:04.098+0000 7f0882600640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T16:01:04.110 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-13T16:01:04.108+0000 7f0879000640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:01:04.406 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:04.541 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.539+0000 7f7d16e00640 1 Processor -- start 2024-09-13T16:01:04.541 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.539+0000 7f7d16e00640 1 -- start start 2024-09-13T16:01:04.542 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.540+0000 7f7d16e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d10159410 0x7f7d100cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:04.542 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.540+0000 7f7d16e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7d1015db50 0x7f7d100b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:04.542 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.540+0000 7f7d16e00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d100ae160 con 0x7f7d1015cfe0 2024-09-13T16:01:04.542 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.540+0000 7f7d16e00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d100cb220 con 0x7f7d1015db50 2024-09-13T16:01:04.542 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.540+0000 7f7d16e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d100adec0 con 0x7f7d10159410 2024-09-13T16:01:04.542 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.540+0000 7f7d14e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7d1015db50 0x7f7d100b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:04.542 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.540+0000 7f7d0f400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f7d1015cfe0 0x7f7d1015d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:37848/0 (socket says 172.21.15.70:37848) 2024-09-13T16:01:04.543 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.540+0000 7f7d0f400640 1 -- 172.21.15.70:0/1814624168 learned_addr learned my addr 172.21.15.70:0/1814624168 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:04.543 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.540+0000 7f7d0fe00640 1 --2- 172.21.15.70:0/1814624168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d10159410 0x7f7d100cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:04.543 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.541+0000 7f7d14e00640 1 -- 172.21.15.70:0/1814624168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d10159410 msgr2=0x7f7d100cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:04.543 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.541+0000 7f7d14e00640 1 --2- 172.21.15.70:0/1814624168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d10159410 0x7f7d100cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:04.543 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.541+0000 7f7d14e00640 1 -- 172.21.15.70:0/1814624168 >> v1:172.21.15.70:6789/0 conn(0x7f7d1015cfe0 legacy=0x7f7d1015d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:04.543 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.541+0000 7f7d14e00640 1 -- 172.21.15.70:0/1814624168 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d100b17d0 con 0x7f7d1015db50 2024-09-13T16:01:04.545 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.542+0000 7f7d14e00640 1 --2- 172.21.15.70:0/1814624168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d1015db50 0x7f7d100b22b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009d90 tx=0x7f7d0802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35639ad96769fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:04.545 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.542+0000 7f7d0ea00640 1 -- 172.21.15.70:0/1814624168 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08031600 con 0x7f7d1015db50 2024-09-13T16:01:04.545 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.542+0000 7f7d0ea00640 1 -- 172.21.15.70:0/1814624168 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0802d050 con 0x7f7d1015db50 2024-09-13T16:01:04.545 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.542+0000 7f7d0ea00640 1 -- 172.21.15.70:0/1814624168 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08031980 con 0x7f7d1015db50 2024-09-13T16:01:04.545 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.542+0000 7f7d16e00640 1 -- 172.21.15.70:0/1814624168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d1015db50 msgr2=0x7f7d100b22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:04.545 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.542+0000 7f7d16e00640 1 --2- 172.21.15.70:0/1814624168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d1015db50 0x7f7d100b22b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009d90 tx=0x7f7d0802a5d0 comp rx=0 tx=0).stop 2024-09-13T16:01:04.545 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.543+0000 7f7d16e00640 1 -- 172.21.15.70:0/1814624168 shutdown_connections 2024-09-13T16:01:04.545 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.543+0000 7f7d16e00640 1 --2- 172.21.15.70:0/1814624168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d1015db50 0x7f7d100b22b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:04.545 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.543+0000 7f7d16e00640 1 --2- 172.21.15.70:0/1814624168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d10159410 0x7f7d100cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:04.545 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.543+0000 7f7d16e00640 1 -- 172.21.15.70:0/1814624168 >> 172.21.15.70:0/1814624168 conn(0x7f7d10069ed0 msgr2=0x7f7d1006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:04.545 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.543+0000 7f7d16e00640 1 -- 172.21.15.70:0/1814624168 shutdown_connections 2024-09-13T16:01:04.545 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.543+0000 7f7d16e00640 1 -- 172.21.15.70:0/1814624168 wait complete. 2024-09-13T16:01:04.546 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.544+0000 7f7d16e00640 1 Processor -- start 2024-09-13T16:01:04.546 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.544+0000 7f7d16e00640 1 -- start start 2024-09-13T16:01:04.548 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.545+0000 7f7d16e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d10159410 0x7f7d101f2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:04.549 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.545+0000 7f7d16e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d1015cfe0 0x7f7d100ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:04.549 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.545+0000 7f7d16e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d1015db50 0x7f7d100acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:04.549 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.545+0000 7f7d16e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d101f2930 con 0x7f7d1015db50 2024-09-13T16:01:04.549 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.545+0000 7f7d16e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d10152b40 con 0x7f7d1015cfe0 2024-09-13T16:01:04.549 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.545+0000 7f7d16e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d101f63a0 con 0x7f7d10159410 2024-09-13T16:01:04.549 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.545+0000 7f7d14e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d1015db50 0x7f7d100acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:04.549 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.545+0000 7f7d14e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d1015db50 0x7f7d100acdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50038/0 (socket says 172.21.15.70:50038) 2024-09-13T16:01:04.549 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.545+0000 7f7d14e00640 1 -- 172.21.15.70:0/1317102109 learned_addr learned my addr 172.21.15.70:0/1317102109 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:04.549 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.546+0000 7f7d0fe00640 1 --2- 172.21.15.70:0/1317102109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d10159410 0x7f7d101f2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:04.549 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.546+0000 7f7d0f400640 1 --2- 172.21.15.70:0/1317102109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d1015cfe0 0x7f7d100ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:04.550 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.546+0000 7f7d14e00640 1 -- 172.21.15.70:0/1317102109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d10159410 msgr2=0x7f7d101f2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:04.550 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.546+0000 7f7d14e00640 1 --2- 172.21.15.70:0/1317102109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d10159410 0x7f7d101f2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:04.550 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.546+0000 7f7d14e00640 1 -- 172.21.15.70:0/1317102109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d1015cfe0 msgr2=0x7f7d100ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:04.550 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.546+0000 7f7d14e00640 1 --2- 172.21.15.70:0/1317102109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d1015cfe0 0x7f7d100ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:04.550 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.546+0000 7f7d14e00640 1 -- 172.21.15.70:0/1317102109 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d08009a70 con 0x7f7d1015db50 2024-09-13T16:01:04.550 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.546+0000 7f7d14e00640 1 --2- 172.21.15.70:0/1317102109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d1015db50 0x7f7d100acdb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009eb0 tx=0x7f7d08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:04.550 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.546+0000 7f7d07e00640 1 -- 172.21.15.70:0/1317102109 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0803b820 con 0x7f7d1015db50 2024-09-13T16:01:04.550 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.546+0000 7f7d07e00640 1 -- 172.21.15.70:0/1317102109 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0803b980 con 0x7f7d1015db50 2024-09-13T16:01:04.550 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.546+0000 7f7d07e00640 1 -- 172.21.15.70:0/1317102109 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0803bcf0 con 0x7f7d1015db50 2024-09-13T16:01:04.550 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.546+0000 7f7d16e00640 1 -- 172.21.15.70:0/1317102109 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d101f6680 con 0x7f7d1015db50 2024-09-13T16:01:04.550 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.547+0000 7f7d16e00640 1 -- 172.21.15.70:0/1317102109 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d101f25c0 con 0x7f7d1015db50 2024-09-13T16:01:04.551 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.548+0000 7f7d16e00640 1 -- 172.21.15.70:0/1317102109 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d101f2780 con 0x7f7d1015db50 2024-09-13T16:01:04.551 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.548+0000 7f7d07e00640 1 -- 172.21.15.70:0/1317102109 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f7d0803a3a0 con 0x7f7d1015db50 2024-09-13T16:01:04.551 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.549+0000 7f7d07e00640 1 --2- 172.21.15.70:0/1317102109 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7cf006ab70 0x7f7cf006d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:04.552 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.549+0000 7f7d07e00640 1 -- 172.21.15.70:0/1317102109 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f7d080a9a30 con 0x7f7d1015db50 2024-09-13T16:01:04.552 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.550+0000 7f7d0fe00640 1 --2- 172.21.15.70:0/1317102109 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7cf006ab70 0x7f7cf006d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:04.552 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.550+0000 7f7d0fe00640 1 --2- 172.21.15.70:0/1317102109 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7cf006ab70 0x7f7cf006d030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7d00006fd0 tx=0x7f7d00008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:04.556 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.554+0000 7f7d07e00640 1 -- 172.21.15.70:0/1317102109 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7d08075b20 con 0x7f7d1015db50 2024-09-13T16:01:04.698 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-09-13T16:01:04.696+0000 7fb43ee00640 -1 osd.6 0 waiting for initial osdmap 2024-09-13T16:01:04.710 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-09-13T16:01:04.707+0000 7fb435800640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:01:04.715 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-09-13T16:01:04.713+0000 7fd8fe200640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T16:01:04.727 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.725+0000 7f7d16e00640 1 -- 172.21.15.70:0/1317102109 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d1006d940 con 0x7f7d1015db50 2024-09-13T16:01:04.727 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-09-13T16:01:04.725+0000 7fb294600640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T16:01:04.728 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.726+0000 7f7d07e00640 1 -- 172.21.15.70:0/1317102109 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7d08049070 con 0x7f7d1015db50 2024-09-13T16:01:04.728 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-13T16:01:04.728 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":12,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:02.397213+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:04.730 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.728+0000 7f7d16e00640 1 -- 172.21.15.70:0/1317102109 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7cf006ab70 msgr2=0x7f7cf006d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:04.730 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.728+0000 7f7d16e00640 1 --2- 172.21.15.70:0/1317102109 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7cf006ab70 0x7f7cf006d030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7d00006fd0 tx=0x7f7d00008040 comp rx=0 tx=0).stop 2024-09-13T16:01:04.730 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.728+0000 7f7d16e00640 1 -- 172.21.15.70:0/1317102109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d1015db50 msgr2=0x7f7d100acdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:04.731 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.728+0000 7f7d16e00640 1 --2- 172.21.15.70:0/1317102109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d1015db50 0x7f7d100acdb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009eb0 tx=0x7f7d08004a40 comp rx=0 tx=0).stop 2024-09-13T16:01:04.731 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.728+0000 7f7d16e00640 1 -- 172.21.15.70:0/1317102109 shutdown_connections 2024-09-13T16:01:04.731 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.728+0000 7f7d16e00640 1 --2- 172.21.15.70:0/1317102109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d1015db50 0x7f7d100acdb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:04.731 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.728+0000 7f7d16e00640 1 --2- 172.21.15.70:0/1317102109 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7cf006ab70 0x7f7cf006d030 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:04.731 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.728+0000 7f7d16e00640 1 --2- 172.21.15.70:0/1317102109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d1015cfe0 0x7f7d100ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:04.731 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.728+0000 7f7d16e00640 1 --2- 172.21.15.70:0/1317102109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d10159410 0x7f7d101f2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:04.731 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.728+0000 7f7d16e00640 1 -- 172.21.15.70:0/1317102109 >> 172.21.15.70:0/1317102109 conn(0x7f7d10069ed0 msgr2=0x7f7d1015d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:04.731 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.728+0000 7f7d16e00640 1 -- 172.21.15.70:0/1317102109 shutdown_connections 2024-09-13T16:01:04.731 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:04.728+0000 7f7d16e00640 1 -- 172.21.15.70:0/1317102109 wait complete. 2024-09-13T16:01:04.734 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-09-13T16:01:04.732+0000 7fd8f4c00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:01:04.737 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-09-13T16:01:04.735+0000 7fb28b000640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:01:04.743 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T16:01:04.791 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-09-13T16:01:04.788+0000 7f7200e00640 -1 osd.7 0 waiting for initial osdmap 2024-09-13T16:01:04.797 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-09-13T16:01:04.795+0000 7f71f7800640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:01:11.550 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:11.693 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.691+0000 7f2022600640 1 Processor -- start 2024-09-13T16:01:11.693 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.691+0000 7f2022600640 1 -- start start 2024-09-13T16:01:11.694 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.692+0000 7f2022600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f201c0cd670 0x7f201c0affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.694 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.692+0000 7f2022600640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f201c0adaa0 0x7f201c0b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.694 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.692+0000 7f2022600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201c0cc5d0 con 0x7f201c145e70 2024-09-13T16:01:11.694 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.692+0000 7f2022600640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201c0cc8b0 con 0x7f201c0adaa0 2024-09-13T16:01:11.694 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.692+0000 7f2022600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201c0ccb90 con 0x7f201c0cd670 2024-09-13T16:01:11.695 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.692+0000 7f2021c00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f201c0adaa0 0x7f201c0b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.695 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.692+0000 7f2021c00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f201c0adaa0 0x7f201c0b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39962/0 (socket says 172.21.15.70:39962) 2024-09-13T16:01:11.695 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.692+0000 7f2021c00640 1 -- 172.21.15.70:0/279922209 learned_addr learned my addr 172.21.15.70:0/279922209 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:11.695 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.693+0000 7f2013e00640 1 --2- 172.21.15.70:0/279922209 >> v2:172.21.15.107:3300/0 conn(0x7f201c0cd670 0x7f201c0affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.695 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.693+0000 7f2021c00640 1 -- 172.21.15.70:0/279922209 >> v2:172.21.15.107:3300/0 conn(0x7f201c0cd670 msgr2=0x7f201c0affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:11.695 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.693+0000 7f2021c00640 1 --2- 172.21.15.70:0/279922209 >> v2:172.21.15.107:3300/0 conn(0x7f201c0cd670 0x7f201c0affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.695 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.693+0000 7f2021c00640 1 -- 172.21.15.70:0/279922209 >> v1:172.21.15.107:6789/0 conn(0x7f201c145e70 legacy=0x7f201c0cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:11.695 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.693+0000 7f2021c00640 1 -- 172.21.15.70:0/279922209 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c0cce70 con 0x7f201c0adaa0 2024-09-13T16:01:11.697 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.694+0000 7f2021c00640 1 --2- 172.21.15.70:0/279922209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f201c0adaa0 0x7f201c0b0510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f201c06bfb0 tx=0x7f201402a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87516ee6c94c5879 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:11.697 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.694+0000 7f201be00640 1 -- 172.21.15.70:0/279922209 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2014031600 con 0x7f201c0adaa0 2024-09-13T16:01:11.697 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.694+0000 7f201be00640 1 -- 172.21.15.70:0/279922209 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201402d050 con 0x7f201c0adaa0 2024-09-13T16:01:11.697 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.694+0000 7f201be00640 1 -- 172.21.15.70:0/279922209 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2014031980 con 0x7f201c0adaa0 2024-09-13T16:01:11.697 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.694+0000 7f2022600640 1 -- 172.21.15.70:0/279922209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f201c0adaa0 msgr2=0x7f201c0b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:11.697 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.694+0000 7f2022600640 1 --2- 172.21.15.70:0/279922209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f201c0adaa0 0x7f201c0b0510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f201c06bfb0 tx=0x7f201402a780 comp rx=0 tx=0).stop 2024-09-13T16:01:11.697 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.695+0000 7f2022600640 1 -- 172.21.15.70:0/279922209 shutdown_connections 2024-09-13T16:01:11.697 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.695+0000 7f2022600640 1 --2- 172.21.15.70:0/279922209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f201c0adaa0 0x7f201c0b0510 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.697 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.695+0000 7f2022600640 1 --2- 172.21.15.70:0/279922209 >> v2:172.21.15.107:3300/0 conn(0x7f201c0cd670 0x7f201c0affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.697 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.695+0000 7f2022600640 1 -- 172.21.15.70:0/279922209 >> 172.21.15.70:0/279922209 conn(0x7f201c0660e0 msgr2=0x7f201c06b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:11.698 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.695+0000 7f2022600640 1 -- 172.21.15.70:0/279922209 shutdown_connections 2024-09-13T16:01:11.698 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.695+0000 7f2022600640 1 -- 172.21.15.70:0/279922209 wait complete. 2024-09-13T16:01:11.698 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.696+0000 7f2022600640 1 Processor -- start 2024-09-13T16:01:11.698 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.696+0000 7f2022600640 1 -- start start 2024-09-13T16:01:11.700 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.697+0000 7f2022600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f201c0adaa0 0x7f201c15ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.700 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.697+0000 7f2022600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f201c0cd670 0x7f201c132d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.700 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.697+0000 7f2022600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f201c145e70 0x7f201c1e4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.700 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.697+0000 7f2022600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c1e6ce0 con 0x7f201c0cd670 2024-09-13T16:01:11.700 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.697+0000 7f2022600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c15f9f0 con 0x7f201c145e70 2024-09-13T16:01:11.700 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.697+0000 7f2022600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c133260 con 0x7f201c0adaa0 2024-09-13T16:01:11.700 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.698+0000 7f2013e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f201c0cd670 0x7f201c132d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.701 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.698+0000 7f2013e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f201c0cd670 0x7f201c132d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39970/0 (socket says 172.21.15.70:39970) 2024-09-13T16:01:11.701 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.698+0000 7f2013e00640 1 -- 172.21.15.70:0/3027479046 learned_addr learned my addr 172.21.15.70:0/3027479046 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:11.701 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.698+0000 7f2013e00640 1 -- 172.21.15.70:0/3027479046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f201c0adaa0 msgr2=0x7f201c15ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:11.701 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.698+0000 7f2013e00640 1 --2- 172.21.15.70:0/3027479046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f201c0adaa0 0x7f201c15ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.701 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.698+0000 7f2013e00640 1 -- 172.21.15.70:0/3027479046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f201c145e70 msgr2=0x7f201c1e4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:11.701 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.698+0000 7f2021c00640 1 --2- 172.21.15.70:0/3027479046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f201c145e70 0x7f201c1e4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.701 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.698+0000 7f2013e00640 1 --2- 172.21.15.70:0/3027479046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f201c145e70 0x7f201c1e4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.701 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.698+0000 7f2013e00640 1 -- 172.21.15.70:0/3027479046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2014009b30 con 0x7f201c0cd670 2024-09-13T16:01:11.701 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.698+0000 7f2013e00640 1 --2- 172.21.15.70:0/3027479046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f201c0cd670 0x7f201c132d20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f200400d800 tx=0x7f200400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:11.702 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.698+0000 7f2019600640 1 -- 172.21.15.70:0/3027479046 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200400b6c0 con 0x7f201c0cd670 2024-09-13T16:01:11.702 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.698+0000 7f2019600640 1 -- 172.21.15.70:0/3027479046 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200400b820 con 0x7f201c0cd670 2024-09-13T16:01:11.702 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.698+0000 7f2019600640 1 -- 172.21.15.70:0/3027479046 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200400bbb0 con 0x7f201c0cd670 2024-09-13T16:01:11.702 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.698+0000 7f2022600640 1 -- 172.21.15.70:0/3027479046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f201c1463d0 con 0x7f201c0cd670 2024-09-13T16:01:11.702 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.699+0000 7f2022600640 1 -- 172.21.15.70:0/3027479046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201c15f710 con 0x7f201c0cd670 2024-09-13T16:01:11.703 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.700+0000 7f2022600640 1 -- 172.21.15.70:0/3027479046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f201c067320 con 0x7f201c0cd670 2024-09-13T16:01:11.703 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.701+0000 7f2019600640 1 -- 172.21.15.70:0/3027479046 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f200400bd10 con 0x7f201c0cd670 2024-09-13T16:01:11.703 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.701+0000 7f2019600640 1 --2- 172.21.15.70:0/3027479046 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f1ff806ac00 0x7f1ff806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.703 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.701+0000 7f2019600640 1 -- 172.21.15.70:0/3027479046 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2004089650 con 0x7f201c0cd670 2024-09-13T16:01:11.704 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.702+0000 7f2021200640 1 --2- 172.21.15.70:0/3027479046 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f1ff806ac00 0x7f1ff806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.704 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.702+0000 7f2021200640 1 --2- 172.21.15.70:0/3027479046 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f1ff806ac00 0x7f1ff806d0c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f200c006fd0 tx=0x7f200c006bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:11.708 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.706+0000 7f2019600640 1 -- 172.21.15.70:0/3027479046 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2004054ae0 con 0x7f201c0cd670 2024-09-13T16:01:11.879 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.877+0000 7f2022600640 1 -- 172.21.15.70:0/3027479046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f201c0cbcf0 con 0x7f201c0cd670 2024-09-13T16:01:11.880 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.878+0000 7f2019600640 1 -- 172.21.15.70:0/3027479046 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12814 (secure 0 0 0) 0x7f2004058100 con 0x7f201c0cd670 2024-09-13T16:01:11.880 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-13T16:01:11.880 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":16,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:08.075649+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:11.882 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.880+0000 7f2022600640 1 -- 172.21.15.70:0/3027479046 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f1ff806ac00 msgr2=0x7f1ff806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:11.883 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.880+0000 7f2022600640 1 --2- 172.21.15.70:0/3027479046 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f1ff806ac00 0x7f1ff806d0c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f200c006fd0 tx=0x7f200c006bc0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.883 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.880+0000 7f2022600640 1 -- 172.21.15.70:0/3027479046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f201c0cd670 msgr2=0x7f201c132d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:11.883 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.880+0000 7f2022600640 1 --2- 172.21.15.70:0/3027479046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f201c0cd670 0x7f201c132d20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f200400d800 tx=0x7f200400dcc0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.883 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.880+0000 7f2022600640 1 -- 172.21.15.70:0/3027479046 shutdown_connections 2024-09-13T16:01:11.883 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.880+0000 7f2022600640 1 --2- 172.21.15.70:0/3027479046 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f1ff806ac00 0x7f1ff806d0c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.883 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.880+0000 7f2022600640 1 --2- 172.21.15.70:0/3027479046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f201c145e70 0x7f201c1e4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.883 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.880+0000 7f2022600640 1 --2- 172.21.15.70:0/3027479046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f201c0cd670 0x7f201c132d20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.883 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.880+0000 7f2022600640 1 --2- 172.21.15.70:0/3027479046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f201c0adaa0 0x7f201c15ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.883 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.880+0000 7f2022600640 1 -- 172.21.15.70:0/3027479046 >> 172.21.15.70:0/3027479046 conn(0x7f201c0660e0 msgr2=0x7f201c0acfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:11.883 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.880+0000 7f2022600640 1 -- 172.21.15.70:0/3027479046 shutdown_connections 2024-09-13T16:01:11.884 INFO:teuthology.misc.health.smithi070.stderr:2024-09-13T16:01:11.880+0000 7f2022600640 1 -- 172.21.15.70:0/3027479046 wait complete. 2024-09-13T16:01:11.896 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T16:01:11.896 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T16:01:11.896 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T16:01:11.896 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T16:01:11.900 INFO:tasks.ceph.mds.a:Started 2024-09-13T16:01:11.901 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T16:01:11.901 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T16:01:11.904 INFO:tasks.ceph.mds.c:Started 2024-09-13T16:01:11.904 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T16:01:11.905 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T16:01:11.909 INFO:tasks.ceph.mds.b:Started 2024-09-13T16:01:11.909 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T16:01:11.909 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T16:01:11.913 INFO:tasks.ceph.mds.d:Started 2024-09-13T16:01:11.913 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T16:01:11.913 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:12.028 INFO:tasks.ceph.mds.a.smithi070.stdout:starting mds.a at 2024-09-13T16:01:12.031 INFO:tasks.ceph.mds.c.smithi070.stdout:starting mds.c at 2024-09-13T16:01:12.046 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-09-13T16:01:12.047 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-09-13T16:01:12.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.073+0000 7f6c22800640 1 Processor -- start 2024-09-13T16:01:12.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.073+0000 7f6c22800640 1 -- start start 2024-09-13T16:01:12.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.074+0000 7f6c22800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c1c15fdd0 0x7f6c1c0d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:12.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.074+0000 7f6c22800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6c1c0b1c50 0x7f6c1c0d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:12.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.074+0000 7f6c22800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1c1601b0 con 0x7f6c1c1603b0 2024-09-13T16:01:12.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.074+0000 7f6c22800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1c0cd6a0 con 0x7f6c1c0b1c50 2024-09-13T16:01:12.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.074+0000 7f6c22800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c0d17e0 con 0x7f6c1c15fdd0 2024-09-13T16:01:12.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.074+0000 7f6c20a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6c1c0b1c50 0x7f6c1c0d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:12.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.074+0000 7f6c20a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6c1c0b1c50 0x7f6c1c0d1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40012/0 (socket says 172.21.15.70:40012) 2024-09-13T16:01:12.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.074+0000 7f6c20a00640 1 -- 172.21.15.70:0/1320124389 learned_addr learned my addr 172.21.15.70:0/1320124389 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:12.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.074+0000 7f6c21400640 1 --2- 172.21.15.70:0/1320124389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c1c15fdd0 0x7f6c1c0d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:12.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.075+0000 7f6c20a00640 1 -- 172.21.15.70:0/1320124389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c1c15fdd0 msgr2=0x7f6c1c0d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:12.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.075+0000 7f6c20a00640 1 --2- 172.21.15.70:0/1320124389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c1c15fdd0 0x7f6c1c0d1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.075+0000 7f6c20a00640 1 -- 172.21.15.70:0/1320124389 >> v1:172.21.15.107:6789/0 conn(0x7f6c1c1603b0 legacy=0x7f6c1c1607e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:12.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.075+0000 7f6c20a00640 1 -- 172.21.15.70:0/1320124389 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c0cfd50 con 0x7f6c1c0b1c50 2024-09-13T16:01:12.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.076+0000 7f6c20a00640 1 --2- 172.21.15.70:0/1320124389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c1c0b1c50 0x7f6c1c0d1fd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009870 tx=0x7f6c0802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b62fc7091cae7c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:12.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.076+0000 7f6c1be00640 1 -- 172.21.15.70:0/1320124389 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c08032440 con 0x7f6c1c0b1c50 2024-09-13T16:01:12.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.076+0000 7f6c1be00640 1 -- 172.21.15.70:0/1320124389 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c080325a0 con 0x7f6c1c0b1c50 2024-09-13T16:01:12.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.076+0000 7f6c1be00640 1 -- 172.21.15.70:0/1320124389 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c08032930 con 0x7f6c1c0b1c50 2024-09-13T16:01:12.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.076+0000 7f6c22800640 1 -- 172.21.15.70:0/1320124389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c1c0b1c50 msgr2=0x7f6c1c0d1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:12.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.076+0000 7f6c22800640 1 --2- 172.21.15.70:0/1320124389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c1c0b1c50 0x7f6c1c0d1fd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009870 tx=0x7f6c0802a1c0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.076+0000 7f6c22800640 1 -- 172.21.15.70:0/1320124389 shutdown_connections 2024-09-13T16:01:12.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.076+0000 7f6c22800640 1 --2- 172.21.15.70:0/1320124389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c1c0b1c50 0x7f6c1c0d1fd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.076+0000 7f6c22800640 1 --2- 172.21.15.70:0/1320124389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c1c15fdd0 0x7f6c1c0d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.076+0000 7f6c22800640 1 -- 172.21.15.70:0/1320124389 >> 172.21.15.70:0/1320124389 conn(0x7f6c1c06a7c0 msgr2=0x7f6c1c06abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:12.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.077+0000 7f6c22800640 1 -- 172.21.15.70:0/1320124389 shutdown_connections 2024-09-13T16:01:12.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.077+0000 7f6c22800640 1 -- 172.21.15.70:0/1320124389 wait complete. 2024-09-13T16:01:12.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.078+0000 7f6c22800640 1 Processor -- start 2024-09-13T16:01:12.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.078+0000 7f6c22800640 1 -- start start 2024-09-13T16:01:12.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.079+0000 7f6c22800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c1c0b1c50 0x7f6c1c1f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:12.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.079+0000 7f6c22800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c15fdd0 0x7f6c1c15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:12.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.079+0000 7f6c22800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c1c1603b0 0x7f6c1c15bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:12.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.079+0000 7f6c22800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c1f39a0 con 0x7f6c1c1603b0 2024-09-13T16:01:12.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.079+0000 7f6c22800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c1f3370 con 0x7f6c1c15fdd0 2024-09-13T16:01:12.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.079+0000 7f6c22800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c1f3170 con 0x7f6c1c0b1c50 2024-09-13T16:01:12.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.079+0000 7f6c21400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c1c0b1c50 0x7f6c1c1f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:12.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.079+0000 7f6c21400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c1c0b1c50 0x7f6c1c1f2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:58976/0 (socket says 172.21.15.70:58976) 2024-09-13T16:01:12.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.079+0000 7f6c21400640 1 -- 172.21.15.70:0/1523407441 learned_addr learned my addr 172.21.15.70:0/1523407441 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:12.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.079+0000 7f6c21e00640 1 --2- 172.21.15.70:0/1523407441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c1c1603b0 0x7f6c1c15bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:12.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.079+0000 7f6c20a00640 1 --2- 172.21.15.70:0/1523407441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c15fdd0 0x7f6c1c15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.080+0000 7f6c21400640 1 -- 172.21.15.70:0/1523407441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c15fdd0 msgr2=0x7f6c1c15ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.080+0000 7f6c21400640 1 --2- 172.21.15.70:0/1523407441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c15fdd0 0x7f6c1c15ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.080+0000 7f6c21400640 1 -- 172.21.15.70:0/1523407441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c1c1603b0 msgr2=0x7f6c1c15bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.080+0000 7f6c21400640 1 --2- 172.21.15.70:0/1523407441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c1c1603b0 0x7f6c1c15bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.080+0000 7f6c21400640 1 -- 172.21.15.70:0/1523407441 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c080094d0 con 0x7f6c1c0b1c50 2024-09-13T16:01:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.080+0000 7f6c21400640 1 --2- 172.21.15.70:0/1523407441 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c1c0b1c50 0x7f6c1c1f2c30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000e9e0 tx=0x7f6c1000eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.080+0000 7f6c19600640 1 -- 172.21.15.70:0/1523407441 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10009670 con 0x7f6c1c0b1c50 2024-09-13T16:01:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.080+0000 7f6c19600640 1 -- 172.21.15.70:0/1523407441 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1000c9d0 con 0x7f6c1c0b1c50 2024-09-13T16:01:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.080+0000 7f6c22800640 1 -- 172.21.15.70:0/1523407441 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c1c0c9030 con 0x7f6c1c0b1c50 2024-09-13T16:01:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.080+0000 7f6c19600640 1 -- 172.21.15.70:0/1523407441 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000cd80 con 0x7f6c1c0b1c50 2024-09-13T16:01:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.080+0000 7f6c22800640 1 -- 172.21.15.70:0/1523407441 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1c1f35c0 con 0x7f6c1c0b1c50 2024-09-13T16:01:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.081+0000 7f6c22800640 1 -- 172.21.15.70:0/1523407441 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1c1f3c10 con 0x7f6c1c0b1c50 2024-09-13T16:01:12.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.082+0000 7f6c19600640 1 -- 172.21.15.70:0/1523407441 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6c10013470 con 0x7f6c1c0b1c50 2024-09-13T16:01:12.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.083+0000 7f6c19600640 1 --2- 172.21.15.70:0/1523407441 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6bfc06ac00 0x7f6bfc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:12.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.083+0000 7f6c19600640 1 -- 172.21.15.70:0/1523407441 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6c10089210 con 0x7f6c1c0b1c50 2024-09-13T16:01:12.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.083+0000 7f6c20a00640 1 --2- 172.21.15.70:0/1523407441 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6bfc06ac00 0x7f6bfc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:12.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.084+0000 7f6c20a00640 1 --2- 172.21.15.70:0/1523407441 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6bfc06ac00 0x7f6bfc06d0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6c08034000 tx=0x7f6c0802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:12.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.089+0000 7f6c19600640 1 -- 172.21.15.70:0/1523407441 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6c100547e0 con 0x7f6c1c0b1c50 2024-09-13T16:01:12.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.262+0000 7f6c22800640 1 -- 172.21.15.70:0/1523407441 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c1c0b1700 con 0x7f6c1c0b1c50 2024-09-13T16:01:12.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.264+0000 7f6c19600640 1 -- 172.21.15.70:0/1523407441 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12814 (secure 0 0 0) 0x7f6c10057e00 con 0x7f6c1c0b1c50 2024-09-13T16:01:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:12.266 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":16,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:08.075649+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:12.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.266+0000 7f6c22800640 1 -- 172.21.15.70:0/1523407441 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6bfc06ac00 msgr2=0x7f6bfc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:12.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.266+0000 7f6c22800640 1 --2- 172.21.15.70:0/1523407441 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6bfc06ac00 0x7f6bfc06d0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6c08034000 tx=0x7f6c0802e000 comp rx=0 tx=0).stop 2024-09-13T16:01:12.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.266+0000 7f6c22800640 1 -- 172.21.15.70:0/1523407441 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c1c0b1c50 msgr2=0x7f6c1c1f2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:12.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.266+0000 7f6c22800640 1 --2- 172.21.15.70:0/1523407441 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c1c0b1c50 0x7f6c1c1f2c30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000e9e0 tx=0x7f6c1000eea0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.266+0000 7f6c22800640 1 -- 172.21.15.70:0/1523407441 shutdown_connections 2024-09-13T16:01:12.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.266+0000 7f6c22800640 1 --2- 172.21.15.70:0/1523407441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c1c1603b0 0x7f6c1c15bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.266+0000 7f6c22800640 1 --2- 172.21.15.70:0/1523407441 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6bfc06ac00 0x7f6bfc06d0c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.266+0000 7f6c22800640 1 --2- 172.21.15.70:0/1523407441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c15fdd0 0x7f6c1c15ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.266+0000 7f6c22800640 1 --2- 172.21.15.70:0/1523407441 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c1c0b1c50 0x7f6c1c1f2c30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.266+0000 7f6c22800640 1 -- 172.21.15.70:0/1523407441 >> 172.21.15.70:0/1523407441 conn(0x7f6c1c06a7c0 msgr2=0x7f6c1c0d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:12.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.266+0000 7f6c22800640 1 -- 172.21.15.70:0/1523407441 shutdown_connections 2024-09-13T16:01:12.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.266+0000 7f6c22800640 1 -- 172.21.15.70:0/1523407441 wait complete. 2024-09-13T16:01:12.284 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:01:06.070694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:01:12.284 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:01:12.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.437+0000 7fd257000640 1 Processor -- start 2024-09-13T16:01:12.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.437+0000 7fd257000640 1 -- start start 2024-09-13T16:01:12.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.438+0000 7fd257000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd2501461c0 0x7fd2500b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:12.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.438+0000 7fd257000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd25006c5b0 0x7fd250070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:12.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.438+0000 7fd257000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2500b2890 con 0x7fd2500b2fe0 2024-09-13T16:01:12.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.438+0000 7fd257000640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25006ca20 con 0x7fd2501461c0 2024-09-13T16:01:12.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.438+0000 7fd257000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2500b3450 con 0x7fd25006c5b0 2024-09-13T16:01:12.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.439+0000 7fd24fe00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd2501461c0 0x7fd2500b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:12.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.439+0000 7fd24fe00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd2501461c0 0x7fd2500b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40020/0 (socket says 172.21.15.70:40020) 2024-09-13T16:01:12.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.439+0000 7fd24fe00640 1 -- 172.21.15.70:0/1323170677 learned_addr learned my addr 172.21.15.70:0/1323170677 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:12.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.439+0000 7fd255000640 1 --2- 172.21.15.70:0/1323170677 >> v2:172.21.15.107:3300/0 conn(0x7fd25006c5b0 0x7fd250070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:12.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.439+0000 7fd24fe00640 1 -- 172.21.15.70:0/1323170677 >> v2:172.21.15.107:3300/0 conn(0x7fd25006c5b0 msgr2=0x7fd250070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:12.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.439+0000 7fd24fe00640 1 --2- 172.21.15.70:0/1323170677 >> v2:172.21.15.107:3300/0 conn(0x7fd25006c5b0 0x7fd250070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.439+0000 7fd24fe00640 1 -- 172.21.15.70:0/1323170677 >> v1:172.21.15.107:6789/0 conn(0x7fd2500b2fe0 legacy=0x7fd25006bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:12.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.439+0000 7fd24fe00640 1 -- 172.21.15.70:0/1323170677 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2500b1880 con 0x7fd2501461c0 2024-09-13T16:01:12.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.439+0000 7fd255000640 1 --2- 172.21.15.70:0/1323170677 >> v2:172.21.15.107:3300/0 conn(0x7fd25006c5b0 0x7fd250070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:12.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.440+0000 7fd24fe00640 1 --2- 172.21.15.70:0/1323170677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2501461c0 0x7fd2500b2aa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd250161510 tx=0x7fd24002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e974cac3bf88689d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:12.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.440+0000 7fd24f400640 1 -- 172.21.15.70:0/1323170677 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240032440 con 0x7fd2501461c0 2024-09-13T16:01:12.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.440+0000 7fd24f400640 1 -- 172.21.15.70:0/1323170677 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2400325a0 con 0x7fd2501461c0 2024-09-13T16:01:12.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.440+0000 7fd24f400640 1 -- 172.21.15.70:0/1323170677 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240032930 con 0x7fd2501461c0 2024-09-13T16:01:12.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.441+0000 7fd257000640 1 -- 172.21.15.70:0/1323170677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2501461c0 msgr2=0x7fd2500b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:12.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.441+0000 7fd257000640 1 --2- 172.21.15.70:0/1323170677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2501461c0 0x7fd2500b2aa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd250161510 tx=0x7fd24002a230 comp rx=0 tx=0).stop 2024-09-13T16:01:12.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.441+0000 7fd257000640 1 -- 172.21.15.70:0/1323170677 shutdown_connections 2024-09-13T16:01:12.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.441+0000 7fd257000640 1 --2- 172.21.15.70:0/1323170677 >> v2:172.21.15.107:3300/0 conn(0x7fd25006c5b0 0x7fd250070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.441+0000 7fd257000640 1 --2- 172.21.15.70:0/1323170677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2501461c0 0x7fd2500b2aa0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.441+0000 7fd257000640 1 -- 172.21.15.70:0/1323170677 >> 172.21.15.70:0/1323170677 conn(0x7fd2500b0580 msgr2=0x7fd2500b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:12.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.441+0000 7fd257000640 1 -- 172.21.15.70:0/1323170677 shutdown_connections 2024-09-13T16:01:12.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.441+0000 7fd257000640 1 -- 172.21.15.70:0/1323170677 wait complete. 2024-09-13T16:01:12.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.443+0000 7fd257000640 1 Processor -- start 2024-09-13T16:01:12.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.443+0000 7fd257000640 1 -- start start 2024-09-13T16:01:12.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.444+0000 7fd257000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd25006c5b0 0x7fd25013e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:12.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.444+0000 7fd257000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2500b2fe0 0x7fd25013e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:12.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.444+0000 7fd257000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2501461c0 0x7fd2500af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:12.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.444+0000 7fd257000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd250154b50 con 0x7fd25006c5b0 2024-09-13T16:01:12.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.444+0000 7fd257000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd250140910 con 0x7fd2500b2fe0 2024-09-13T16:01:12.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.444+0000 7fd257000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25013e680 con 0x7fd2501461c0 2024-09-13T16:01:12.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.444+0000 7fd24fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd25006c5b0 0x7fd25013e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:12.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.444+0000 7fd24fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd25006c5b0 0x7fd25013e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40030/0 (socket says 172.21.15.70:40030) 2024-09-13T16:01:12.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.444+0000 7fd24fe00640 1 -- 172.21.15.70:0/338340398 learned_addr learned my addr 172.21.15.70:0/338340398 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:12.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.444+0000 7fd255000640 1 --2- 172.21.15.70:0/338340398 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2501461c0 0x7fd2500af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:12.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.444+0000 7fd247e00640 1 --2- 172.21.15.70:0/338340398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2500b2fe0 0x7fd25013e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:12.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.444+0000 7fd24fe00640 1 -- 172.21.15.70:0/338340398 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2501461c0 msgr2=0x7fd2500af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:12.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.444+0000 7fd24fe00640 1 --2- 172.21.15.70:0/338340398 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2501461c0 0x7fd2500af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.444+0000 7fd24fe00640 1 -- 172.21.15.70:0/338340398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2500b2fe0 msgr2=0x7fd25013e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:12.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.444+0000 7fd24fe00640 1 --2- 172.21.15.70:0/338340398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2500b2fe0 0x7fd25013e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.444+0000 7fd24fe00640 1 -- 172.21.15.70:0/338340398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2400094d0 con 0x7fd25006c5b0 2024-09-13T16:01:12.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.444+0000 7fd247e00640 1 --2- 172.21.15.70:0/338340398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2500b2fe0 0x7fd25013e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:12.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.445+0000 7fd24fe00640 1 --2- 172.21.15.70:0/338340398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd25006c5b0 0x7fd25013e140 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd240000c00 tx=0x7fd2400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:12.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.445+0000 7fd24cc00640 1 -- 172.21.15.70:0/338340398 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240030b80 con 0x7fd25006c5b0 2024-09-13T16:01:12.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.445+0000 7fd24cc00640 1 -- 172.21.15.70:0/338340398 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd240030d00 con 0x7fd25006c5b0 2024-09-13T16:01:12.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.445+0000 7fd257000640 1 -- 172.21.15.70:0/338340398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2501f2370 con 0x7fd25006c5b0 2024-09-13T16:01:12.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.445+0000 7fd24cc00640 1 -- 172.21.15.70:0/338340398 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24003d680 con 0x7fd25006c5b0 2024-09-13T16:01:12.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.445+0000 7fd257000640 1 -- 172.21.15.70:0/338340398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2501f2930 con 0x7fd25006c5b0 2024-09-13T16:01:12.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.446+0000 7fd257000640 1 -- 172.21.15.70:0/338340398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2501465a0 con 0x7fd25006c5b0 2024-09-13T16:01:12.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.447+0000 7fd24cc00640 1 -- 172.21.15.70:0/338340398 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd240039040 con 0x7fd25006c5b0 2024-09-13T16:01:12.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.448+0000 7fd24cc00640 1 --2- 172.21.15.70:0/338340398 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd22c06ac30 0x7fd22c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:12.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.448+0000 7fd24cc00640 1 -- 172.21.15.70:0/338340398 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd2400a9cf0 con 0x7fd25006c5b0 2024-09-13T16:01:12.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.448+0000 7fd247e00640 1 --2- 172.21.15.70:0/338340398 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd22c06ac30 0x7fd22c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:12.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.449+0000 7fd247e00640 1 --2- 172.21.15.70:0/338340398 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd22c06ac30 0x7fd22c06d0f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd25015c150 tx=0x7fd238009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:12.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.452+0000 7fd24cc00640 1 -- 172.21.15.70:0/338340398 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd240075180 con 0x7fd25006c5b0 2024-09-13T16:01:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.622+0000 7fd257000640 1 -- 172.21.15.70:0/338340398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2500008d0 con 0x7fd25006c5b0 2024-09-13T16:01:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.623+0000 7fd24cc00640 1 -- 172.21.15.70:0/338340398 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2400787a0 con 0x7fd25006c5b0 2024-09-13T16:01:12.625 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-13T16:01:12.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.625+0000 7fd257000640 1 -- 172.21.15.70:0/338340398 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd22c06ac30 msgr2=0x7fd22c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:12.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.625+0000 7fd257000640 1 --2- 172.21.15.70:0/338340398 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd22c06ac30 0x7fd22c06d0f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd25015c150 tx=0x7fd238009040 comp rx=0 tx=0).stop 2024-09-13T16:01:12.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.625+0000 7fd257000640 1 -- 172.21.15.70:0/338340398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd25006c5b0 msgr2=0x7fd25013e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:12.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.625+0000 7fd257000640 1 --2- 172.21.15.70:0/338340398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd25006c5b0 0x7fd25013e140 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd240000c00 tx=0x7fd2400046c0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.625+0000 7fd257000640 1 -- 172.21.15.70:0/338340398 shutdown_connections 2024-09-13T16:01:12.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.625+0000 7fd257000640 1 --2- 172.21.15.70:0/338340398 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd2501461c0 0x7fd2500af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.625+0000 7fd257000640 1 --2- 172.21.15.70:0/338340398 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd22c06ac30 0x7fd22c06d0f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.625+0000 7fd257000640 1 --2- 172.21.15.70:0/338340398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2500b2fe0 0x7fd25013e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.625+0000 7fd257000640 1 --2- 172.21.15.70:0/338340398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd25006c5b0 0x7fd25013e140 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.625+0000 7fd257000640 1 -- 172.21.15.70:0/338340398 >> 172.21.15.70:0/338340398 conn(0x7fd2500b0580 msgr2=0x7fd250070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:12.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.625+0000 7fd257000640 1 -- 172.21.15.70:0/338340398 shutdown_connections 2024-09-13T16:01:12.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.625+0000 7fd257000640 1 -- 172.21.15.70:0/338340398 wait complete. 2024-09-13T16:01:12.643 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:01:12.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.792+0000 7f1987600640 1 Processor -- start 2024-09-13T16:01:12.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.792+0000 7f1987600640 1 -- start start 2024-09-13T16:01:12.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.794+0000 7f1987600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19800b3990 0x7f1980159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:12.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.794+0000 7f1987600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1980159fc0 con 0x7f198006f660 2024-09-13T16:01:12.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.794+0000 7f1987600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1980153f00 con 0x7f1980153b20 2024-09-13T16:01:12.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.794+0000 7f1987600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19800b3df0 con 0x7f19800b3990 2024-09-13T16:01:12.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.794+0000 7f1985600640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f198006f660 0x7f198006d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39378/0 (socket says 172.21.15.70:39378) 2024-09-13T16:01:12.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.794+0000 7f1985600640 1 -- 172.21.15.70:0/1962946479 learned_addr learned my addr 172.21.15.70:0/1962946479 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:12.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.794+0000 7f1977e00640 1 --2- 172.21.15.70:0/1962946479 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19800b3990 0x7f1980159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:12.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.794+0000 7f197fe00640 1 -- 172.21.15.70:0/1962946479 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015515003 0 0) 0x7f1980159fc0 con 0x7f198006f660 2024-09-13T16:01:12.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.794+0000 7f197fe00640 1 -- 172.21.15.70:0/1962946479 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1964003520 con 0x7f198006f660 2024-09-13T16:01:12.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.795+0000 7f197fe00640 1 -- 172.21.15.70:0/1962946479 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703907653 0 0) 0x7f1980153f00 con 0x7f1980153b20 2024-09-13T16:01:12.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.795+0000 7f197fe00640 1 -- 172.21.15.70:0/1962946479 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1980159fc0 con 0x7f1980153b20 2024-09-13T16:01:12.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.795+0000 7f197fe00640 1 -- 172.21.15.70:0/1962946479 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3671875844 0 0) 0x7f1964003520 con 0x7f198006f660 2024-09-13T16:01:12.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.795+0000 7f1977e00640 1 -- 172.21.15.70:0/1962946479 >> v1:172.21.15.107:6789/0 conn(0x7f1980153b20 legacy=0x7f19800b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:12.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.795+0000 7f1977e00640 1 -- 172.21.15.70:0/1962946479 >> v1:172.21.15.70:6789/0 conn(0x7f198006f660 legacy=0x7f198006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:12.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.795+0000 7f1977e00640 1 -- 172.21.15.70:0/1962946479 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19800b1a40 con 0x7f19800b3990 2024-09-13T16:01:12.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.796+0000 7f1977e00640 1 --2- 172.21.15.70:0/1962946479 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19800b3990 0x7f1980159a80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f19680097d0 tx=0x7f196802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7af0b5e036a83abf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:12.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.796+0000 7f197fe00640 1 -- 172.21.15.70:0/1962946479 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19780019f0 con 0x7f19800b3990 2024-09-13T16:01:12.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.796+0000 7f197fe00640 1 -- 172.21.15.70:0/1962946479 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196802ac30 con 0x7f19800b3990 2024-09-13T16:01:12.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.796+0000 7f197fe00640 1 -- 172.21.15.70:0/1962946479 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968032440 con 0x7f19800b3990 2024-09-13T16:01:12.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.797+0000 7f1987600640 1 -- 172.21.15.70:0/1962946479 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19800b3990 msgr2=0x7f1980159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:12.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.797+0000 7f1987600640 1 --2- 172.21.15.70:0/1962946479 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19800b3990 0x7f1980159a80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f19680097d0 tx=0x7f196802a1a0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.797+0000 7f1987600640 1 -- 172.21.15.70:0/1962946479 shutdown_connections 2024-09-13T16:01:12.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.797+0000 7f1987600640 1 --2- 172.21.15.70:0/1962946479 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19800b3990 0x7f1980159a80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.797+0000 7f1987600640 1 -- 172.21.15.70:0/1962946479 >> 172.21.15.70:0/1962946479 conn(0x7f19800b0510 msgr2=0x7f19800b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:12.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.797+0000 7f1987600640 1 -- 172.21.15.70:0/1962946479 shutdown_connections 2024-09-13T16:01:12.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.797+0000 7f1987600640 1 -- 172.21.15.70:0/1962946479 wait complete. 2024-09-13T16:01:12.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.798+0000 7f1987600640 1 Processor -- start 2024-09-13T16:01:12.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.798+0000 7f1987600640 1 -- start start 2024-09-13T16:01:12.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.799+0000 7f1987600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f198006f660 0x7f198015b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:12.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.799+0000 7f1987600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19800b3990 0x7f1980148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:12.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.799+0000 7f1987600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1980153b20 0x7f19801504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:12.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.799+0000 7f1987600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198014f920 con 0x7f1980153b20 2024-09-13T16:01:12.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.799+0000 7f1987600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198015c350 con 0x7f19800b3990 2024-09-13T16:01:12.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.799+0000 7f1987600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198015bd90 con 0x7f198006f660 2024-09-13T16:01:12.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.800+0000 7f1985600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1980153b20 0x7f19801504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:12.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.800+0000 7f1985600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1980153b20 0x7f19801504c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40042/0 (socket says 172.21.15.70:40042) 2024-09-13T16:01:12.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.800+0000 7f1985600640 1 -- 172.21.15.70:0/2443678586 learned_addr learned my addr 172.21.15.70:0/2443678586 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:12.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.800+0000 7f1977e00640 1 --2- 172.21.15.70:0/2443678586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19800b3990 0x7f1980148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:12.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.800+0000 7f1984c00640 1 --2- 172.21.15.70:0/2443678586 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f198006f660 0x7f198015b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:12.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.800+0000 7f1985600640 1 -- 172.21.15.70:0/2443678586 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f198006f660 msgr2=0x7f198015b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:12.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.800+0000 7f1985600640 1 --2- 172.21.15.70:0/2443678586 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f198006f660 0x7f198015b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.800+0000 7f1985600640 1 -- 172.21.15.70:0/2443678586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19800b3990 msgr2=0x7f1980148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:12.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.800+0000 7f1985600640 1 --2- 172.21.15.70:0/2443678586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19800b3990 0x7f1980148170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:12.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.800+0000 7f1985600640 1 -- 172.21.15.70:0/2443678586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1968009400 con 0x7f1980153b20 2024-09-13T16:01:12.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.800+0000 7f1984c00640 1 --2- 172.21.15.70:0/2443678586 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f198006f660 0x7f198015b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:12.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.800+0000 7f1985600640 1 --2- 172.21.15.70:0/2443678586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1980153b20 0x7f19801504c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1978001ec0 tx=0x7f197800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:12.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.800+0000 7f197d600640 1 -- 172.21.15.70:0/2443678586 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19780020d0 con 0x7f1980153b20 2024-09-13T16:01:12.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.800+0000 7f197d600640 1 -- 172.21.15.70:0/2443678586 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1978012400 con 0x7f1980153b20 2024-09-13T16:01:12.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.800+0000 7f197d600640 1 -- 172.21.15.70:0/2443678586 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19780127d0 con 0x7f1980153b20 2024-09-13T16:01:12.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.800+0000 7f1987600640 1 -- 172.21.15.70:0/2443678586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198015c070 con 0x7f1980153b20 2024-09-13T16:01:12.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.801+0000 7f1987600640 1 -- 172.21.15.70:0/2443678586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198014ffa0 con 0x7f1980153b20 2024-09-13T16:01:12.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.802+0000 7f1987600640 1 -- 172.21.15.70:0/2443678586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1980159a80 con 0x7f1980153b20 2024-09-13T16:01:12.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.802+0000 7f197d600640 1 -- 172.21.15.70:0/2443678586 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1978007070 con 0x7f1980153b20 2024-09-13T16:01:12.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.803+0000 7f197d600640 1 --2- 172.21.15.70:0/2443678586 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f195c06ac00 0x7f195c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:12.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.803+0000 7f197d600640 1 -- 172.21.15.70:0/2443678586 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1978089100 con 0x7f1980153b20 2024-09-13T16:01:12.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.803+0000 7f1984c00640 1 --2- 172.21.15.70:0/2443678586 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f195c06ac00 0x7f195c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:12.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.804+0000 7f1984c00640 1 --2- 172.21.15.70:0/2443678586 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f195c06ac00 0x7f195c06d0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f19700011e0 tx=0x7f1970009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:12.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:12.807+0000 7f197d600640 1 -- 172.21.15.70:0/2443678586 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f19780546d0 con 0x7f1980153b20 2024-09-13T16:01:13.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:13.008+0000 7f1987600640 1 -- 172.21.15.70:0/2443678586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1980150190 con 0x7f1980153b20 2024-09-13T16:01:13.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:13.009+0000 7f197d600640 1 -- 172.21.15.70:0/2443678586 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f1978017500 con 0x7f1980153b20 2024-09-13T16:01:13.011 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:13.011 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2578992914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2578992914},{"type":"v1","addr":"172.21.15.70:6835","nonce":2578992914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T16:01:13.011 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 2 2024-09-13T16:01:13.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:13.011+0000 7f1987600640 1 -- 172.21.15.70:0/2443678586 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f195c06ac00 msgr2=0x7f195c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:13.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:13.011+0000 7f1987600640 1 --2- 172.21.15.70:0/2443678586 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f195c06ac00 0x7f195c06d0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f19700011e0 tx=0x7f1970009040 comp rx=0 tx=0).stop 2024-09-13T16:01:13.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:13.011+0000 7f1987600640 1 -- 172.21.15.70:0/2443678586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1980153b20 msgr2=0x7f19801504c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:13.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:13.011+0000 7f1987600640 1 --2- 172.21.15.70:0/2443678586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1980153b20 0x7f19801504c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1978001ec0 tx=0x7f197800a430 comp rx=0 tx=0).stop 2024-09-13T16:01:13.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:13.011+0000 7f1987600640 1 -- 172.21.15.70:0/2443678586 shutdown_connections 2024-09-13T16:01:13.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:13.011+0000 7f1987600640 1 --2- 172.21.15.70:0/2443678586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1980153b20 0x7f19801504c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:13.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:13.011+0000 7f1987600640 1 --2- 172.21.15.70:0/2443678586 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f195c06ac00 0x7f195c06d0c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:13.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:13.011+0000 7f1987600640 1 --2- 172.21.15.70:0/2443678586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19800b3990 0x7f1980148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:13.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:13.011+0000 7f1987600640 1 --2- 172.21.15.70:0/2443678586 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f198006f660 0x7f198015b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:13.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:13.011+0000 7f1987600640 1 -- 172.21.15.70:0/2443678586 >> 172.21.15.70:0/2443678586 conn(0x7f19800b0510 msgr2=0x7f19800cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:13.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:13.011+0000 7f1987600640 1 -- 172.21.15.70:0/2443678586 shutdown_connections 2024-09-13T16:01:13.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:13.011+0000 7f1987600640 1 -- 172.21.15.70:0/2443678586 wait complete. 2024-09-13T16:01:15.029 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:01:15.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.192+0000 7fb6c5200640 1 Processor -- start 2024-09-13T16:01:15.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.193+0000 7fb6c5200640 1 -- start start 2024-09-13T16:01:15.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.194+0000 7fb6c5200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb6c0159480 0x7fb6c00ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.194+0000 7fb6c5200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb6c006f4b0 0x7fb6c0070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.194+0000 7fb6c5200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6c0071390 0x7fb6c015ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.194+0000 7fb6c5200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c0071790 con 0x7fb6c006f4b0 2024-09-13T16:01:15.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.194+0000 7fb6c5200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c00cd850 con 0x7fb6c0159480 2024-09-13T16:01:15.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.194+0000 7fb6c5200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c00cd570 con 0x7fb6c0071390 2024-09-13T16:01:15.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.194+0000 7fb6b6a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb6c006f4b0 0x7fb6c0070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.194+0000 7fb6b6a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb6c006f4b0 0x7fb6c0070e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40048/0 (socket says 172.21.15.70:40048) 2024-09-13T16:01:15.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.194+0000 7fb6b6a00640 1 -- 172.21.15.70:0/1638511138 learned_addr learned my addr 172.21.15.70:0/1638511138 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:15.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.194+0000 7fb6bfe00640 1 --2- 172.21.15.70:0/1638511138 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6c0071390 0x7fb6c015ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.194+0000 7fb6bf400640 1 --2- 172.21.15.70:0/1638511138 >> v2:172.21.15.107:3300/0 conn(0x7fb6c0159480 0x7fb6c00ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.195+0000 7fb6b6a00640 1 -- 172.21.15.70:0/1638511138 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6c0071390 msgr2=0x7fb6c015ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:15.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.195+0000 7fb6b6a00640 1 --2- 172.21.15.70:0/1638511138 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6c0071390 0x7fb6c015ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.195+0000 7fb6b6a00640 1 -- 172.21.15.70:0/1638511138 >> v2:172.21.15.107:3300/0 conn(0x7fb6c0159480 msgr2=0x7fb6c00ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:15.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.195+0000 7fb6b6a00640 1 --2- 172.21.15.70:0/1638511138 >> v2:172.21.15.107:3300/0 conn(0x7fb6c0159480 0x7fb6c00ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.195+0000 7fb6b6a00640 1 -- 172.21.15.70:0/1638511138 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c00b1740 con 0x7fb6c006f4b0 2024-09-13T16:01:15.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.195+0000 7fb6b6a00640 1 --2- 172.21.15.70:0/1638511138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6c006f4b0 0x7fb6c0070e50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0067270 tx=0x7fb6a802c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a0c1f9fbbba60f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:15.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.196+0000 7fb6bea00640 1 -- 172.21.15.70:0/1638511138 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a802cea0 con 0x7fb6c006f4b0 2024-09-13T16:01:15.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.196+0000 7fb6bea00640 1 -- 172.21.15.70:0/1638511138 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a8034640 con 0x7fb6c006f4b0 2024-09-13T16:01:15.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.196+0000 7fb6bea00640 1 -- 172.21.15.70:0/1638511138 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80349d0 con 0x7fb6c006f4b0 2024-09-13T16:01:15.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.196+0000 7fb6c5200640 1 -- 172.21.15.70:0/1638511138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6c006f4b0 msgr2=0x7fb6c0070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:15.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.196+0000 7fb6c5200640 1 --2- 172.21.15.70:0/1638511138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6c006f4b0 0x7fb6c0070e50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0067270 tx=0x7fb6a802c350 comp rx=0 tx=0).stop 2024-09-13T16:01:15.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.196+0000 7fb6c5200640 1 -- 172.21.15.70:0/1638511138 shutdown_connections 2024-09-13T16:01:15.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.196+0000 7fb6c5200640 1 --2- 172.21.15.70:0/1638511138 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6c0071390 0x7fb6c015ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.196+0000 7fb6c5200640 1 --2- 172.21.15.70:0/1638511138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6c006f4b0 0x7fb6c0070e50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.196+0000 7fb6c5200640 1 --2- 172.21.15.70:0/1638511138 >> v2:172.21.15.107:3300/0 conn(0x7fb6c0159480 0x7fb6c00ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.196+0000 7fb6c5200640 1 -- 172.21.15.70:0/1638511138 >> 172.21.15.70:0/1638511138 conn(0x7fb6c00ae310 msgr2=0x7fb6c00ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:15.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.197+0000 7fb6c5200640 1 -- 172.21.15.70:0/1638511138 shutdown_connections 2024-09-13T16:01:15.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.197+0000 7fb6c5200640 1 -- 172.21.15.70:0/1638511138 wait complete. 2024-09-13T16:01:15.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.198+0000 7fb6c5200640 1 Processor -- start 2024-09-13T16:01:15.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.198+0000 7fb6c5200640 1 -- start start 2024-09-13T16:01:15.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.199+0000 7fb6c5200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6c006f4b0 0x7fb6c014c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.199+0000 7fb6c5200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6c0071390 0x7fb6c00b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.199+0000 7fb6c5200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6c0159480 0x7fb6c00b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.199+0000 7fb6c5200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c015a230 con 0x7fb6c006f4b0 2024-09-13T16:01:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.199+0000 7fb6c5200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c0159900 con 0x7fb6c0159480 2024-09-13T16:01:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.199+0000 7fb6c5200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c0159b70 con 0x7fb6c0071390 2024-09-13T16:01:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.199+0000 7fb6bf400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6c006f4b0 0x7fb6c014c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.199+0000 7fb6bf400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6c006f4b0 0x7fb6c014c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40058/0 (socket says 172.21.15.70:40058) 2024-09-13T16:01:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.199+0000 7fb6bf400640 1 -- 172.21.15.70:0/980342559 learned_addr learned my addr 172.21.15.70:0/980342559 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.199+0000 7fb6b6a00640 1 --2- 172.21.15.70:0/980342559 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6c0071390 0x7fb6c00b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.200+0000 7fb6bfe00640 1 --2- 172.21.15.70:0/980342559 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6c0159480 0x7fb6c00b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.200+0000 7fb6bf400640 1 -- 172.21.15.70:0/980342559 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6c0071390 msgr2=0x7fb6c00b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.200+0000 7fb6bf400640 1 --2- 172.21.15.70:0/980342559 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6c0071390 0x7fb6c00b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.200+0000 7fb6bf400640 1 -- 172.21.15.70:0/980342559 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6c0159480 msgr2=0x7fb6c00b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.200+0000 7fb6bf400640 1 --2- 172.21.15.70:0/980342559 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6c0159480 0x7fb6c00b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.200+0000 7fb6bf400640 1 -- 172.21.15.70:0/980342559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a80094d0 con 0x7fb6c006f4b0 2024-09-13T16:01:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.200+0000 7fb6bf400640 1 --2- 172.21.15.70:0/980342559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6c006f4b0 0x7fb6c014c340 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000d620 tx=0x7fb6b000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.200+0000 7fb6b7e00640 1 -- 172.21.15.70:0/980342559 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b000b620 con 0x7fb6c006f4b0 2024-09-13T16:01:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.200+0000 7fb6b7e00640 1 -- 172.21.15.70:0/980342559 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b000b780 con 0x7fb6c006f4b0 2024-09-13T16:01:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.200+0000 7fb6c5200640 1 -- 172.21.15.70:0/980342559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c0159e50 con 0x7fb6c006f4b0 2024-09-13T16:01:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.200+0000 7fb6b7e00640 1 -- 172.21.15.70:0/980342559 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b000bb30 con 0x7fb6c006f4b0 2024-09-13T16:01:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.200+0000 7fb6c5200640 1 -- 172.21.15.70:0/980342559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c0158360 con 0x7fb6c006f4b0 2024-09-13T16:01:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.201+0000 7fb6c5200640 1 -- 172.21.15.70:0/980342559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c0067360 con 0x7fb6c006f4b0 2024-09-13T16:01:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.202+0000 7fb6b7e00640 1 -- 172.21.15.70:0/980342559 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb6b000bc90 con 0x7fb6c006f4b0 2024-09-13T16:01:15.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.203+0000 7fb6b7e00640 1 --2- 172.21.15.70:0/980342559 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb69c06ac00 0x7fb69c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.204+0000 7fb6b7e00640 1 -- 172.21.15.70:0/980342559 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb6b00894e0 con 0x7fb6c006f4b0 2024-09-13T16:01:15.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.204+0000 7fb6b6a00640 1 --2- 172.21.15.70:0/980342559 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb69c06ac00 0x7fb69c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.204+0000 7fb6b6a00640 1 --2- 172.21.15.70:0/980342559 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb69c06ac00 0x7fb69c06d0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8036000 tx=0x7fb6a8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.208+0000 7fb6b7e00640 1 -- 172.21.15.70:0/980342559 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb6b0054970 con 0x7fb6c006f4b0 2024-09-13T16:01:15.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.411+0000 7fb6c5200640 1 -- 172.21.15.70:0/980342559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6c015ce80 con 0x7fb6c006f4b0 2024-09-13T16:01:15.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.412+0000 7fb6b7e00640 1 -- 172.21.15.70:0/980342559 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7fb6b0057f90 con 0x7fb6c006f4b0 2024-09-13T16:01:15.413 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:15.413 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2852595148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2852595148},{"type":"v1","addr":"172.21.15.107:6834","nonce":2852595148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2578992914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2578992914},{"type":"v1","addr":"172.21.15.70:6835","nonce":2578992914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/927553867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":927553867},{"type":"v1","addr":"172.21.15.70:6837","nonce":927553867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/712016246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":712016246},{"type":"v1","addr":"172.21.15.107:6835","nonce":712016246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T16:01:15.413 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 3 2024-09-13T16:01:15.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.414+0000 7fb6c5200640 1 -- 172.21.15.70:0/980342559 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb69c06ac00 msgr2=0x7fb69c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:15.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.414+0000 7fb6c5200640 1 --2- 172.21.15.70:0/980342559 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb69c06ac00 0x7fb69c06d0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8036000 tx=0x7fb6a8030000 comp rx=0 tx=0).stop 2024-09-13T16:01:15.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.414+0000 7fb6c5200640 1 -- 172.21.15.70:0/980342559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6c006f4b0 msgr2=0x7fb6c014c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:15.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.414+0000 7fb6c5200640 1 --2- 172.21.15.70:0/980342559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6c006f4b0 0x7fb6c014c340 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000d620 tx=0x7fb6b000dae0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.414+0000 7fb6c5200640 1 -- 172.21.15.70:0/980342559 shutdown_connections 2024-09-13T16:01:15.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.414+0000 7fb6c5200640 1 --2- 172.21.15.70:0/980342559 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb69c06ac00 0x7fb69c06d0c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.414+0000 7fb6c5200640 1 --2- 172.21.15.70:0/980342559 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6c0159480 0x7fb6c00b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.414+0000 7fb6c5200640 1 --2- 172.21.15.70:0/980342559 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6c0071390 0x7fb6c00b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.414+0000 7fb6c5200640 1 --2- 172.21.15.70:0/980342559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6c006f4b0 0x7fb6c014c340 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.414+0000 7fb6c5200640 1 -- 172.21.15.70:0/980342559 >> 172.21.15.70:0/980342559 conn(0x7fb6c00ae310 msgr2=0x7fb6c01558d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:15.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.414+0000 7fb6c5200640 1 -- 172.21.15.70:0/980342559 shutdown_connections 2024-09-13T16:01:15.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.414+0000 7fb6c5200640 1 -- 172.21.15.70:0/980342559 wait complete. 2024-09-13T16:01:15.431 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:15.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.582+0000 7f8611a00640 1 Processor -- start 2024-09-13T16:01:15.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.582+0000 7f8611a00640 1 -- start start 2024-09-13T16:01:15.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.583+0000 7f8611a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f860c15cbc0 0x7f860c0cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.583+0000 7f8611a00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c0b5540 con 0x7f860c0cf000 2024-09-13T16:01:15.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.583+0000 7f8611a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c0b60c0 con 0x7f860c1463c0 2024-09-13T16:01:15.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.583+0000 7f8611a00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860c0b5790 con 0x7f860c15cbc0 2024-09-13T16:01:15.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.584+0000 7f860b400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f860c15cbc0 0x7f860c0cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.584+0000 7f8611000640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f860c0cf000 0x7f860c0b6550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39382/0 (socket says 172.21.15.70:39382) 2024-09-13T16:01:15.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.584+0000 7f8611000640 1 -- 172.21.15.70:0/3064942808 learned_addr learned my addr 172.21.15.70:0/3064942808 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:15.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.584+0000 7f860b400640 1 -- 172.21.15.70:0/3064942808 >> v1:172.21.15.107:6789/0 conn(0x7f860c1463c0 legacy=0x7f860c0d18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:15.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.584+0000 7f860b400640 1 -- 172.21.15.70:0/3064942808 >> v1:172.21.15.70:6789/0 conn(0x7f860c0cf000 legacy=0x7f860c0b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:15.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.584+0000 7f860aa00640 1 -- 172.21.15.70:0/3064942808 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679666966 0 0) 0x7f860c0b5540 con 0x7f860c0cf000 2024-09-13T16:01:15.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.584+0000 7f860b400640 1 -- 172.21.15.70:0/3064942808 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c0b5a70 con 0x7f860c15cbc0 2024-09-13T16:01:15.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.585+0000 7f860b400640 1 --2- 172.21.15.70:0/3064942808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f860c15cbc0 0x7f860c0cfef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f85f80097a0 tx=0x7f85f802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5661cf0d053b635 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:15.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.585+0000 7f860aa00640 1 -- 172.21.15.70:0/3064942808 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f8032440 con 0x7f860c15cbc0 2024-09-13T16:01:15.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.585+0000 7f860aa00640 1 -- 172.21.15.70:0/3064942808 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f80325a0 con 0x7f860c15cbc0 2024-09-13T16:01:15.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.585+0000 7f860aa00640 1 -- 172.21.15.70:0/3064942808 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f8032930 con 0x7f860c15cbc0 2024-09-13T16:01:15.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.586+0000 7f8611a00640 1 -- 172.21.15.70:0/3064942808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f860c15cbc0 msgr2=0x7f860c0cfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:15.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.586+0000 7f8611a00640 1 --2- 172.21.15.70:0/3064942808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f860c15cbc0 0x7f860c0cfef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f85f80097a0 tx=0x7f85f802a230 comp rx=0 tx=0).stop 2024-09-13T16:01:15.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.586+0000 7f8611a00640 1 -- 172.21.15.70:0/3064942808 shutdown_connections 2024-09-13T16:01:15.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.586+0000 7f8611a00640 1 --2- 172.21.15.70:0/3064942808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f860c15cbc0 0x7f860c0cfef0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.586+0000 7f8611a00640 1 -- 172.21.15.70:0/3064942808 >> 172.21.15.70:0/3064942808 conn(0x7f860c0b4420 msgr2=0x7f860c0b4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:15.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.586+0000 7f8611a00640 1 -- 172.21.15.70:0/3064942808 shutdown_connections 2024-09-13T16:01:15.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.586+0000 7f8611a00640 1 -- 172.21.15.70:0/3064942808 wait complete. 2024-09-13T16:01:15.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.587+0000 7f8611a00640 1 Processor -- start 2024-09-13T16:01:15.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.588+0000 7f8611a00640 1 -- start start 2024-09-13T16:01:15.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.588+0000 7f8611a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f860c0cf000 0x7f860c1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.588+0000 7f8611a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f860c1463c0 0x7f860c0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.588+0000 7f8611a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f860c15cbc0 0x7f860c0cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.588+0000 7f8611a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c0ca9c0 con 0x7f860c1463c0 2024-09-13T16:01:15.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.588+0000 7f8611a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c0c8870 con 0x7f860c15cbc0 2024-09-13T16:01:15.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.588+0000 7f8611a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c0cabd0 con 0x7f860c0cf000 2024-09-13T16:01:15.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.589+0000 7f860b400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f860c1463c0 0x7f860c0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.589+0000 7f860b400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f860c1463c0 0x7f860c0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40074/0 (socket says 172.21.15.70:40074) 2024-09-13T16:01:15.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.589+0000 7f860b400640 1 -- 172.21.15.70:0/2989590682 learned_addr learned my addr 172.21.15.70:0/2989590682 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:15.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.589+0000 7f860be00640 1 --2- 172.21.15.70:0/2989590682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f860c0cf000 0x7f860c1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.589+0000 7f8611000640 1 --2- 172.21.15.70:0/2989590682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f860c15cbc0 0x7f860c0cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.589+0000 7f860b400640 1 -- 172.21.15.70:0/2989590682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f860c0cf000 msgr2=0x7f860c1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:15.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.589+0000 7f860b400640 1 --2- 172.21.15.70:0/2989590682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f860c0cf000 0x7f860c1554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.589+0000 7f860b400640 1 -- 172.21.15.70:0/2989590682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f860c15cbc0 msgr2=0x7f860c0cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:15.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.589+0000 7f860b400640 1 --2- 172.21.15.70:0/2989590682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f860c15cbc0 0x7f860c0cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.589+0000 7f860b400640 1 -- 172.21.15.70:0/2989590682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f8009400 con 0x7f860c1463c0 2024-09-13T16:01:15.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.589+0000 7f8611000640 1 --2- 172.21.15.70:0/2989590682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f860c15cbc0 0x7f860c0cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:15.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.589+0000 7f860b400640 1 --2- 172.21.15.70:0/2989590682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f860c1463c0 0x7f860c0ccf00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85f8000c00 tx=0x7f85f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:15.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.590+0000 7f8603e00640 1 -- 172.21.15.70:0/2989590682 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f8004230 con 0x7f860c1463c0 2024-09-13T16:01:15.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.590+0000 7f8603e00640 1 -- 172.21.15.70:0/2989590682 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f8004390 con 0x7f860c1463c0 2024-09-13T16:01:15.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.590+0000 7f8603e00640 1 -- 172.21.15.70:0/2989590682 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f8030ac0 con 0x7f860c1463c0 2024-09-13T16:01:15.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.590+0000 7f8611a00640 1 -- 172.21.15.70:0/2989590682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860c0caeb0 con 0x7f860c1463c0 2024-09-13T16:01:15.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.590+0000 7f8611a00640 1 -- 172.21.15.70:0/2989590682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860c0cb470 con 0x7f860c1463c0 2024-09-13T16:01:15.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.591+0000 7f8611a00640 1 -- 172.21.15.70:0/2989590682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860c067360 con 0x7f860c1463c0 2024-09-13T16:01:15.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.592+0000 7f8603e00640 1 -- 172.21.15.70:0/2989590682 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f85f8039050 con 0x7f860c1463c0 2024-09-13T16:01:15.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.593+0000 7f8603e00640 1 --2- 172.21.15.70:0/2989590682 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f85ec06ac00 0x7f85ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.593+0000 7f8603e00640 1 -- 172.21.15.70:0/2989590682 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f85f80a9ac0 con 0x7f860c1463c0 2024-09-13T16:01:15.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.593+0000 7f860be00640 1 --2- 172.21.15.70:0/2989590682 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f85ec06ac00 0x7f85ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.594+0000 7f860be00640 1 --2- 172.21.15.70:0/2989590682 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f85ec06ac00 0x7f85ec06d0c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85fc000f60 tx=0x7f85fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:15.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.597+0000 7f8603e00640 1 -- 172.21.15.70:0/2989590682 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f85f8075120 con 0x7f860c1463c0 2024-09-13T16:01:15.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.767+0000 7f8611a00640 1 -- 172.21.15.70:0/2989590682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f860c0cfef0 con 0x7f860c1463c0 2024-09-13T16:01:15.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.768+0000 7f8603e00640 1 -- 172.21.15.70:0/2989590682 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12814 (secure 0 0 0) 0x7f85f804b020 con 0x7f860c1463c0 2024-09-13T16:01:15.769 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:15.769 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":16,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:08.075649+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:15.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.770+0000 7f8611a00640 1 -- 172.21.15.70:0/2989590682 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f85ec06ac00 msgr2=0x7f85ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.770+0000 7f8611a00640 1 --2- 172.21.15.70:0/2989590682 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f85ec06ac00 0x7f85ec06d0c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85fc000f60 tx=0x7f85fc009040 comp rx=0 tx=0).stop 2024-09-13T16:01:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.770+0000 7f8611a00640 1 -- 172.21.15.70:0/2989590682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f860c1463c0 msgr2=0x7f860c0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.770+0000 7f8611a00640 1 --2- 172.21.15.70:0/2989590682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f860c1463c0 0x7f860c0ccf00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85f8000c00 tx=0x7f85f80046c0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.770+0000 7f8611a00640 1 -- 172.21.15.70:0/2989590682 shutdown_connections 2024-09-13T16:01:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.770+0000 7f8611a00640 1 --2- 172.21.15.70:0/2989590682 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f85ec06ac00 0x7f85ec06d0c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.770+0000 7f8611a00640 1 --2- 172.21.15.70:0/2989590682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f860c15cbc0 0x7f860c0cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.770+0000 7f8611a00640 1 --2- 172.21.15.70:0/2989590682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f860c1463c0 0x7f860c0ccf00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.770+0000 7f8611a00640 1 --2- 172.21.15.70:0/2989590682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f860c0cf000 0x7f860c1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.770+0000 7f8611a00640 1 -- 172.21.15.70:0/2989590682 >> 172.21.15.70:0/2989590682 conn(0x7f860c0b4420 msgr2=0x7f860c0b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.770+0000 7f8611a00640 1 -- 172.21.15.70:0/2989590682 shutdown_connections 2024-09-13T16:01:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.770+0000 7f8611a00640 1 -- 172.21.15.70:0/2989590682 wait complete. 2024-09-13T16:01:15.787 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:01:06.070694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:01:15.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:01:15.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.941+0000 7f05d5c00640 1 Processor -- start 2024-09-13T16:01:15.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.941+0000 7f05d5c00640 1 -- start start 2024-09-13T16:01:15.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.942+0000 7f05d5c00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f05d0154ad0 0x7f05d00cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.942+0000 7f05d5c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f05d006f830 0x7f05d006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.942+0000 7f05d5c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d00ce2c0 0x7f05d00cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.942+0000 7f05d5c00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d006b5b0 con 0x7f05d0154ad0 2024-09-13T16:01:15.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.942+0000 7f05d5c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d006b7c0 con 0x7f05d006f830 2024-09-13T16:01:15.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.942+0000 7f05d5c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d006baa0 con 0x7f05d00ce2c0 2024-09-13T16:01:15.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.942+0000 7f05cea00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f05d0154ad0 0x7f05d00cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.942+0000 7f05cea00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f05d0154ad0 0x7f05d00cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40076/0 (socket says 172.21.15.70:40076) 2024-09-13T16:01:15.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.943+0000 7f05cea00640 1 -- 172.21.15.70:0/1614719440 learned_addr learned my addr 172.21.15.70:0/1614719440 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:15.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.943+0000 7f05ce000640 1 --2- 172.21.15.70:0/1614719440 >> v2:172.21.15.107:3300/0 conn(0x7f05d006f830 0x7f05d006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.943+0000 7f05cf400640 1 --2- 172.21.15.70:0/1614719440 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d00ce2c0 0x7f05d00cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.943+0000 7f05cea00640 1 -- 172.21.15.70:0/1614719440 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d00ce2c0 msgr2=0x7f05d00cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:15.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.943+0000 7f05cea00640 1 --2- 172.21.15.70:0/1614719440 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d00ce2c0 0x7f05d00cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.943+0000 7f05cea00640 1 -- 172.21.15.70:0/1614719440 >> v2:172.21.15.107:3300/0 conn(0x7f05d006f830 msgr2=0x7f05d006fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:15.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.943+0000 7f05cea00640 1 --2- 172.21.15.70:0/1614719440 >> v2:172.21.15.107:3300/0 conn(0x7f05d006f830 0x7f05d006fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.943+0000 7f05cea00640 1 -- 172.21.15.70:0/1614719440 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d006bd80 con 0x7f05d0154ad0 2024-09-13T16:01:15.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.943+0000 7f05ce000640 1 --2- 172.21.15.70:0/1614719440 >> v2:172.21.15.107:3300/0 conn(0x7f05d006f830 0x7f05d006fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:15.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.944+0000 7f05cea00640 1 --2- 172.21.15.70:0/1614719440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05d0154ad0 0x7f05d00cdd80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05d00ae4c0 tx=0x7f05c002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02653f9a8104835 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:15.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.944+0000 7f05cd600640 1 -- 172.21.15.70:0/1614719440 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c002ae90 con 0x7f05d0154ad0 2024-09-13T16:01:15.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.944+0000 7f05cd600640 1 -- 172.21.15.70:0/1614719440 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c0032440 con 0x7f05d0154ad0 2024-09-13T16:01:15.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.944+0000 7f05cd600640 1 -- 172.21.15.70:0/1614719440 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c00327d0 con 0x7f05d0154ad0 2024-09-13T16:01:15.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.945+0000 7f05d5c00640 1 -- 172.21.15.70:0/1614719440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05d0154ad0 msgr2=0x7f05d00cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:15.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.945+0000 7f05d5c00640 1 --2- 172.21.15.70:0/1614719440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05d0154ad0 0x7f05d00cdd80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05d00ae4c0 tx=0x7f05c002a140 comp rx=0 tx=0).stop 2024-09-13T16:01:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.945+0000 7f05d5c00640 1 -- 172.21.15.70:0/1614719440 shutdown_connections 2024-09-13T16:01:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.945+0000 7f05d5c00640 1 --2- 172.21.15.70:0/1614719440 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d00ce2c0 0x7f05d00cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.945+0000 7f05d5c00640 1 --2- 172.21.15.70:0/1614719440 >> v2:172.21.15.107:3300/0 conn(0x7f05d006f830 0x7f05d006fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.945+0000 7f05d5c00640 1 --2- 172.21.15.70:0/1614719440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05d0154ad0 0x7f05d00cdd80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.945+0000 7f05d5c00640 1 -- 172.21.15.70:0/1614719440 >> 172.21.15.70:0/1614719440 conn(0x7f05d00b0580 msgr2=0x7f05d00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.945+0000 7f05d5c00640 1 -- 172.21.15.70:0/1614719440 shutdown_connections 2024-09-13T16:01:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.945+0000 7f05d5c00640 1 -- 172.21.15.70:0/1614719440 wait complete. 2024-09-13T16:01:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.946+0000 7f05d5c00640 1 Processor -- start 2024-09-13T16:01:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.947+0000 7f05d5c00640 1 -- start start 2024-09-13T16:01:15.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.947+0000 7f05d5c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d0154ad0 0x7f05d013f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.947+0000 7f05d5c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05d013fc90 0x7f05d01f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.947+0000 7f05d5c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d014f9d0 0x7f05d014fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.947+0000 7f05d5c00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d0150390 con 0x7f05d013fc90 2024-09-13T16:01:15.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.947+0000 7f05d5c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00b1d60 con 0x7f05d014f9d0 2024-09-13T16:01:15.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.947+0000 7f05d5c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d013fac0 con 0x7f05d0154ad0 2024-09-13T16:01:15.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.948+0000 7f05ce000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05d013fc90 0x7f05d01f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.948+0000 7f05ce000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05d013fc90 0x7f05d01f5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40092/0 (socket says 172.21.15.70:40092) 2024-09-13T16:01:15.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.948+0000 7f05ce000640 1 -- 172.21.15.70:0/343018434 learned_addr learned my addr 172.21.15.70:0/343018434 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:15.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.948+0000 7f05cea00640 1 --2- 172.21.15.70:0/343018434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d0154ad0 0x7f05d013f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.948+0000 7f05cf400640 1 --2- 172.21.15.70:0/343018434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d014f9d0 0x7f05d014fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.948+0000 7f05ce000640 1 -- 172.21.15.70:0/343018434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d0154ad0 msgr2=0x7f05d013f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:15.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.948+0000 7f05ce000640 1 --2- 172.21.15.70:0/343018434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d0154ad0 0x7f05d013f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.948+0000 7f05ce000640 1 -- 172.21.15.70:0/343018434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d014f9d0 msgr2=0x7f05d014fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:15.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.948+0000 7f05ce000640 1 --2- 172.21.15.70:0/343018434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d014f9d0 0x7f05d014fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:15.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.948+0000 7f05ce000640 1 -- 172.21.15.70:0/343018434 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c00094d0 con 0x7f05d013fc90 2024-09-13T16:01:15.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.948+0000 7f05ce000640 1 --2- 172.21.15.70:0/343018434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05d013fc90 0x7f05d01f5680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f05bc00e810 tx=0x7f05bc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:15.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.948+0000 7f05c6a00640 1 -- 172.21.15.70:0/343018434 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc004030 con 0x7f05d013fc90 2024-09-13T16:01:15.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.949+0000 7f05c6a00640 1 -- 172.21.15.70:0/343018434 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc004190 con 0x7f05d013fc90 2024-09-13T16:01:15.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.949+0000 7f05c6a00640 1 -- 172.21.15.70:0/343018434 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc004520 con 0x7f05d013fc90 2024-09-13T16:01:15.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.949+0000 7f05d5c00640 1 -- 172.21.15.70:0/343018434 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d00b1a30 con 0x7f05d013fc90 2024-09-13T16:01:15.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.949+0000 7f05d5c00640 1 -- 172.21.15.70:0/343018434 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d01f61b0 con 0x7f05d013fc90 2024-09-13T16:01:15.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.950+0000 7f05d5c00640 1 -- 172.21.15.70:0/343018434 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d006fee0 con 0x7f05d013fc90 2024-09-13T16:01:15.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.951+0000 7f05c6a00640 1 -- 172.21.15.70:0/343018434 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f05bc00c670 con 0x7f05d013fc90 2024-09-13T16:01:15.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.951+0000 7f05c6a00640 1 --2- 172.21.15.70:0/343018434 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f05b006ac00 0x7f05b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:15.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.952+0000 7f05c6a00640 1 -- 172.21.15.70:0/343018434 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f05bc088ae0 con 0x7f05d013fc90 2024-09-13T16:01:15.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.952+0000 7f05cea00640 1 --2- 172.21.15.70:0/343018434 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f05b006ac00 0x7f05b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:15.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.952+0000 7f05cea00640 1 --2- 172.21.15.70:0/343018434 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f05b006ac00 0x7f05b006d0c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05c0034000 tx=0x7f05c002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:15.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:15.955+0000 7f05c6a00640 1 -- 172.21.15.70:0/343018434 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f05bc054020 con 0x7f05d013fc90 2024-09-13T16:01:16.018 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T16:01:16.022 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T16:01:16.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.131+0000 7f05d5c00640 1 -- 172.21.15.70:0/343018434 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05d015b560 con 0x7f05d013fc90 2024-09-13T16:01:16.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.131+0000 7f05c6a00640 1 -- 172.21.15.70:0/343018434 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05bc0093c0 con 0x7f05d013fc90 2024-09-13T16:01:16.133 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-13T16:01:16.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.133+0000 7f05d5c00640 1 -- 172.21.15.70:0/343018434 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f05b006ac00 msgr2=0x7f05b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:16.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.133+0000 7f05d5c00640 1 --2- 172.21.15.70:0/343018434 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f05b006ac00 0x7f05b006d0c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05c0034000 tx=0x7f05c002e000 comp rx=0 tx=0).stop 2024-09-13T16:01:16.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.133+0000 7f05d5c00640 1 -- 172.21.15.70:0/343018434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05d013fc90 msgr2=0x7f05d01f5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:16.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.133+0000 7f05d5c00640 1 --2- 172.21.15.70:0/343018434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05d013fc90 0x7f05d01f5680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f05bc00e810 tx=0x7f05bc00ecd0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.133+0000 7f05d5c00640 1 -- 172.21.15.70:0/343018434 shutdown_connections 2024-09-13T16:01:16.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.133+0000 7f05d5c00640 1 --2- 172.21.15.70:0/343018434 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f05b006ac00 0x7f05b006d0c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.133+0000 7f05d5c00640 1 --2- 172.21.15.70:0/343018434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d014f9d0 0x7f05d014fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.133+0000 7f05d5c00640 1 --2- 172.21.15.70:0/343018434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05d013fc90 0x7f05d01f5680 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.133+0000 7f05d5c00640 1 --2- 172.21.15.70:0/343018434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d0154ad0 0x7f05d013f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.133+0000 7f05d5c00640 1 -- 172.21.15.70:0/343018434 >> 172.21.15.70:0/343018434 conn(0x7f05d00b0580 msgr2=0x7f05d015a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:16.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.133+0000 7f05d5c00640 1 -- 172.21.15.70:0/343018434 shutdown_connections 2024-09-13T16:01:16.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.133+0000 7f05d5c00640 1 -- 172.21.15.70:0/343018434 wait complete. 2024-09-13T16:01:16.150 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T16:01:16.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.340+0000 7fea3ea00640 1 Processor -- start 2024-09-13T16:01:16.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.340+0000 7fea3ea00640 1 -- start start 2024-09-13T16:01:16.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.341+0000 7fea3ea00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fea38145a50 0x7fea3806cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:16.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.341+0000 7fea3ea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fea380b3bb0 0x7fea3806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:16.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.341+0000 7fea3ea00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3806cb40 con 0x7fea38145670 2024-09-13T16:01:16.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.341+0000 7fea3ea00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea3806ae10 con 0x7fea38145a50 2024-09-13T16:01:16.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.341+0000 7fea3ea00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea3806a8b0 con 0x7fea380b3bb0 2024-09-13T16:01:16.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.341+0000 7fea37400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fea38145a50 0x7fea3806cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:16.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.341+0000 7fea37e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fea38145670 0x7fea380b34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39398/0 (socket says 172.21.15.70:39398) 2024-09-13T16:01:16.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.341+0000 7fea37e00640 1 -- 172.21.15.70:0/933749851 learned_addr learned my addr 172.21.15.70:0/933749851 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:16.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.342+0000 7fea3ca00640 1 --2- 172.21.15.70:0/933749851 >> v2:172.21.15.107:3300/0 conn(0x7fea380b3bb0 0x7fea3806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:16.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.342+0000 7fea37400640 1 -- 172.21.15.70:0/933749851 >> v2:172.21.15.107:3300/0 conn(0x7fea380b3bb0 msgr2=0x7fea3806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:16.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.342+0000 7fea37400640 1 --2- 172.21.15.70:0/933749851 >> v2:172.21.15.107:3300/0 conn(0x7fea380b3bb0 0x7fea3806d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.342+0000 7fea37400640 1 -- 172.21.15.70:0/933749851 >> v1:172.21.15.70:6789/0 conn(0x7fea38145670 legacy=0x7fea380b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:16.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.342+0000 7fea37400640 1 -- 172.21.15.70:0/933749851 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3806ab30 con 0x7fea38145a50 2024-09-13T16:01:16.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.342+0000 7fea36a00640 1 -- 172.21.15.70:0/933749851 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102982913 0 0) 0x7fea3806cb40 con 0x7fea38145670 2024-09-13T16:01:16.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.343+0000 7fea37400640 1 --2- 172.21.15.70:0/933749851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea38145a50 0x7fea3806cfd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fea38146390 tx=0x7fea2402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90d7c9d44b0efc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:16.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.343+0000 7fea36a00640 1 -- 172.21.15.70:0/933749851 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2402ae60 con 0x7fea38145a50 2024-09-13T16:01:16.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.343+0000 7fea36a00640 1 -- 172.21.15.70:0/933749851 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea24032440 con 0x7fea38145a50 2024-09-13T16:01:16.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.343+0000 7fea36a00640 1 -- 172.21.15.70:0/933749851 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea240327d0 con 0x7fea38145a50 2024-09-13T16:01:16.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.343+0000 7fea3ea00640 1 -- 172.21.15.70:0/933749851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea38145a50 msgr2=0x7fea3806cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:16.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.343+0000 7fea3ea00640 1 --2- 172.21.15.70:0/933749851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea38145a50 0x7fea3806cfd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fea38146390 tx=0x7fea2402a110 comp rx=0 tx=0).stop 2024-09-13T16:01:16.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.344+0000 7fea3ea00640 1 -- 172.21.15.70:0/933749851 shutdown_connections 2024-09-13T16:01:16.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.344+0000 7fea3ea00640 1 --2- 172.21.15.70:0/933749851 >> v2:172.21.15.107:3300/0 conn(0x7fea380b3bb0 0x7fea3806d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.344+0000 7fea3ea00640 1 --2- 172.21.15.70:0/933749851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea38145a50 0x7fea3806cfd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.344+0000 7fea3ea00640 1 -- 172.21.15.70:0/933749851 >> 172.21.15.70:0/933749851 conn(0x7fea3806afe0 msgr2=0x7fea3806b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:16.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.344+0000 7fea3ea00640 1 -- 172.21.15.70:0/933749851 shutdown_connections 2024-09-13T16:01:16.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.344+0000 7fea3ea00640 1 -- 172.21.15.70:0/933749851 wait complete. 2024-09-13T16:01:16.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.345+0000 7fea3ea00640 1 Processor -- start 2024-09-13T16:01:16.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.345+0000 7fea3ea00640 1 -- start start 2024-09-13T16:01:16.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.346+0000 7fea3ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea380b3bb0 0x7fea380c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:16.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.346+0000 7fea3ea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea38145670 0x7fea3813e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:16.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.346+0000 7fea3ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea38145a50 0x7fea3813ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:16.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.346+0000 7fea3ea00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea380cc080 con 0x7fea38145670 2024-09-13T16:01:16.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.346+0000 7fea3ea00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea381f5e70 con 0x7fea380b3bb0 2024-09-13T16:01:16.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.346+0000 7fea3ea00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea380b12c0 con 0x7fea38145a50 2024-09-13T16:01:16.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.346+0000 7fea37400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea38145670 0x7fea3813e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:16.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.346+0000 7fea37400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea38145670 0x7fea3813e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40106/0 (socket says 172.21.15.70:40106) 2024-09-13T16:01:16.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.346+0000 7fea37400640 1 -- 172.21.15.70:0/459500030 learned_addr learned my addr 172.21.15.70:0/459500030 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:16.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.347+0000 7fea37e00640 1 --2- 172.21.15.70:0/459500030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea380b3bb0 0x7fea380c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:16.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.347+0000 7fea3ca00640 1 --2- 172.21.15.70:0/459500030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea38145a50 0x7fea3813ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:16.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.347+0000 7fea37400640 1 -- 172.21.15.70:0/459500030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea38145a50 msgr2=0x7fea3813ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:16.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.347+0000 7fea37400640 1 --2- 172.21.15.70:0/459500030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea38145a50 0x7fea3813ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.347+0000 7fea37400640 1 -- 172.21.15.70:0/459500030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea380b3bb0 msgr2=0x7fea380c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:16.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.347+0000 7fea37400640 1 --2- 172.21.15.70:0/459500030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea380b3bb0 0x7fea380c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.347+0000 7fea37400640 1 -- 172.21.15.70:0/459500030 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea24009400 con 0x7fea38145670 2024-09-13T16:01:16.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.347+0000 7fea37400640 1 --2- 172.21.15.70:0/459500030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea38145670 0x7fea3813e840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fea24000c00 tx=0x7fea240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:16.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.347+0000 7fea2fe00640 1 -- 172.21.15.70:0/459500030 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea240308d0 con 0x7fea38145670 2024-09-13T16:01:16.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.348+0000 7fea2fe00640 1 -- 172.21.15.70:0/459500030 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea24030a30 con 0x7fea38145670 2024-09-13T16:01:16.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.348+0000 7fea3ea00640 1 -- 172.21.15.70:0/459500030 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea381f6130 con 0x7fea38145670 2024-09-13T16:01:16.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.348+0000 7fea2fe00640 1 -- 172.21.15.70:0/459500030 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24030dc0 con 0x7fea38145670 2024-09-13T16:01:16.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.348+0000 7fea3ea00640 1 -- 172.21.15.70:0/459500030 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea381f66f0 con 0x7fea38145670 2024-09-13T16:01:16.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.349+0000 7fea3ea00640 1 -- 172.21.15.70:0/459500030 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea380b2900 con 0x7fea38145670 2024-09-13T16:01:16.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.349+0000 7fea2fe00640 1 -- 172.21.15.70:0/459500030 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fea24039040 con 0x7fea38145670 2024-09-13T16:01:16.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.350+0000 7fea2fe00640 1 --2- 172.21.15.70:0/459500030 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fea1806ac00 0x7fea1806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:16.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.350+0000 7fea2fe00640 1 -- 172.21.15.70:0/459500030 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fea240a9c60 con 0x7fea38145670 2024-09-13T16:01:16.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.351+0000 7fea37e00640 1 --2- 172.21.15.70:0/459500030 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fea1806ac00 0x7fea1806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:16.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.351+0000 7fea37e00640 1 --2- 172.21.15.70:0/459500030 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fea1806ac00 0x7fea1806d0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fea28000f60 tx=0x7fea28007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:16.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.354+0000 7fea2fe00640 1 -- 172.21.15.70:0/459500030 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fea240752d0 con 0x7fea38145670 2024-09-13T16:01:16.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.524+0000 7fea3ea00640 1 -- 172.21.15.70:0/459500030 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fea38071a40 con 0x7fea38145670 2024-09-13T16:01:16.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.525+0000 7fea2fe00640 1 -- 172.21.15.70:0/459500030 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fea240788f0 con 0x7fea38145670 2024-09-13T16:01:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:16.526 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2024-09-13T16:01:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:01:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: "poolnum": 1, 2024-09-13T16:01:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "poolname": ".mgr" 2024-09-13T16:01:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:01:16.527 INFO:teuthology.orchestra.run.smithi070.stdout:] 2024-09-13T16:01:16.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.527+0000 7fea3ea00640 1 -- 172.21.15.70:0/459500030 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fea1806ac00 msgr2=0x7fea1806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:16.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.527+0000 7fea3ea00640 1 --2- 172.21.15.70:0/459500030 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fea1806ac00 0x7fea1806d0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fea28000f60 tx=0x7fea28007d50 comp rx=0 tx=0).stop 2024-09-13T16:01:16.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.527+0000 7fea3ea00640 1 -- 172.21.15.70:0/459500030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea38145670 msgr2=0x7fea3813e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:16.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.527+0000 7fea3ea00640 1 --2- 172.21.15.70:0/459500030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea38145670 0x7fea3813e840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fea24000c00 tx=0x7fea240046c0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.527+0000 7fea3ea00640 1 -- 172.21.15.70:0/459500030 shutdown_connections 2024-09-13T16:01:16.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.527+0000 7fea3ea00640 1 --2- 172.21.15.70:0/459500030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea38145a50 0x7fea3813ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.527+0000 7fea3ea00640 1 --2- 172.21.15.70:0/459500030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea38145670 0x7fea3813e840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.527+0000 7fea3ea00640 1 --2- 172.21.15.70:0/459500030 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fea1806ac00 0x7fea1806d0c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.527+0000 7fea3ea00640 1 --2- 172.21.15.70:0/459500030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea380b3bb0 0x7fea380c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.527+0000 7fea3ea00640 1 -- 172.21.15.70:0/459500030 >> 172.21.15.70:0/459500030 conn(0x7fea3806afe0 msgr2=0x7fea380b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:16.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.527+0000 7fea3ea00640 1 -- 172.21.15.70:0/459500030 shutdown_connections 2024-09-13T16:01:16.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.527+0000 7fea3ea00640 1 -- 172.21.15.70:0/459500030 wait complete. 2024-09-13T16:01:16.544 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T16:01:16.545 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T16:01:16.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.699+0000 7f64a7200640 1 Processor -- start 2024-09-13T16:01:16.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.699+0000 7f64a7200640 1 -- start start 2024-09-13T16:01:16.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.700+0000 7f64a7200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f64a8144020 0x7f64a806ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:16.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.700+0000 7f64a7200640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a8144400 con 0x7f64a80adc30 2024-09-13T16:01:16.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.700+0000 7f64a7200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a80cc4e0 con 0x7f64a8071320 2024-09-13T16:01:16.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.700+0000 7f64a7200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a815ef60 con 0x7f64a8144020 2024-09-13T16:01:16.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.700+0000 7f64a6800640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f64a80adc30 0x7f64a815e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39402/0 (socket says 172.21.15.70:39402) 2024-09-13T16:01:16.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.700+0000 7f64a5e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f64a8144020 0x7f64a806ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:16.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.700+0000 7f64a6800640 1 -- 172.21.15.70:0/3919604250 learned_addr learned my addr 172.21.15.70:0/3919604250 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:16.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.701+0000 7f64a5e00640 1 -- 172.21.15.70:0/3919604250 >> v1:172.21.15.107:6789/0 conn(0x7f64a8071320 legacy=0x7f64a815e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:16.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.701+0000 7f64a5e00640 1 -- 172.21.15.70:0/3919604250 >> v1:172.21.15.70:6789/0 conn(0x7f64a80adc30 legacy=0x7f64a815e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:16.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.701+0000 7f64a5400640 1 -- 172.21.15.70:0/3919604250 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370976939 0 0) 0x7f64a80cc4e0 con 0x7f64a8071320 2024-09-13T16:01:16.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.701+0000 7f64a5e00640 1 -- 172.21.15.70:0/3919604250 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a806fe50 con 0x7f64a8144020 2024-09-13T16:01:16.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.702+0000 7f64a5e00640 1 --2- 172.21.15.70:0/3919604250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8144020 0x7f64a806ca50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f64980097a0 tx=0x7f649802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560477f1a6ac9f23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.702+0000 7f64a5400640 1 -- 172.21.15.70:0/3919604250 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6498032440 con 0x7f64a8144020 2024-09-13T16:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.702+0000 7f64a5400640 1 -- 172.21.15.70:0/3919604250 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64980325a0 con 0x7f64a8144020 2024-09-13T16:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.702+0000 7f64a5400640 1 -- 172.21.15.70:0/3919604250 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6498032930 con 0x7f64a8144020 2024-09-13T16:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.702+0000 7f64a7200640 1 -- 172.21.15.70:0/3919604250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8144020 msgr2=0x7f64a806ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.702+0000 7f64a7200640 1 --2- 172.21.15.70:0/3919604250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8144020 0x7f64a806ca50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f64980097a0 tx=0x7f649802a1a0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.702+0000 7f64a7200640 1 -- 172.21.15.70:0/3919604250 shutdown_connections 2024-09-13T16:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.702+0000 7f64a7200640 1 --2- 172.21.15.70:0/3919604250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8144020 0x7f64a806ca50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.702+0000 7f64a7200640 1 -- 172.21.15.70:0/3919604250 >> 172.21.15.70:0/3919604250 conn(0x7f64a80b0300 msgr2=0x7f64a80b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.702+0000 7f64a7200640 1 -- 172.21.15.70:0/3919604250 shutdown_connections 2024-09-13T16:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.703+0000 7f64a7200640 1 -- 172.21.15.70:0/3919604250 wait complete. 2024-09-13T16:01:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.704+0000 7f64a7200640 1 Processor -- start 2024-09-13T16:01:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.704+0000 7f64a7200640 1 -- start start 2024-09-13T16:01:16.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.705+0000 7f64a7200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a8071320 0x7f64a813b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:16.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.705+0000 7f64a7200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64a80adc30 0x7f64a80acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:16.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.705+0000 7f64a7200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8144020 0x7f64a8159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:16.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.705+0000 7f64a7200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a813be80 con 0x7f64a8144020 2024-09-13T16:01:16.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.705+0000 7f64a7200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a813aba0 con 0x7f64a80adc30 2024-09-13T16:01:16.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.705+0000 7f64a7200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a813ae80 con 0x7f64a8071320 2024-09-13T16:01:16.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.705+0000 7f64a6800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8144020 0x7f64a8159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.705+0000 7f64a6800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8144020 0x7f64a8159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40118/0 (socket says 172.21.15.70:40118) 2024-09-13T16:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.705+0000 7f64a6800640 1 -- 172.21.15.70:0/2380671195 learned_addr learned my addr 172.21.15.70:0/2380671195 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.705+0000 7f649d400640 1 --2- 172.21.15.70:0/2380671195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64a80adc30 0x7f64a80acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.705+0000 7f64a5e00640 1 --2- 172.21.15.70:0/2380671195 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a8071320 0x7f64a813b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.706+0000 7f64a6800640 1 -- 172.21.15.70:0/2380671195 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a8071320 msgr2=0x7f64a813b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.706+0000 7f64a6800640 1 --2- 172.21.15.70:0/2380671195 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a8071320 0x7f64a813b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.706+0000 7f64a6800640 1 -- 172.21.15.70:0/2380671195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64a80adc30 msgr2=0x7f64a80acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.706+0000 7f64a6800640 1 --2- 172.21.15.70:0/2380671195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64a80adc30 0x7f64a80acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.706+0000 7f64a6800640 1 -- 172.21.15.70:0/2380671195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6498009400 con 0x7f64a8144020 2024-09-13T16:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.706+0000 7f649d400640 1 --2- 172.21.15.70:0/2380671195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64a80adc30 0x7f64a80acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.706+0000 7f64a6800640 1 --2- 172.21.15.70:0/2380671195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8144020 0x7f64a8159930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f64a000cbc0 tx=0x7f64a000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.706+0000 7f649ea00640 1 -- 172.21.15.70:0/2380671195 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a000ad40 con 0x7f64a8144020 2024-09-13T16:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.706+0000 7f649ea00640 1 -- 172.21.15.70:0/2380671195 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a0012400 con 0x7f64a8144020 2024-09-13T16:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.706+0000 7f649ea00640 1 -- 172.21.15.70:0/2380671195 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a000aea0 con 0x7f64a8144020 2024-09-13T16:01:16.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.706+0000 7f64a7200640 1 -- 172.21.15.70:0/2380671195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a813b160 con 0x7f64a8144020 2024-09-13T16:01:16.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.706+0000 7f64a7200640 1 -- 172.21.15.70:0/2380671195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a80b2710 con 0x7f64a8144020 2024-09-13T16:01:16.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.707+0000 7f64a7200640 1 -- 172.21.15.70:0/2380671195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a806ca50 con 0x7f64a8144020 2024-09-13T16:01:16.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.708+0000 7f649ea00640 1 -- 172.21.15.70:0/2380671195 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f64a0007070 con 0x7f64a8144020 2024-09-13T16:01:16.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.709+0000 7f649ea00640 1 --2- 172.21.15.70:0/2380671195 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f648406ac00 0x7f648406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:16.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.709+0000 7f649ea00640 1 -- 172.21.15.70:0/2380671195 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f64a0088ef0 con 0x7f64a8144020 2024-09-13T16:01:16.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.709+0000 7f64a5e00640 1 --2- 172.21.15.70:0/2380671195 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f648406ac00 0x7f648406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:16.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.710+0000 7f64a5e00640 1 --2- 172.21.15.70:0/2380671195 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f648406ac00 0x7f648406d0c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6498034000 tx=0x7f649802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:16.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.713+0000 7f649ea00640 1 -- 172.21.15.70:0/2380671195 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f64a0054430 con 0x7f64a8144020 2024-09-13T16:01:16.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:16.882+0000 7f64a7200640 1 -- 172.21.15.70:0/2380671195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f64a80ce1f0 con 0x7f64a8144020 2024-09-13T16:01:17.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.176+0000 7f649ea00640 1 -- 172.21.15.70:0/2380671195 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f64a00170b0 con 0x7f64a8144020 2024-09-13T16:01:17.177 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' created 2024-09-13T16:01:17.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.179+0000 7f64a7200640 1 -- 172.21.15.70:0/2380671195 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f648406ac00 msgr2=0x7f648406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:17.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.179+0000 7f64a7200640 1 --2- 172.21.15.70:0/2380671195 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f648406ac00 0x7f648406d0c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6498034000 tx=0x7f649802e000 comp rx=0 tx=0).stop 2024-09-13T16:01:17.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.179+0000 7f64a7200640 1 -- 172.21.15.70:0/2380671195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8144020 msgr2=0x7f64a8159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:17.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.179+0000 7f64a7200640 1 --2- 172.21.15.70:0/2380671195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8144020 0x7f64a8159930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f64a000cbc0 tx=0x7f64a000a430 comp rx=0 tx=0).stop 2024-09-13T16:01:17.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.179+0000 7f64a7200640 1 -- 172.21.15.70:0/2380671195 shutdown_connections 2024-09-13T16:01:17.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.179+0000 7f64a7200640 1 --2- 172.21.15.70:0/2380671195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8144020 0x7f64a8159930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:17.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.179+0000 7f64a7200640 1 --2- 172.21.15.70:0/2380671195 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f648406ac00 0x7f648406d0c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:17.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.179+0000 7f64a7200640 1 --2- 172.21.15.70:0/2380671195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64a80adc30 0x7f64a80acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:17.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.179+0000 7f64a7200640 1 --2- 172.21.15.70:0/2380671195 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a8071320 0x7f64a813b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:17.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.179+0000 7f64a7200640 1 -- 172.21.15.70:0/2380671195 >> 172.21.15.70:0/2380671195 conn(0x7f64a80b0300 msgr2=0x7f64a806cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:17.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.179+0000 7f64a7200640 1 -- 172.21.15.70:0/2380671195 shutdown_connections 2024-09-13T16:01:17.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.180+0000 7f64a7200640 1 -- 172.21.15.70:0/2380671195 wait complete. 2024-09-13T16:01:17.200 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T16:01:17.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.357+0000 7fad09800640 1 Processor -- start 2024-09-13T16:01:17.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.357+0000 7fad09800640 1 -- start start 2024-09-13T16:01:17.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.358+0000 7fad09800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad04154ad0 0x7fad040cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:17.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.358+0000 7fad09800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fad0406f830 0x7fad0406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:17.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.359+0000 7fad09800640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0406b7c0 con 0x7fad040ce2c0 2024-09-13T16:01:17.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.359+0000 7fad09800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0406b5b0 con 0x7fad0406f830 2024-09-13T16:01:17.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.359+0000 7fad09800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0406baa0 con 0x7fad04154ad0 2024-09-13T16:01:17.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.359+0000 7fad02000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fad0406f830 0x7fad0406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:17.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.359+0000 7fad03400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fad040ce2c0 0x7fad040cbac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39410/0 (socket says 172.21.15.70:39410) 2024-09-13T16:01:17.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.359+0000 7fad03400640 1 -- 172.21.15.70:0/2667643455 learned_addr learned my addr 172.21.15.70:0/2667643455 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:17.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.359+0000 7fad02a00640 1 --2- 172.21.15.70:0/2667643455 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad04154ad0 0x7fad040cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:17.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.359+0000 7fad02000640 1 -- 172.21.15.70:0/2667643455 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad04154ad0 msgr2=0x7fad040cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:17.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.359+0000 7fad02000640 1 --2- 172.21.15.70:0/2667643455 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad04154ad0 0x7fad040cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:17.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.359+0000 7fad02000640 1 -- 172.21.15.70:0/2667643455 >> v1:172.21.15.70:6789/0 conn(0x7fad040ce2c0 legacy=0x7fad040cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:17.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.359+0000 7fad02000640 1 -- 172.21.15.70:0/2667643455 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0406bd80 con 0x7fad0406f830 2024-09-13T16:01:17.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.359+0000 7fad01600640 1 -- 172.21.15.70:0/2667643455 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201785637 0 0) 0x7fad0406b7c0 con 0x7fad040ce2c0 2024-09-13T16:01:17.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.359+0000 7fad02a00640 1 --2- 172.21.15.70:0/2667643455 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad04154ad0 0x7fad040cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:17.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.360+0000 7fad02000640 1 --2- 172.21.15.70:0/2667643455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad0406f830 0x7fad0406fee0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7facf00097d0 tx=0x7facf002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7d6ec935f4893e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:17.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.361+0000 7fad01600640 1 -- 172.21.15.70:0/2667643455 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf002ae40 con 0x7fad0406f830 2024-09-13T16:01:17.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.361+0000 7fad01600640 1 -- 172.21.15.70:0/2667643455 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf0032440 con 0x7fad0406f830 2024-09-13T16:01:17.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.361+0000 7fad01600640 1 -- 172.21.15.70:0/2667643455 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00327d0 con 0x7fad0406f830 2024-09-13T16:01:17.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.361+0000 7fad09800640 1 -- 172.21.15.70:0/2667643455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad0406f830 msgr2=0x7fad0406fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:17.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.361+0000 7fad09800640 1 --2- 172.21.15.70:0/2667643455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad0406f830 0x7fad0406fee0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7facf00097d0 tx=0x7facf002a130 comp rx=0 tx=0).stop 2024-09-13T16:01:17.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.361+0000 7fad09800640 1 -- 172.21.15.70:0/2667643455 shutdown_connections 2024-09-13T16:01:17.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.361+0000 7fad09800640 1 --2- 172.21.15.70:0/2667643455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad0406f830 0x7fad0406fee0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:17.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.361+0000 7fad09800640 1 --2- 172.21.15.70:0/2667643455 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad04154ad0 0x7fad040cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:17.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.361+0000 7fad09800640 1 -- 172.21.15.70:0/2667643455 >> 172.21.15.70:0/2667643455 conn(0x7fad040b0580 msgr2=0x7fad040b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:17.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.361+0000 7fad09800640 1 -- 172.21.15.70:0/2667643455 shutdown_connections 2024-09-13T16:01:17.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.361+0000 7fad09800640 1 -- 172.21.15.70:0/2667643455 wait complete. 2024-09-13T16:01:17.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.363+0000 7fad09800640 1 Processor -- start 2024-09-13T16:01:17.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.363+0000 7fad09800640 1 -- start start 2024-09-13T16:01:17.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.364+0000 7fad09800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad04154ad0 0x7fad04153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:17.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.364+0000 7fad09800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad04153190 0x7fad0415d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:17.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.364+0000 7fad09800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad041404f0 0x7fad0415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:17.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.364+0000 7fad09800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad040b1df0 con 0x7fad04153190 2024-09-13T16:01:17.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.364+0000 7fad09800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad040b20d0 con 0x7fad041404f0 2024-09-13T16:01:17.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.364+0000 7fad09800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad040b23b0 con 0x7fad04154ad0 2024-09-13T16:01:17.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.364+0000 7fad02000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad04153190 0x7fad0415d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:17.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.364+0000 7fad02000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad04153190 0x7fad0415d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40134/0 (socket says 172.21.15.70:40134) 2024-09-13T16:01:17.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.364+0000 7fad02000640 1 -- 172.21.15.70:0/10926573 learned_addr learned my addr 172.21.15.70:0/10926573 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:17.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.364+0000 7fad02a00640 1 --2- 172.21.15.70:0/10926573 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad04154ad0 0x7fad04153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:17.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.364+0000 7fad03400640 1 --2- 172.21.15.70:0/10926573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad041404f0 0x7fad0415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:17.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.364+0000 7fad02000640 1 -- 172.21.15.70:0/10926573 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad04154ad0 msgr2=0x7fad04153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:17.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.364+0000 7fad02000640 1 --2- 172.21.15.70:0/10926573 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad04154ad0 0x7fad04153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:17.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.364+0000 7fad02000640 1 -- 172.21.15.70:0/10926573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad041404f0 msgr2=0x7fad0415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:17.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.364+0000 7fad02000640 1 --2- 172.21.15.70:0/10926573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad041404f0 0x7fad0415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:17.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.364+0000 7fad02000640 1 -- 172.21.15.70:0/10926573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf0009400 con 0x7fad04153190 2024-09-13T16:01:17.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.365+0000 7fad02000640 1 --2- 172.21.15.70:0/10926573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad04153190 0x7fad0415d290 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7facf0000c00 tx=0x7facf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:17.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.365+0000 7facfaa00640 1 -- 172.21.15.70:0/10926573 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0004230 con 0x7fad04153190 2024-09-13T16:01:17.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.365+0000 7facfaa00640 1 -- 172.21.15.70:0/10926573 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf0004390 con 0x7fad04153190 2024-09-13T16:01:17.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.365+0000 7fad09800640 1 -- 172.21.15.70:0/10926573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad040b2690 con 0x7fad04153190 2024-09-13T16:01:17.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.365+0000 7facfaa00640 1 -- 172.21.15.70:0/10926573 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0030b40 con 0x7fad04153190 2024-09-13T16:01:17.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.365+0000 7fad09800640 1 -- 172.21.15.70:0/10926573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad040b1980 con 0x7fad04153190 2024-09-13T16:01:17.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.366+0000 7fad09800640 1 -- 172.21.15.70:0/10926573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad040b2bb0 con 0x7fad04153190 2024-09-13T16:01:17.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.367+0000 7facfaa00640 1 -- 172.21.15.70:0/10926573 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7facf0039050 con 0x7fad04153190 2024-09-13T16:01:17.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.368+0000 7facfaa00640 1 --2- 172.21.15.70:0/10926573 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7face406ac30 0x7face406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:17.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.368+0000 7facfaa00640 1 -- 172.21.15.70:0/10926573 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7facf00a9dc0 con 0x7fad04153190 2024-09-13T16:01:17.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.368+0000 7fad02a00640 1 --2- 172.21.15.70:0/10926573 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7face406ac30 0x7face406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:17.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.369+0000 7fad02a00640 1 --2- 172.21.15.70:0/10926573 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7face406ac30 0x7face406d0f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7facf4006fd0 tx=0x7facf4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:17.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.372+0000 7facfaa00640 1 -- 172.21.15.70:0/10926573 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7facf00751f0 con 0x7fad04153190 2024-09-13T16:01:17.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:17.541+0000 7fad09800640 1 -- 172.21.15.70:0/10926573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fad040b2bb0 con 0x7fad04153190 2024-09-13T16:01:18.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.183+0000 7facfaa00640 1 -- 172.21.15.70:0/10926573 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fad040b2bb0 con 0x7fad04153190 2024-09-13T16:01:18.184 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' created 2024-09-13T16:01:18.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.188+0000 7fad09800640 1 -- 172.21.15.70:0/10926573 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7face406ac30 msgr2=0x7face406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:18.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.188+0000 7fad09800640 1 --2- 172.21.15.70:0/10926573 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7face406ac30 0x7face406d0f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7facf4006fd0 tx=0x7facf4008040 comp rx=0 tx=0).stop 2024-09-13T16:01:18.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.188+0000 7fad09800640 1 -- 172.21.15.70:0/10926573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad04153190 msgr2=0x7fad0415d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:18.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.188+0000 7fad09800640 1 --2- 172.21.15.70:0/10926573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad04153190 0x7fad0415d290 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7facf0000c00 tx=0x7facf00046c0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.191+0000 7fad09800640 1 -- 172.21.15.70:0/10926573 shutdown_connections 2024-09-13T16:01:18.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.191+0000 7fad09800640 1 --2- 172.21.15.70:0/10926573 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7face406ac30 0x7face406d0f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.191+0000 7fad09800640 1 --2- 172.21.15.70:0/10926573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad041404f0 0x7fad0415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.191+0000 7fad09800640 1 --2- 172.21.15.70:0/10926573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad04153190 0x7fad0415d290 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.191+0000 7fad09800640 1 --2- 172.21.15.70:0/10926573 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad04154ad0 0x7fad04153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.191+0000 7fad09800640 1 -- 172.21.15.70:0/10926573 >> 172.21.15.70:0/10926573 conn(0x7fad040b0580 msgr2=0x7fad04070330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:18.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.192+0000 7fad09800640 1 -- 172.21.15.70:0/10926573 shutdown_connections 2024-09-13T16:01:18.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.192+0000 7fad09800640 1 -- 172.21.15.70:0/10926573 wait complete. 2024-09-13T16:01:18.219 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T16:01:18.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.371+0000 7f0001000640 1 Processor -- start 2024-09-13T16:01:18.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.371+0000 7f0001000640 1 -- start start 2024-09-13T16:01:18.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.373+0000 7f0001000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efffc0cafa0 0x7efffc15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:18.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.373+0000 7f0001000640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc06f5f0 con 0x7efffc071690 2024-09-13T16:01:18.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.373+0000 7f0001000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc070450 con 0x7efffc156f60 2024-09-13T16:01:18.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.373+0000 7f0001000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efffc15aa30 con 0x7efffc0cafa0 2024-09-13T16:01:18.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.373+0000 7efff9400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7efffc071690 0x7efffc0cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39424/0 (socket says 172.21.15.70:39424) 2024-09-13T16:01:18.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.373+0000 7efff9400640 1 -- 172.21.15.70:0/1699825768 learned_addr learned my addr 172.21.15.70:0/1699825768 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:18.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.373+0000 7efffa800640 1 --2- 172.21.15.70:0/1699825768 >> v2:172.21.15.107:3300/0 conn(0x7efffc0cafa0 0x7efffc15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:18.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.373+0000 7efff8a00640 1 -- 172.21.15.70:0/1699825768 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95798361 0 0) 0x7efffc06f5f0 con 0x7efffc071690 2024-09-13T16:01:18.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.373+0000 7efff8a00640 1 -- 172.21.15.70:0/1699825768 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effe0003520 con 0x7efffc071690 2024-09-13T16:01:18.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.373+0000 7efff8a00640 1 -- 172.21.15.70:0/1699825768 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496899568 0 0) 0x7efffc070450 con 0x7efffc156f60 2024-09-13T16:01:18.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.374+0000 7efff8a00640 1 -- 172.21.15.70:0/1699825768 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efffc06f5f0 con 0x7efffc156f60 2024-09-13T16:01:18.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.374+0000 7efff8a00640 1 -- 172.21.15.70:0/1699825768 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3679538236 0 0) 0x7effe0003520 con 0x7efffc071690 2024-09-13T16:01:18.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.374+0000 7efffa800640 1 -- 172.21.15.70:0/1699825768 >> v1:172.21.15.107:6789/0 conn(0x7efffc156f60 legacy=0x7efffc070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:18.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.374+0000 7efffa800640 1 -- 172.21.15.70:0/1699825768 >> v1:172.21.15.70:6789/0 conn(0x7efffc071690 legacy=0x7efffc0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:18.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.374+0000 7efffa800640 1 -- 172.21.15.70:0/1699825768 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc06f840 con 0x7efffc0cafa0 2024-09-13T16:01:18.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.375+0000 7efffa800640 1 --2- 172.21.15.70:0/1699825768 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efffc0cafa0 0x7efffc15a4f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efff4009d90 tx=0x7efff402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4198060ac10a686a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:18.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.375+0000 7efff8a00640 1 -- 172.21.15.70:0/1699825768 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe8001670 con 0x7efffc0cafa0 2024-09-13T16:01:18.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.375+0000 7efff8a00640 1 -- 172.21.15.70:0/1699825768 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff402d050 con 0x7efffc0cafa0 2024-09-13T16:01:18.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.375+0000 7efff8a00640 1 -- 172.21.15.70:0/1699825768 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4007760 con 0x7efffc0cafa0 2024-09-13T16:01:18.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.375+0000 7f0001000640 1 -- 172.21.15.70:0/1699825768 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efffc0cafa0 msgr2=0x7efffc15a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:18.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.375+0000 7f0001000640 1 --2- 172.21.15.70:0/1699825768 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efffc0cafa0 0x7efffc15a4f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efff4009d90 tx=0x7efff402a680 comp rx=0 tx=0).stop 2024-09-13T16:01:18.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.376+0000 7f0001000640 1 -- 172.21.15.70:0/1699825768 shutdown_connections 2024-09-13T16:01:18.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.376+0000 7f0001000640 1 --2- 172.21.15.70:0/1699825768 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efffc0cafa0 0x7efffc15a4f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.376+0000 7f0001000640 1 -- 172.21.15.70:0/1699825768 >> 172.21.15.70:0/1699825768 conn(0x7efffc0b0580 msgr2=0x7efffc0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:18.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.376+0000 7f0001000640 1 -- 172.21.15.70:0/1699825768 shutdown_connections 2024-09-13T16:01:18.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.376+0000 7f0001000640 1 -- 172.21.15.70:0/1699825768 wait complete. 2024-09-13T16:01:18.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.377+0000 7f0001000640 1 Processor -- start 2024-09-13T16:01:18.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.377+0000 7f0001000640 1 -- start start 2024-09-13T16:01:18.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.378+0000 7f0001000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efffc071690 0x7efffc15d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:18.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.378+0000 7f0001000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efffc0cafa0 0x7efffc0af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:18.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.378+0000 7f0001000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efffc156f60 0x7efffc0b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:18.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.378+0000 7f0001000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc142fd0 con 0x7efffc071690 2024-09-13T16:01:18.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.378+0000 7f0001000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc15c560 con 0x7efffc0cafa0 2024-09-13T16:01:18.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.378+0000 7f0001000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efffc15c840 con 0x7efffc156f60 2024-09-13T16:01:18.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.378+0000 7efff9e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efffc071690 0x7efffc15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:18.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.379+0000 7efff9e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efffc071690 0x7efffc15d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40142/0 (socket says 172.21.15.70:40142) 2024-09-13T16:01:18.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.379+0000 7efff9e00640 1 -- 172.21.15.70:0/3851299888 learned_addr learned my addr 172.21.15.70:0/3851299888 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:18.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.379+0000 7efff9e00640 1 -- 172.21.15.70:0/3851299888 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efffc156f60 msgr2=0x7efffc0b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:18.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.379+0000 7efff9e00640 1 --2- 172.21.15.70:0/3851299888 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efffc156f60 0x7efffc0b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.379+0000 7efff9e00640 1 -- 172.21.15.70:0/3851299888 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efffc0cafa0 msgr2=0x7efffc0af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:18.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.379+0000 7efff9e00640 1 --2- 172.21.15.70:0/3851299888 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efffc0cafa0 0x7efffc0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.379+0000 7efff9e00640 1 -- 172.21.15.70:0/3851299888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff4009a70 con 0x7efffc071690 2024-09-13T16:01:18.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.379+0000 7efff9e00640 1 --2- 172.21.15.70:0/3851299888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efffc071690 0x7efffc15d040 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7effec00c430 tx=0x7effec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:18.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.379+0000 7efff2000640 1 -- 172.21.15.70:0/3851299888 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec0052d0 con 0x7efffc071690 2024-09-13T16:01:18.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.379+0000 7efff2000640 1 -- 172.21.15.70:0/3851299888 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec005450 con 0x7efffc071690 2024-09-13T16:01:18.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.380+0000 7f0001000640 1 -- 172.21.15.70:0/3851299888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efffc15cb20 con 0x7efffc071690 2024-09-13T16:01:18.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.380+0000 7efff2000640 1 -- 172.21.15.70:0/3851299888 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec003830 con 0x7efffc071690 2024-09-13T16:01:18.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.380+0000 7f0001000640 1 -- 172.21.15.70:0/3851299888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efffc15c210 con 0x7efffc071690 2024-09-13T16:01:18.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.381+0000 7f0001000640 1 -- 172.21.15.70:0/3851299888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efffc15cd10 con 0x7efffc071690 2024-09-13T16:01:18.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.382+0000 7efff2000640 1 -- 172.21.15.70:0/3851299888 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7effec003990 con 0x7efffc071690 2024-09-13T16:01:18.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.383+0000 7efff2000640 1 --2- 172.21.15.70:0/3851299888 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7effdc06ac00 0x7effdc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:18.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.383+0000 7efff2000640 1 -- 172.21.15.70:0/3851299888 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7effec0889f0 con 0x7efffc071690 2024-09-13T16:01:18.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.383+0000 7efff9400640 1 --2- 172.21.15.70:0/3851299888 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7effdc06ac00 0x7effdc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:18.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.383+0000 7efff9400640 1 --2- 172.21.15.70:0/3851299888 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7effdc06ac00 0x7effdc06d0c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efffc06ca40 tx=0x7effe8001230 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:18.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.387+0000 7efff2000640 1 -- 172.21.15.70:0/3851299888 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7effec053b90 con 0x7efffc071690 2024-09-13T16:01:18.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.591+0000 7f0001000640 1 -- 172.21.15.70:0/3851299888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7efffc0b0e30 con 0x7efffc071690 2024-09-13T16:01:18.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.597+0000 7efff2000640 1 -- 172.21.15.70:0/3851299888 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7effec0170c0 con 0x7efffc071690 2024-09-13T16:01:18.599 INFO:teuthology.orchestra.run.smithi070.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T16:01:18.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.602+0000 7f0001000640 1 -- 172.21.15.70:0/3851299888 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7effdc06ac00 msgr2=0x7effdc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:18.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.602+0000 7f0001000640 1 --2- 172.21.15.70:0/3851299888 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7effdc06ac00 0x7effdc06d0c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efffc06ca40 tx=0x7effe8001230 comp rx=0 tx=0).stop 2024-09-13T16:01:18.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.602+0000 7f0001000640 1 -- 172.21.15.70:0/3851299888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efffc071690 msgr2=0x7efffc15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:18.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.602+0000 7f0001000640 1 --2- 172.21.15.70:0/3851299888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efffc071690 0x7efffc15d040 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7effec00c430 tx=0x7effec00c8f0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.602+0000 7f0001000640 1 -- 172.21.15.70:0/3851299888 shutdown_connections 2024-09-13T16:01:18.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.602+0000 7f0001000640 1 --2- 172.21.15.70:0/3851299888 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efffc156f60 0x7efffc0b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.602+0000 7f0001000640 1 --2- 172.21.15.70:0/3851299888 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7effdc06ac00 0x7effdc06d0c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.602+0000 7f0001000640 1 --2- 172.21.15.70:0/3851299888 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efffc0cafa0 0x7efffc0af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.602+0000 7f0001000640 1 --2- 172.21.15.70:0/3851299888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efffc071690 0x7efffc15d040 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.602+0000 7f0001000640 1 -- 172.21.15.70:0/3851299888 >> 172.21.15.70:0/3851299888 conn(0x7efffc0b0580 msgr2=0x7efffc0cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:18.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.602+0000 7f0001000640 1 -- 172.21.15.70:0/3851299888 shutdown_connections 2024-09-13T16:01:18.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.602+0000 7f0001000640 1 -- 172.21.15.70:0/3851299888 wait complete. 2024-09-13T16:01:18.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:18.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.784+0000 7efd6e200640 1 Processor -- start 2024-09-13T16:01:18.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.784+0000 7efd6e200640 1 -- start start 2024-09-13T16:01:18.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.785+0000 7efd6e200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efd680b1b00 0x7efd680cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:18.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.785+0000 7efd6e200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efd680cde50 0x7efd6815a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:18.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.785+0000 7efd6e200640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6806bea0 con 0x7efd6815a520 2024-09-13T16:01:18.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.785+0000 7efd6e200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6806c180 con 0x7efd680b1b00 2024-09-13T16:01:18.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.785+0000 7efd6e200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6806c460 con 0x7efd680cde50 2024-09-13T16:01:18.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.785+0000 7efd66a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efd680b1b00 0x7efd680cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:18.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.786+0000 7efd67400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7efd6815a520 0x7efd6806b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39440/0 (socket says 172.21.15.70:39440) 2024-09-13T16:01:18.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.786+0000 7efd67400640 1 -- 172.21.15.70:0/1215437321 learned_addr learned my addr 172.21.15.70:0/1215437321 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:18.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.786+0000 7efd67e00640 1 --2- 172.21.15.70:0/1215437321 >> v2:172.21.15.107:3300/0 conn(0x7efd680cde50 0x7efd6815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:18.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.786+0000 7efd66000640 1 -- 172.21.15.70:0/1215437321 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759476138 0 0) 0x7efd6806bea0 con 0x7efd6815a520 2024-09-13T16:01:18.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.786+0000 7efd66000640 1 -- 172.21.15.70:0/1215437321 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd4c003520 con 0x7efd6815a520 2024-09-13T16:01:18.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.786+0000 7efd66a00640 1 -- 172.21.15.70:0/1215437321 >> v2:172.21.15.107:3300/0 conn(0x7efd680cde50 msgr2=0x7efd6815a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:18.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.786+0000 7efd66a00640 1 --2- 172.21.15.70:0/1215437321 >> v2:172.21.15.107:3300/0 conn(0x7efd680cde50 0x7efd6815a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.786+0000 7efd66a00640 1 -- 172.21.15.70:0/1215437321 >> v1:172.21.15.70:6789/0 conn(0x7efd6815a520 legacy=0x7efd6806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:18.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.786+0000 7efd66a00640 1 -- 172.21.15.70:0/1215437321 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6806c740 con 0x7efd680b1b00 2024-09-13T16:01:18.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.787+0000 7efd66a00640 1 --2- 172.21.15.70:0/1215437321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680b1b00 0x7efd680cd910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efd680cc5f0 tx=0x7efd5402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870277b349f988c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:18.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.787+0000 7efd66000640 1 -- 172.21.15.70:0/1215437321 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54032440 con 0x7efd680b1b00 2024-09-13T16:01:18.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.787+0000 7efd66000640 1 -- 172.21.15.70:0/1215437321 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd540325a0 con 0x7efd680b1b00 2024-09-13T16:01:18.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.787+0000 7efd66000640 1 -- 172.21.15.70:0/1215437321 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54032930 con 0x7efd680b1b00 2024-09-13T16:01:18.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.788+0000 7efd6e200640 1 -- 172.21.15.70:0/1215437321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680b1b00 msgr2=0x7efd680cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:18.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.788+0000 7efd6e200640 1 --2- 172.21.15.70:0/1215437321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680b1b00 0x7efd680cd910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efd680cc5f0 tx=0x7efd5402a1a0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.788+0000 7efd6e200640 1 -- 172.21.15.70:0/1215437321 shutdown_connections 2024-09-13T16:01:18.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.788+0000 7efd6e200640 1 --2- 172.21.15.70:0/1215437321 >> v2:172.21.15.107:3300/0 conn(0x7efd680cde50 0x7efd6815a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.788+0000 7efd6e200640 1 --2- 172.21.15.70:0/1215437321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680b1b00 0x7efd680cd910 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.788+0000 7efd6e200640 1 -- 172.21.15.70:0/1215437321 >> 172.21.15.70:0/1215437321 conn(0x7efd680b0510 msgr2=0x7efd680b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:18.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.788+0000 7efd6e200640 1 -- 172.21.15.70:0/1215437321 shutdown_connections 2024-09-13T16:01:18.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.788+0000 7efd6e200640 1 -- 172.21.15.70:0/1215437321 wait complete. 2024-09-13T16:01:18.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.789+0000 7efd6e200640 1 Processor -- start 2024-09-13T16:01:18.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.790+0000 7efd6e200640 1 -- start start 2024-09-13T16:01:18.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.790+0000 7efd6e200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680b1b00 0x7efd68147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:18.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.791+0000 7efd6e200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd680cde50 0x7efd6814a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:18.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.791+0000 7efd6e200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd6815a520 0x7efd680ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:18.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.791+0000 7efd6e200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6814dd50 con 0x7efd680b1b00 2024-09-13T16:01:18.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.791+0000 7efd6e200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd68147b60 con 0x7efd680cde50 2024-09-13T16:01:18.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.791+0000 7efd6e200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6814ade0 con 0x7efd6815a520 2024-09-13T16:01:18.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.791+0000 7efd67400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680b1b00 0x7efd68147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:18.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.791+0000 7efd67400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680b1b00 0x7efd68147620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40166/0 (socket says 172.21.15.70:40166) 2024-09-13T16:01:18.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.791+0000 7efd67400640 1 -- 172.21.15.70:0/2284890599 learned_addr learned my addr 172.21.15.70:0/2284890599 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:18.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.791+0000 7efd66a00640 1 --2- 172.21.15.70:0/2284890599 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd680cde50 0x7efd6814a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:18.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.791+0000 7efd67400640 1 -- 172.21.15.70:0/2284890599 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd6815a520 msgr2=0x7efd680ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:18.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.791+0000 7efd67400640 1 --2- 172.21.15.70:0/2284890599 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd6815a520 0x7efd680ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.791+0000 7efd67400640 1 -- 172.21.15.70:0/2284890599 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd680cde50 msgr2=0x7efd6814a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:18.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.791+0000 7efd67400640 1 --2- 172.21.15.70:0/2284890599 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd680cde50 0x7efd6814a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.791+0000 7efd67400640 1 -- 172.21.15.70:0/2284890599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd54009400 con 0x7efd680b1b00 2024-09-13T16:01:18.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.791+0000 7efd67400640 1 --2- 172.21.15.70:0/2284890599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680b1b00 0x7efd68147620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efd5800c390 tx=0x7efd5800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:18.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.792+0000 7efd5f400640 1 -- 172.21.15.70:0/2284890599 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd58005ce0 con 0x7efd680b1b00 2024-09-13T16:01:18.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.792+0000 7efd5f400640 1 -- 172.21.15.70:0/2284890599 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd58005e40 con 0x7efd680b1b00 2024-09-13T16:01:18.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.792+0000 7efd5f400640 1 -- 172.21.15.70:0/2284890599 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd58007310 con 0x7efd680b1b00 2024-09-13T16:01:18.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.792+0000 7efd6e200640 1 -- 172.21.15.70:0/2284890599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd680707d0 con 0x7efd680b1b00 2024-09-13T16:01:18.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.792+0000 7efd6e200640 1 -- 172.21.15.70:0/2284890599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd68070d90 con 0x7efd680b1b00 2024-09-13T16:01:18.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.793+0000 7efd6e200640 1 -- 172.21.15.70:0/2284890599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd680b08f0 con 0x7efd680b1b00 2024-09-13T16:01:18.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.794+0000 7efd5f400640 1 -- 172.21.15.70:0/2284890599 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efd58007470 con 0x7efd680b1b00 2024-09-13T16:01:18.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.794+0000 7efd5f400640 1 --2- 172.21.15.70:0/2284890599 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efd4806ac00 0x7efd4806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:18.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.794+0000 7efd5f400640 1 -- 172.21.15.70:0/2284890599 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd58088970 con 0x7efd680b1b00 2024-09-13T16:01:18.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.795+0000 7efd66a00640 1 --2- 172.21.15.70:0/2284890599 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efd4806ac00 0x7efd4806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:18.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.795+0000 7efd66a00640 1 --2- 172.21.15.70:0/2284890599 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efd4806ac00 0x7efd4806d0c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efd54034000 tx=0x7efd5402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:18.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.799+0000 7efd5f400640 1 -- 172.21.15.70:0/2284890599 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efd58053c10 con 0x7efd680b1b00 2024-09-13T16:01:18.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.969+0000 7efd6e200640 1 -- 172.21.15.70:0/2284890599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd680cd910 con 0x7efd680b1b00 2024-09-13T16:01:18.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.970+0000 7efd5f400640 1 -- 172.21.15.70:0/2284890599 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16482 (secure 0 0 0) 0x7efd58017090 con 0x7efd680b1b00 2024-09-13T16:01:18.972 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:18.972 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":19,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:18.592375+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:18.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.972+0000 7efd6e200640 1 -- 172.21.15.70:0/2284890599 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efd4806ac00 msgr2=0x7efd4806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:18.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.972+0000 7efd6e200640 1 --2- 172.21.15.70:0/2284890599 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efd4806ac00 0x7efd4806d0c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efd54034000 tx=0x7efd5402e000 comp rx=0 tx=0).stop 2024-09-13T16:01:18.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.972+0000 7efd6e200640 1 -- 172.21.15.70:0/2284890599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680b1b00 msgr2=0x7efd68147620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:18.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.972+0000 7efd6e200640 1 --2- 172.21.15.70:0/2284890599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680b1b00 0x7efd68147620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efd5800c390 tx=0x7efd5800c850 comp rx=0 tx=0).stop 2024-09-13T16:01:18.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.972+0000 7efd6e200640 1 -- 172.21.15.70:0/2284890599 shutdown_connections 2024-09-13T16:01:18.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.972+0000 7efd6e200640 1 --2- 172.21.15.70:0/2284890599 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd6815a520 0x7efd680ac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.972+0000 7efd6e200640 1 --2- 172.21.15.70:0/2284890599 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efd4806ac00 0x7efd4806d0c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.972+0000 7efd6e200640 1 --2- 172.21.15.70:0/2284890599 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd680cde50 0x7efd6814a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.972+0000 7efd6e200640 1 --2- 172.21.15.70:0/2284890599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680b1b00 0x7efd68147620 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:18.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.972+0000 7efd6e200640 1 -- 172.21.15.70:0/2284890599 >> 172.21.15.70:0/2284890599 conn(0x7efd680b0510 msgr2=0x7efd68159730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:18.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.973+0000 7efd6e200640 1 -- 172.21.15.70:0/2284890599 shutdown_connections 2024-09-13T16:01:18.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:18.973+0000 7efd6e200640 1 -- 172.21.15.70:0/2284890599 wait complete. 2024-09-13T16:01:18.989 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:19.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.141+0000 7f22c7000640 1 Processor -- start 2024-09-13T16:01:19.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.141+0000 7f22c7000640 1 -- start start 2024-09-13T16:01:19.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.142+0000 7f22c7000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22c00b1e40 0x7f22c0159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:19.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.142+0000 7f22c7000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f22c00b2220 0x7f22c00b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:19.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.142+0000 7f22c7000640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c015a430 con 0x7f22c00b2660 2024-09-13T16:01:19.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.142+0000 7f22c7000640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c01598b0 con 0x7f22c00b2220 2024-09-13T16:01:19.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.142+0000 7f22c7000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c0159b90 con 0x7f22c00b1e40 2024-09-13T16:01:19.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.143+0000 7f22c5000640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f22c00b2660 0x7f22c015c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39452/0 (socket says 172.21.15.70:39452) 2024-09-13T16:01:19.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.143+0000 7f22c5000640 1 -- 172.21.15.70:0/2042624376 learned_addr learned my addr 172.21.15.70:0/2042624376 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:19.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.143+0000 7f22bf400640 1 --2- 172.21.15.70:0/2042624376 >> v2:172.21.15.70:3300/0 conn(0x7f22c00b2220 0x7f22c00b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:19.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.143+0000 7f22bfe00640 1 --2- 172.21.15.70:0/2042624376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22c00b1e40 0x7f22c0159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:19.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.143+0000 7f22bf400640 1 -- 172.21.15.70:0/2042624376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22c00b1e40 msgr2=0x7f22c0159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:19.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.143+0000 7f22bf400640 1 --2- 172.21.15.70:0/2042624376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22c00b1e40 0x7f22c0159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:19.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.143+0000 7f22bf400640 1 -- 172.21.15.70:0/2042624376 >> v1:172.21.15.70:6789/0 conn(0x7f22c00b2660 legacy=0x7f22c015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:19.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.143+0000 7f22bf400640 1 -- 172.21.15.70:0/2042624376 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c0159e70 con 0x7f22c00b2220 2024-09-13T16:01:19.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.143+0000 7f22bea00640 1 -- 172.21.15.70:0/2042624376 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834586332 0 0) 0x7f22c015a430 con 0x7f22c00b2660 2024-09-13T16:01:19.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.144+0000 7f22bf400640 1 --2- 172.21.15.70:0/2042624376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c00b2220 0x7f22c00b2bc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0097a0 tx=0x7f22ac02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd33aa1a2124436 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:19.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.144+0000 7f22bea00640 1 -- 172.21.15.70:0/2042624376 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac02ae50 con 0x7f22c00b2220 2024-09-13T16:01:19.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.144+0000 7f22bea00640 1 -- 172.21.15.70:0/2042624376 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac032440 con 0x7f22c00b2220 2024-09-13T16:01:19.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.144+0000 7f22bea00640 1 -- 172.21.15.70:0/2042624376 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0327d0 con 0x7f22c00b2220 2024-09-13T16:01:19.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.145+0000 7f22c7000640 1 -- 172.21.15.70:0/2042624376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c00b2220 msgr2=0x7f22c00b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:19.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.145+0000 7f22c7000640 1 --2- 172.21.15.70:0/2042624376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c00b2220 0x7f22c00b2bc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0097a0 tx=0x7f22ac02a100 comp rx=0 tx=0).stop 2024-09-13T16:01:19.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.145+0000 7f22c7000640 1 -- 172.21.15.70:0/2042624376 shutdown_connections 2024-09-13T16:01:19.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.145+0000 7f22c7000640 1 --2- 172.21.15.70:0/2042624376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c00b2220 0x7f22c00b2bc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:19.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.145+0000 7f22c7000640 1 --2- 172.21.15.70:0/2042624376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22c00b1e40 0x7f22c0159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:19.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.145+0000 7f22c7000640 1 -- 172.21.15.70:0/2042624376 >> 172.21.15.70:0/2042624376 conn(0x7f22c00b0510 msgr2=0x7f22c00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:19.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.145+0000 7f22c7000640 1 -- 172.21.15.70:0/2042624376 shutdown_connections 2024-09-13T16:01:19.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.145+0000 7f22c7000640 1 -- 172.21.15.70:0/2042624376 wait complete. 2024-09-13T16:01:19.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.147+0000 7f22c7000640 1 Processor -- start 2024-09-13T16:01:19.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.147+0000 7f22c7000640 1 -- start start 2024-09-13T16:01:19.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.148+0000 7f22c7000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22c00b1e40 0x7f22c01f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:19.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.148+0000 7f22c7000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c00b2220 0x7f22c01f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:19.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.148+0000 7f22c7000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22c00b2660 0x7f22c015cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:19.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.148+0000 7f22c7000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c01f60e0 con 0x7f22c00b2220 2024-09-13T16:01:19.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.148+0000 7f22c7000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c01f63c0 con 0x7f22c00b1e40 2024-09-13T16:01:19.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.148+0000 7f22c7000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c01f23b0 con 0x7f22c00b2660 2024-09-13T16:01:19.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.148+0000 7f22bf400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c00b2220 0x7f22c01f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:19.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.148+0000 7f22bf400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c00b2220 0x7f22c01f2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40186/0 (socket says 172.21.15.70:40186) 2024-09-13T16:01:19.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.148+0000 7f22bf400640 1 -- 172.21.15.70:0/888058975 learned_addr learned my addr 172.21.15.70:0/888058975 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:19.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.148+0000 7f22c5000640 1 --2- 172.21.15.70:0/888058975 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22c00b2660 0x7f22c015cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:19.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.148+0000 7f22bf400640 1 -- 172.21.15.70:0/888058975 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22c00b2660 msgr2=0x7f22c015cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:19.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.148+0000 7f22bf400640 1 --2- 172.21.15.70:0/888058975 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22c00b2660 0x7f22c015cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:19.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.148+0000 7f22bf400640 1 -- 172.21.15.70:0/888058975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22c00b1e40 msgr2=0x7f22c01f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:19.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.148+0000 7f22bfe00640 1 --2- 172.21.15.70:0/888058975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22c00b1e40 0x7f22c01f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:19.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.148+0000 7f22bf400640 1 --2- 172.21.15.70:0/888058975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22c00b1e40 0x7f22c01f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:19.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.148+0000 7f22bf400640 1 -- 172.21.15.70:0/888058975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac009400 con 0x7f22c00b2220 2024-09-13T16:01:19.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.148+0000 7f22bfe00640 1 --2- 172.21.15.70:0/888058975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22c00b1e40 0x7f22c01f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:19.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.149+0000 7f22bf400640 1 --2- 172.21.15.70:0/888058975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c00b2220 0x7f22c01f2bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f22ac035040 tx=0x7f22ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:19.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.149+0000 7f22b7e00640 1 -- 172.21.15.70:0/888058975 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac03d710 con 0x7f22c00b2220 2024-09-13T16:01:19.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.149+0000 7f22b7e00640 1 -- 172.21.15.70:0/888058975 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac03d890 con 0x7f22c00b2220 2024-09-13T16:01:19.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.149+0000 7f22c7000640 1 -- 172.21.15.70:0/888058975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c01f2690 con 0x7f22c00b2220 2024-09-13T16:01:19.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.149+0000 7f22b7e00640 1 -- 172.21.15.70:0/888058975 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac03dc40 con 0x7f22c00b2220 2024-09-13T16:01:19.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.149+0000 7f22c7000640 1 -- 172.21.15.70:0/888058975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c01f66a0 con 0x7f22c00b2220 2024-09-13T16:01:19.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.150+0000 7f22c7000640 1 -- 172.21.15.70:0/888058975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c0071390 con 0x7f22c00b2220 2024-09-13T16:01:19.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.151+0000 7f22b7e00640 1 -- 172.21.15.70:0/888058975 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f22ac039040 con 0x7f22c00b2220 2024-09-13T16:01:19.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.152+0000 7f22b7e00640 1 --2- 172.21.15.70:0/888058975 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f22a006ac00 0x7f22a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:19.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.152+0000 7f22b7e00640 1 -- 172.21.15.70:0/888058975 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22ac0a9ca0 con 0x7f22c00b2220 2024-09-13T16:01:19.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.152+0000 7f22bfe00640 1 --2- 172.21.15.70:0/888058975 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f22a006ac00 0x7f22a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:19.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.153+0000 7f22bfe00640 1 --2- 172.21.15.70:0/888058975 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f22a006ac00 0x7f22a006d0c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f22c0141ba0 tx=0x7f22b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:19.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.156+0000 7f22b7e00640 1 -- 172.21.15.70:0/888058975 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f22ac074de0 con 0x7f22c00b2220 2024-09-13T16:01:19.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.324+0000 7f22c7000640 1 -- 172.21.15.70:0/888058975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22c00710b0 con 0x7f22c00b2220 2024-09-13T16:01:19.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.326+0000 7f22b7e00640 1 -- 172.21.15.70:0/888058975 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f22ac078400 con 0x7f22c00b2220 2024-09-13T16:01:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:19.327 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":19,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:18.592375+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:19.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.328+0000 7f22c7000640 1 -- 172.21.15.70:0/888058975 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f22a006ac00 msgr2=0x7f22a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:19.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.328+0000 7f22c7000640 1 --2- 172.21.15.70:0/888058975 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f22a006ac00 0x7f22a006d0c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f22c0141ba0 tx=0x7f22b0008040 comp rx=0 tx=0).stop 2024-09-13T16:01:19.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.328+0000 7f22c7000640 1 -- 172.21.15.70:0/888058975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c00b2220 msgr2=0x7f22c01f2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:19.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.328+0000 7f22c7000640 1 --2- 172.21.15.70:0/888058975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c00b2220 0x7f22c01f2bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f22ac035040 tx=0x7f22ac0046c0 comp rx=0 tx=0).stop 2024-09-13T16:01:19.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.328+0000 7f22c7000640 1 -- 172.21.15.70:0/888058975 shutdown_connections 2024-09-13T16:01:19.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.328+0000 7f22c7000640 1 --2- 172.21.15.70:0/888058975 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22c00b2660 0x7f22c015cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:19.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.328+0000 7f22c7000640 1 --2- 172.21.15.70:0/888058975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c00b2220 0x7f22c01f2bb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:19.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.328+0000 7f22c7000640 1 --2- 172.21.15.70:0/888058975 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f22a006ac00 0x7f22a006d0c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:19.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.328+0000 7f22c7000640 1 --2- 172.21.15.70:0/888058975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22c00b1e40 0x7f22c01f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:19.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.328+0000 7f22c7000640 1 -- 172.21.15.70:0/888058975 >> 172.21.15.70:0/888058975 conn(0x7f22c00b0510 msgr2=0x7f22c00af410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:19.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.328+0000 7f22c7000640 1 -- 172.21.15.70:0/888058975 shutdown_connections 2024-09-13T16:01:19.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.328+0000 7f22c7000640 1 -- 172.21.15.70:0/888058975 wait complete. 2024-09-13T16:01:19.345 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T16:01:19.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.498+0000 7fd97f200640 1 Processor -- start 2024-09-13T16:01:19.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.498+0000 7fd97f200640 1 -- start start 2024-09-13T16:01:19.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.499+0000 7fd97f200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd978152f90 0x7fd97806bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:19.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.499+0000 7fd97f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd97806c2e0 0x7fd9780b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:19.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.499+0000 7fd97f200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd9780b20f0 0x7fd97815c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:19.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.499+0000 7fd97f200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97806c720 con 0x7fd9780b20f0 2024-09-13T16:01:19.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.499+0000 7fd97f200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97815a070 con 0x7fd978152f90 2024-09-13T16:01:19.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.499+0000 7fd97f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd978153370 con 0x7fd97806c2e0 2024-09-13T16:01:19.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.499+0000 7fd97e800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd9780b20f0 0x7fd97815c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:19.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.499+0000 7fd97e800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd9780b20f0 0x7fd97815c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40192/0 (socket says 172.21.15.70:40192) 2024-09-13T16:01:19.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.499+0000 7fd97e800640 1 -- 172.21.15.70:0/357753055 learned_addr learned my addr 172.21.15.70:0/357753055 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:19.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.499+0000 7fd97d400640 1 --2- 172.21.15.70:0/357753055 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd97806c2e0 0x7fd9780b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:19.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.499+0000 7fd97de00640 1 --2- 172.21.15.70:0/357753055 >> v2:172.21.15.107:3300/0 conn(0x7fd978152f90 0x7fd97806bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:19.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.500+0000 7fd97e800640 1 -- 172.21.15.70:0/357753055 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd97806c2e0 msgr2=0x7fd9780b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:19.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.500+0000 7fd97e800640 1 --2- 172.21.15.70:0/357753055 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd97806c2e0 0x7fd9780b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:19.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.500+0000 7fd97e800640 1 -- 172.21.15.70:0/357753055 >> v2:172.21.15.107:3300/0 conn(0x7fd978152f90 msgr2=0x7fd97806bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:19.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.500+0000 7fd97e800640 1 --2- 172.21.15.70:0/357753055 >> v2:172.21.15.107:3300/0 conn(0x7fd978152f90 0x7fd97806bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:19.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.500+0000 7fd97e800640 1 -- 172.21.15.70:0/357753055 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9780b2900 con 0x7fd9780b20f0 2024-09-13T16:01:19.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.501+0000 7fd97e800640 1 --2- 172.21.15.70:0/357753055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9780b20f0 0x7fd97815c550 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd97806cdf0 tx=0x7fd97402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6cf2a9cfab404cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:19.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.501+0000 7fd97ca00640 1 -- 172.21.15.70:0/357753055 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974031600 con 0x7fd9780b20f0 2024-09-13T16:01:19.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.501+0000 7fd97ca00640 1 -- 172.21.15.70:0/357753055 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97402d050 con 0x7fd9780b20f0 2024-09-13T16:01:19.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.501+0000 7fd97ca00640 1 -- 172.21.15.70:0/357753055 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974031980 con 0x7fd9780b20f0 2024-09-13T16:01:19.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.501+0000 7fd97f200640 1 -- 172.21.15.70:0/357753055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9780b20f0 msgr2=0x7fd97815c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:19.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.501+0000 7fd97f200640 1 --2- 172.21.15.70:0/357753055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9780b20f0 0x7fd97815c550 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd97806cdf0 tx=0x7fd97402a610 comp rx=0 tx=0).stop 2024-09-13T16:01:19.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.502+0000 7fd97f200640 1 -- 172.21.15.70:0/357753055 shutdown_connections 2024-09-13T16:01:19.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.502+0000 7fd97f200640 1 --2- 172.21.15.70:0/357753055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9780b20f0 0x7fd97815c550 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:19.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.502+0000 7fd97f200640 1 --2- 172.21.15.70:0/357753055 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd97806c2e0 0x7fd9780b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:19.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.502+0000 7fd97f200640 1 --2- 172.21.15.70:0/357753055 >> v2:172.21.15.107:3300/0 conn(0x7fd978152f90 0x7fd97806bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:19.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.502+0000 7fd97f200640 1 -- 172.21.15.70:0/357753055 >> 172.21.15.70:0/357753055 conn(0x7fd978069ed0 msgr2=0x7fd97806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:19.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.502+0000 7fd97f200640 1 -- 172.21.15.70:0/357753055 shutdown_connections 2024-09-13T16:01:19.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.502+0000 7fd97f200640 1 -- 172.21.15.70:0/357753055 wait complete. 2024-09-13T16:01:19.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.503+0000 7fd97f200640 1 Processor -- start 2024-09-13T16:01:19.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.503+0000 7fd97f200640 1 -- start start 2024-09-13T16:01:19.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.504+0000 7fd97f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd97806c2e0 0x7fd97813aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.504+0000 7fd97f200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9780b20f0 0x7fd9780b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.504+0000 7fd97f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd978152f90 0x7fd9780b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.504+0000 7fd97f200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd978155fa0 con 0x7fd9780b20f0 2024-09-13T16:01:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.504+0000 7fd97f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97813b3e0 con 0x7fd978152f90 2024-09-13T16:01:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.504+0000 7fd97f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9780ae420 con 0x7fd97806c2e0 2024-09-13T16:01:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.504+0000 7fd97d400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9780b20f0 0x7fd9780b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.504+0000 7fd97d400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9780b20f0 0x7fd9780b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40194/0 (socket says 172.21.15.70:40194) 2024-09-13T16:01:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.504+0000 7fd97d400640 1 -- 172.21.15.70:0/1265049428 learned_addr learned my addr 172.21.15.70:0/1265049428 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.504+0000 7fd97de00640 1 --2- 172.21.15.70:0/1265049428 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd97806c2e0 0x7fd97813aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.505+0000 7fd97e800640 1 --2- 172.21.15.70:0/1265049428 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd978152f90 0x7fd9780b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.505+0000 7fd97d400640 1 -- 172.21.15.70:0/1265049428 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd97806c2e0 msgr2=0x7fd97813aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.505+0000 7fd97d400640 1 --2- 172.21.15.70:0/1265049428 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd97806c2e0 0x7fd97813aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.505+0000 7fd97d400640 1 -- 172.21.15.70:0/1265049428 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd978152f90 msgr2=0x7fd9780b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.505+0000 7fd97d400640 1 --2- 172.21.15.70:0/1265049428 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd978152f90 0x7fd9780b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.505+0000 7fd97d400640 1 -- 172.21.15.70:0/1265049428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd974009b30 con 0x7fd9780b20f0 2024-09-13T16:01:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.505+0000 7fd97e800640 1 --2- 172.21.15.70:0/1265049428 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd978152f90 0x7fd9780b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.505+0000 7fd97d400640 1 --2- 172.21.15.70:0/1265049428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9780b20f0 0x7fd9780b0900 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd96800e8a0 tx=0x7fd96800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.505+0000 7fd972000640 1 -- 172.21.15.70:0/1265049428 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9680094f0 con 0x7fd9780b20f0 2024-09-13T16:01:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.505+0000 7fd972000640 1 -- 172.21.15.70:0/1265049428 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96800c940 con 0x7fd9780b20f0 2024-09-13T16:01:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.505+0000 7fd97f200640 1 -- 172.21.15.70:0/1265049428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd978155700 con 0x7fd9780b20f0 2024-09-13T16:01:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.505+0000 7fd972000640 1 -- 172.21.15.70:0/1265049428 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96800ccf0 con 0x7fd9780b20f0 2024-09-13T16:01:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.506+0000 7fd97f200640 1 -- 172.21.15.70:0/1265049428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd978155cc0 con 0x7fd9780b20f0 2024-09-13T16:01:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.506+0000 7fd97f200640 1 -- 172.21.15.70:0/1265049428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97815b630 con 0x7fd9780b20f0 2024-09-13T16:01:19.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.508+0000 7fd972000640 1 -- 172.21.15.70:0/1265049428 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd968013470 con 0x7fd9780b20f0 2024-09-13T16:01:19.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.508+0000 7fd972000640 1 --2- 172.21.15.70:0/1265049428 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd95c06ac00 0x7fd95c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:19.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.508+0000 7fd972000640 1 -- 172.21.15.70:0/1265049428 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd968089470 con 0x7fd9780b20f0 2024-09-13T16:01:19.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.509+0000 7fd97de00640 1 --2- 172.21.15.70:0/1265049428 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd95c06ac00 0x7fd95c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:19.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.509+0000 7fd97de00640 1 --2- 172.21.15.70:0/1265049428 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd95c06ac00 0x7fd95c06d0c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009ac0 tx=0x7fd96c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:19.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.512+0000 7fd972000640 1 -- 172.21.15.70:0/1265049428 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd968054660 con 0x7fd9780b20f0 2024-09-13T16:01:19.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:19.720+0000 7fd97f200640 1 -- 172.21.15.70:0/1265049428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd9780ae590 con 0x7fd9780b20f0 2024-09-13T16:01:20.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.607+0000 7fd972000640 1 -- 172.21.15.70:0/1265049428 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd9780ae590 con 0x7fd9780b20f0 2024-09-13T16:01:20.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.610+0000 7fd97f200640 1 -- 172.21.15.70:0/1265049428 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd95c06ac00 msgr2=0x7fd95c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:20.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.610+0000 7fd97f200640 1 --2- 172.21.15.70:0/1265049428 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd95c06ac00 0x7fd95c06d0c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009ac0 tx=0x7fd96c009190 comp rx=0 tx=0).stop 2024-09-13T16:01:20.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.610+0000 7fd97f200640 1 -- 172.21.15.70:0/1265049428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9780b20f0 msgr2=0x7fd9780b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:20.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.610+0000 7fd97f200640 1 --2- 172.21.15.70:0/1265049428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9780b20f0 0x7fd9780b0900 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd96800e8a0 tx=0x7fd96800ed60 comp rx=0 tx=0).stop 2024-09-13T16:01:20.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.610+0000 7fd97f200640 1 -- 172.21.15.70:0/1265049428 shutdown_connections 2024-09-13T16:01:20.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.610+0000 7fd97f200640 1 --2- 172.21.15.70:0/1265049428 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd95c06ac00 0x7fd95c06d0c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:20.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.610+0000 7fd97f200640 1 --2- 172.21.15.70:0/1265049428 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd978152f90 0x7fd9780b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:20.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.610+0000 7fd97f200640 1 --2- 172.21.15.70:0/1265049428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9780b20f0 0x7fd9780b0900 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:20.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.610+0000 7fd97f200640 1 --2- 172.21.15.70:0/1265049428 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd97806c2e0 0x7fd97813aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:20.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.610+0000 7fd97f200640 1 -- 172.21.15.70:0/1265049428 >> 172.21.15.70:0/1265049428 conn(0x7fd978069ed0 msgr2=0x7fd9780ad280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:20.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.610+0000 7fd97f200640 1 -- 172.21.15.70:0/1265049428 shutdown_connections 2024-09-13T16:01:20.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.610+0000 7fd97f200640 1 -- 172.21.15.70:0/1265049428 wait complete. 2024-09-13T16:01:20.628 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T16:01:20.629 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T16:01:20.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.786+0000 7f0b45200640 1 Processor -- start 2024-09-13T16:01:20.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.786+0000 7f0b45200640 1 -- start start 2024-09-13T16:01:20.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.787+0000 7f0b45200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b40071690 0x7f0b4015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:20.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.787+0000 7f0b45200640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4006f5f0 con 0x7f0b400cafa0 2024-09-13T16:01:20.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.787+0000 7f0b45200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b40070450 con 0x7f0b40156f60 2024-09-13T16:01:20.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.787+0000 7f0b45200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4015aa30 con 0x7f0b40071690 2024-09-13T16:01:20.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.787+0000 7f0b3e800640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f0b400cafa0 0x7f0b400cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39034/0 (socket says 172.21.15.70:39034) 2024-09-13T16:01:20.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.787+0000 7f0b3e800640 1 -- 172.21.15.70:0/1773218186 learned_addr learned my addr 172.21.15.70:0/1773218186 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:20.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.788+0000 7f0b3d400640 1 --2- 172.21.15.70:0/1773218186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b40071690 0x7f0b4015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:20.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.788+0000 7f0b3ca00640 1 -- 172.21.15.70:0/1773218186 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056751207 0 0) 0x7f0b4006f5f0 con 0x7f0b400cafa0 2024-09-13T16:01:20.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.788+0000 7f0b3ca00640 1 -- 172.21.15.70:0/1773218186 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b24003520 con 0x7f0b400cafa0 2024-09-13T16:01:20.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.788+0000 7f0b3d400640 1 -- 172.21.15.70:0/1773218186 >> v1:172.21.15.107:6789/0 conn(0x7f0b40156f60 legacy=0x7f0b40070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:20.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.788+0000 7f0b3d400640 1 -- 172.21.15.70:0/1773218186 >> v1:172.21.15.70:6789/0 conn(0x7f0b400cafa0 legacy=0x7f0b400cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:20.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.788+0000 7f0b3ca00640 1 -- 172.21.15.70:0/1773218186 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361228056 0 0) 0x7f0b40070450 con 0x7f0b40156f60 2024-09-13T16:01:20.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.788+0000 7f0b3d400640 1 -- 172.21.15.70:0/1773218186 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4006f840 con 0x7f0b40071690 2024-09-13T16:01:20.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.789+0000 7f0b3d400640 1 --2- 172.21.15.70:0/1773218186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b40071690 0x7f0b4015a4f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c0097d0 tx=0x7f0b2c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0ed36e927af776 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:20.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.789+0000 7f0b3ca00640 1 -- 172.21.15.70:0/1773218186 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c032440 con 0x7f0b40071690 2024-09-13T16:01:20.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.789+0000 7f0b3ca00640 1 -- 172.21.15.70:0/1773218186 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2c0325a0 con 0x7f0b40071690 2024-09-13T16:01:20.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.789+0000 7f0b3ca00640 1 -- 172.21.15.70:0/1773218186 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c032910 con 0x7f0b40071690 2024-09-13T16:01:20.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.790+0000 7f0b45200640 1 -- 172.21.15.70:0/1773218186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b40071690 msgr2=0x7f0b4015a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:20.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.790+0000 7f0b45200640 1 --2- 172.21.15.70:0/1773218186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b40071690 0x7f0b4015a4f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c0097d0 tx=0x7f0b2c02a210 comp rx=0 tx=0).stop 2024-09-13T16:01:20.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.790+0000 7f0b45200640 1 -- 172.21.15.70:0/1773218186 shutdown_connections 2024-09-13T16:01:20.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.790+0000 7f0b45200640 1 --2- 172.21.15.70:0/1773218186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b40071690 0x7f0b4015a4f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:20.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.790+0000 7f0b45200640 1 -- 172.21.15.70:0/1773218186 >> 172.21.15.70:0/1773218186 conn(0x7f0b400b0580 msgr2=0x7f0b400b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:20.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.790+0000 7f0b45200640 1 -- 172.21.15.70:0/1773218186 shutdown_connections 2024-09-13T16:01:20.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.790+0000 7f0b45200640 1 -- 172.21.15.70:0/1773218186 wait complete. 2024-09-13T16:01:20.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.792+0000 7f0b45200640 1 Processor -- start 2024-09-13T16:01:20.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.792+0000 7f0b45200640 1 -- start start 2024-09-13T16:01:20.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.793+0000 7f0b45200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b40071690 0x7f0b40158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:20.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.793+0000 7f0b45200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b400cafa0 0x7f0b4015b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:20.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.793+0000 7f0b45200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b40156f60 0x7f0b4015be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:20.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.793+0000 7f0b45200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4014ca40 con 0x7f0b40156f60 2024-09-13T16:01:20.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.793+0000 7f0b45200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b40157a50 con 0x7f0b400cafa0 2024-09-13T16:01:20.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.793+0000 7f0b45200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b40157d30 con 0x7f0b40071690 2024-09-13T16:01:20.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.793+0000 7f0b3e800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b40156f60 0x7f0b4015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:20.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.793+0000 7f0b3de00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b40071690 0x7f0b40158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:20.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.793+0000 7f0b3d400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b400cafa0 0x7f0b4015b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:20.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.793+0000 7f0b3de00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b40071690 0x7f0b40158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:50912/0 (socket says 172.21.15.70:50912) 2024-09-13T16:01:20.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.793+0000 7f0b3de00640 1 -- 172.21.15.70:0/903108201 learned_addr learned my addr 172.21.15.70:0/903108201 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:20.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.793+0000 7f0b3d400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b400cafa0 0x7f0b4015b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.70:59328/0 (socket says 172.21.15.70:59328) 2024-09-13T16:01:20.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.793+0000 7f0b3e800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b40156f60 0x7f0b4015be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35678/0 (socket says 172.21.15.70:35678) 2024-09-13T16:01:20.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.794+0000 7f0b3de00640 1 -- 172.21.15.70:0/903108201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b400cafa0 msgr2=0x7f0b4015b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:20.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.794+0000 7f0b3de00640 1 --2- 172.21.15.70:0/903108201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b400cafa0 0x7f0b4015b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:20.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.794+0000 7f0b3de00640 1 -- 172.21.15.70:0/903108201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b40156f60 msgr2=0x7f0b4015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:20.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.794+0000 7f0b3de00640 1 --2- 172.21.15.70:0/903108201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b40156f60 0x7f0b4015be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:20.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.794+0000 7f0b3de00640 1 -- 172.21.15.70:0/903108201 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c009400 con 0x7f0b40071690 2024-09-13T16:01:20.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.794+0000 7f0b3d400640 1 --2- 172.21.15.70:0/903108201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b400cafa0 0x7f0b4015b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:20.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.794+0000 7f0b3e800640 1 --2- 172.21.15.70:0/903108201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b40156f60 0x7f0b4015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:20.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.794+0000 7f0b3de00640 1 --2- 172.21.15.70:0/903108201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b40071690 0x7f0b40158af0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000c410 tx=0x7f0b3000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:20.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.794+0000 7f0b36000640 1 -- 172.21.15.70:0/903108201 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b300035f0 con 0x7f0b40071690 2024-09-13T16:01:20.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.794+0000 7f0b36000640 1 -- 172.21.15.70:0/903108201 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b30003770 con 0x7f0b40071690 2024-09-13T16:01:20.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.794+0000 7f0b45200640 1 -- 172.21.15.70:0/903108201 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b40158010 con 0x7f0b40071690 2024-09-13T16:01:20.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.794+0000 7f0b36000640 1 -- 172.21.15.70:0/903108201 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30003b20 con 0x7f0b40071690 2024-09-13T16:01:20.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.794+0000 7f0b45200640 1 -- 172.21.15.70:0/903108201 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b401585d0 con 0x7f0b40071690 2024-09-13T16:01:20.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.795+0000 7f0b45200640 1 -- 172.21.15.70:0/903108201 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b400b1e20 con 0x7f0b40071690 2024-09-13T16:01:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.797+0000 7f0b36000640 1 -- 172.21.15.70:0/903108201 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0b30003c80 con 0x7f0b40071690 2024-09-13T16:01:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.797+0000 7f0b36000640 1 --2- 172.21.15.70:0/903108201 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0b2006ac00 0x7f0b2006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.798+0000 7f0b36000640 1 -- 172.21.15.70:0/903108201 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b30088c40 con 0x7f0b40071690 2024-09-13T16:01:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.798+0000 7f0b3d400640 1 --2- 172.21.15.70:0/903108201 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0b2006ac00 0x7f0b2006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.798+0000 7f0b3d400640 1 --2- 172.21.15.70:0/903108201 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0b2006ac00 0x7f0b2006d0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c034000 tx=0x7f0b2c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:20.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:20.802+0000 7f0b36000640 1 -- 172.21.15.70:0/903108201 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0b30053e30 con 0x7f0b40071690 2024-09-13T16:01:21.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.001+0000 7f0b45200640 1 -- 172.21.15.70:0/903108201 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0b400b1b40 con 0x7f0b40071690 2024-09-13T16:01:21.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.610+0000 7f0b36000640 1 -- 172.21.15.70:0/903108201 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0b30017020 con 0x7f0b40071690 2024-09-13T16:01:21.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.612+0000 7f0b45200640 1 -- 172.21.15.70:0/903108201 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0b2006ac00 msgr2=0x7f0b2006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:21.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.612+0000 7f0b45200640 1 --2- 172.21.15.70:0/903108201 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0b2006ac00 0x7f0b2006d0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c034000 tx=0x7f0b2c02e000 comp rx=0 tx=0).stop 2024-09-13T16:01:21.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.612+0000 7f0b45200640 1 -- 172.21.15.70:0/903108201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b40071690 msgr2=0x7f0b40158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:21.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.612+0000 7f0b45200640 1 --2- 172.21.15.70:0/903108201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b40071690 0x7f0b40158af0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000c410 tx=0x7f0b3000c8d0 comp rx=0 tx=0).stop 2024-09-13T16:01:21.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.613+0000 7f0b45200640 1 -- 172.21.15.70:0/903108201 shutdown_connections 2024-09-13T16:01:21.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.613+0000 7f0b45200640 1 --2- 172.21.15.70:0/903108201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b40156f60 0x7f0b4015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:21.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.613+0000 7f0b45200640 1 --2- 172.21.15.70:0/903108201 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0b2006ac00 0x7f0b2006d0c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:21.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.613+0000 7f0b45200640 1 --2- 172.21.15.70:0/903108201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b400cafa0 0x7f0b4015b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:21.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.613+0000 7f0b45200640 1 --2- 172.21.15.70:0/903108201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0b40071690 0x7f0b40158af0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:21.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.613+0000 7f0b45200640 1 -- 172.21.15.70:0/903108201 >> 172.21.15.70:0/903108201 conn(0x7f0b400b0580 msgr2=0x7f0b400ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:21.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.613+0000 7f0b45200640 1 -- 172.21.15.70:0/903108201 shutdown_connections 2024-09-13T16:01:21.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.613+0000 7f0b45200640 1 -- 172.21.15.70:0/903108201 wait complete. 2024-09-13T16:01:21.630 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T16:01:21.630 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:01:21.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.780+0000 7f2c2e400640 1 Processor -- start 2024-09-13T16:01:21.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.780+0000 7f2c2e400640 1 -- start start 2024-09-13T16:01:21.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.781+0000 7f2c2e400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2c2815a520 0x7f2c2806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:21.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.781+0000 7f2c2e400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2c280ce020 0x7f2c2815a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:21.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.781+0000 7f2c2e400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2806bc00 con 0x7f2c280b1b00 2024-09-13T16:01:21.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.781+0000 7f2c2e400640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2806bea0 con 0x7f2c280ce020 2024-09-13T16:01:21.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.781+0000 7f2c2e400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2806c180 con 0x7f2c2815a520 2024-09-13T16:01:21.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.781+0000 7f2c27e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2c280ce020 0x7f2c2815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:21.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.781+0000 7f2c27e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2c280ce020 0x7f2c2815a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35688/0 (socket says 172.21.15.70:35688) 2024-09-13T16:01:21.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.781+0000 7f2c27e00640 1 -- 172.21.15.70:0/1527274003 learned_addr learned my addr 172.21.15.70:0/1527274003 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:21.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.782+0000 7f2c27400640 1 --2- 172.21.15.70:0/1527274003 >> v2:172.21.15.107:3300/0 conn(0x7f2c2815a520 0x7f2c2806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:21.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.782+0000 7f2c27e00640 1 -- 172.21.15.70:0/1527274003 >> v2:172.21.15.107:3300/0 conn(0x7f2c2815a520 msgr2=0x7f2c2806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:21.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.782+0000 7f2c27e00640 1 --2- 172.21.15.70:0/1527274003 >> v2:172.21.15.107:3300/0 conn(0x7f2c2815a520 0x7f2c2806b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:21.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.782+0000 7f2c27e00640 1 -- 172.21.15.70:0/1527274003 >> v1:172.21.15.107:6789/0 conn(0x7f2c280b1b00 legacy=0x7f2c280cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:21.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.782+0000 7f2c27e00640 1 -- 172.21.15.70:0/1527274003 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2806c460 con 0x7f2c280ce020 2024-09-13T16:01:21.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.782+0000 7f2c27400640 1 --2- 172.21.15.70:0/1527274003 >> v2:172.21.15.107:3300/0 conn(0x7f2c2815a520 0x7f2c2806b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:21.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.783+0000 7f2c27e00640 1 --2- 172.21.15.70:0/1527274003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c280ce020 0x7f2c2815a900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2c280b14f0 tx=0x7f2c2002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17a122b44994ce8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:21.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.783+0000 7f2c26a00640 1 -- 172.21.15.70:0/1527274003 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20031600 con 0x7f2c280ce020 2024-09-13T16:01:21.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.783+0000 7f2c26a00640 1 -- 172.21.15.70:0/1527274003 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2002d050 con 0x7f2c280ce020 2024-09-13T16:01:21.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.783+0000 7f2c26a00640 1 -- 172.21.15.70:0/1527274003 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20031980 con 0x7f2c280ce020 2024-09-13T16:01:21.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.784+0000 7f2c2e400640 1 -- 172.21.15.70:0/1527274003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c280ce020 msgr2=0x7f2c2815a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:21.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.784+0000 7f2c2e400640 1 --2- 172.21.15.70:0/1527274003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c280ce020 0x7f2c2815a900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2c280b14f0 tx=0x7f2c2002a6f0 comp rx=0 tx=0).stop 2024-09-13T16:01:21.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.784+0000 7f2c2e400640 1 -- 172.21.15.70:0/1527274003 shutdown_connections 2024-09-13T16:01:21.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.784+0000 7f2c2e400640 1 --2- 172.21.15.70:0/1527274003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c280ce020 0x7f2c2815a900 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:21.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.784+0000 7f2c2e400640 1 --2- 172.21.15.70:0/1527274003 >> v2:172.21.15.107:3300/0 conn(0x7f2c2815a520 0x7f2c2806b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:21.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.784+0000 7f2c2e400640 1 -- 172.21.15.70:0/1527274003 >> 172.21.15.70:0/1527274003 conn(0x7f2c280b0510 msgr2=0x7f2c280b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:21.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.784+0000 7f2c2e400640 1 -- 172.21.15.70:0/1527274003 shutdown_connections 2024-09-13T16:01:21.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.784+0000 7f2c2e400640 1 -- 172.21.15.70:0/1527274003 wait complete. 2024-09-13T16:01:21.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.785+0000 7f2c2e400640 1 Processor -- start 2024-09-13T16:01:21.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.785+0000 7f2c2e400640 1 -- start start 2024-09-13T16:01:21.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.786+0000 7f2c2e400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c280b1b00 0x7f2c28151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:21.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.786+0000 7f2c2e400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c280ce020 0x7f2c280cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:21.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.786+0000 7f2c2e400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2815a520 0x7f2c280cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:21.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.786+0000 7f2c2e400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c281e4860 con 0x7f2c280b1b00 2024-09-13T16:01:21.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.786+0000 7f2c2e400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c28152250 con 0x7f2c2815a520 2024-09-13T16:01:21.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.786+0000 7f2c2e400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c281e3c50 con 0x7f2c280ce020 2024-09-13T16:01:21.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.787+0000 7f2c27400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c280b1b00 0x7f2c28151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:21.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.787+0000 7f2c27400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c280b1b00 0x7f2c28151d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35702/0 (socket says 172.21.15.70:35702) 2024-09-13T16:01:21.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.787+0000 7f2c27400640 1 -- 172.21.15.70:0/3303771809 learned_addr learned my addr 172.21.15.70:0/3303771809 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:21.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.787+0000 7f2c1fe00640 1 --2- 172.21.15.70:0/3303771809 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c280ce020 0x7f2c280cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:21.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.787+0000 7f2c27e00640 1 --2- 172.21.15.70:0/3303771809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2815a520 0x7f2c280cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:21.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.787+0000 7f2c27400640 1 -- 172.21.15.70:0/3303771809 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c280ce020 msgr2=0x7f2c280cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:21.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.787+0000 7f2c27400640 1 --2- 172.21.15.70:0/3303771809 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c280ce020 0x7f2c280cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:21.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.787+0000 7f2c27400640 1 -- 172.21.15.70:0/3303771809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2815a520 msgr2=0x7f2c280cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:21.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.787+0000 7f2c27400640 1 --2- 172.21.15.70:0/3303771809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2815a520 0x7f2c280cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:21.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.787+0000 7f2c27400640 1 -- 172.21.15.70:0/3303771809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c20009b30 con 0x7f2c280b1b00 2024-09-13T16:01:21.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.787+0000 7f2c27400640 1 --2- 172.21.15.70:0/3303771809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c280b1b00 0x7f2c28151d10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800c7f0 tx=0x7f2c1800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:21.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.787+0000 7f2c1f400640 1 -- 172.21.15.70:0/3303771809 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c18007820 con 0x7f2c280b1b00 2024-09-13T16:01:21.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.787+0000 7f2c1f400640 1 -- 172.21.15.70:0/3303771809 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c18007980 con 0x7f2c280b1b00 2024-09-13T16:01:21.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.787+0000 7f2c2e400640 1 -- 172.21.15.70:0/3303771809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c281e3f30 con 0x7f2c280b1b00 2024-09-13T16:01:21.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.788+0000 7f2c1f400640 1 -- 172.21.15.70:0/3303771809 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c18007cf0 con 0x7f2c280b1b00 2024-09-13T16:01:21.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.788+0000 7f2c2e400640 1 -- 172.21.15.70:0/3303771809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c281e44f0 con 0x7f2c280b1b00 2024-09-13T16:01:21.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.789+0000 7f2c2e400640 1 -- 172.21.15.70:0/3303771809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c281e4680 con 0x7f2c280b1b00 2024-09-13T16:01:21.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.789+0000 7f2c1f400640 1 -- 172.21.15.70:0/3303771809 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2c180113f0 con 0x7f2c280b1b00 2024-09-13T16:01:21.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.791+0000 7f2c1f400640 1 --2- 172.21.15.70:0/3303771809 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2c0406ac30 0x7f2c0406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:21.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.791+0000 7f2c1f400640 1 -- 172.21.15.70:0/3303771809 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c18089620 con 0x7f2c280b1b00 2024-09-13T16:01:21.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.791+0000 7f2c1fe00640 1 --2- 172.21.15.70:0/3303771809 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2c0406ac30 0x7f2c0406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:21.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.792+0000 7f2c1fe00640 1 --2- 172.21.15.70:0/3303771809 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2c0406ac30 0x7f2c0406d0f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2c28155460 tx=0x7f2c10007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:21.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.795+0000 7f2c1f400640 1 -- 172.21.15.70:0/3303771809 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2c18054810 con 0x7f2c280b1b00 2024-09-13T16:01:21.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.997+0000 7f2c2e400640 1 -- 172.21.15.70:0/3303771809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c2815a900 con 0x7f2c280b1b00 2024-09-13T16:01:21.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.997+0000 7f2c1f400640 1 -- 172.21.15.70:0/3303771809 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4728 (secure 0 0 0) 0x7f2c1805e070 con 0x7f2c280b1b00 2024-09-13T16:01:21.998 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:21.998 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2852595148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2852595148},{"type":"v1","addr":"172.21.15.107:6834","nonce":2852595148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2578992914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2578992914},{"type":"v1","addr":"172.21.15.70:6835","nonce":2578992914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/927553867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":927553867},{"type":"v1","addr":"172.21.15.70:6837","nonce":927553867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:01:18.592735+0000","modified":"2024-09-13T16:01:21.606407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6835/712016246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":712016246},{"type":"v1","addr":"172.21.15.107:6835","nonce":712016246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:01:21.999 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2024-09-13T16:01:22.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.999+0000 7f2c2e400640 1 -- 172.21.15.70:0/3303771809 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2c0406ac30 msgr2=0x7f2c0406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.999+0000 7f2c2e400640 1 --2- 172.21.15.70:0/3303771809 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2c0406ac30 0x7f2c0406d0f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2c28155460 tx=0x7f2c10007e30 comp rx=0 tx=0).stop 2024-09-13T16:01:22.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.999+0000 7f2c2e400640 1 -- 172.21.15.70:0/3303771809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c280b1b00 msgr2=0x7f2c28151d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.999+0000 7f2c2e400640 1 --2- 172.21.15.70:0/3303771809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c280b1b00 0x7f2c28151d10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800c7f0 tx=0x7f2c1800ccb0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.999+0000 7f2c2e400640 1 -- 172.21.15.70:0/3303771809 shutdown_connections 2024-09-13T16:01:22.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.999+0000 7f2c2e400640 1 --2- 172.21.15.70:0/3303771809 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2c0406ac30 0x7f2c0406d0f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.999+0000 7f2c2e400640 1 --2- 172.21.15.70:0/3303771809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c2815a520 0x7f2c280cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.999+0000 7f2c2e400640 1 --2- 172.21.15.70:0/3303771809 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c280ce020 0x7f2c280cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:21.999+0000 7f2c2e400640 1 --2- 172.21.15.70:0/3303771809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c280b1b00 0x7f2c28151d10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.000+0000 7f2c2e400640 1 -- 172.21.15.70:0/3303771809 >> 172.21.15.70:0/3303771809 conn(0x7f2c280b0510 msgr2=0x7f2c280cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:22.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.000+0000 7f2c2e400640 1 -- 172.21.15.70:0/3303771809 shutdown_connections 2024-09-13T16:01:22.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.000+0000 7f2c2e400640 1 -- 172.21.15.70:0/3303771809 wait complete. 2024-09-13T16:01:22.017 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:22.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.168+0000 7faef2800640 1 Processor -- start 2024-09-13T16:01:22.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.168+0000 7faef2800640 1 -- start start 2024-09-13T16:01:22.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.169+0000 7faef2800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faeec15a5c0 0x7faeec0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:22.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.169+0000 7faef2800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7faeec0cbac0 0x7faeec0b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:22.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.169+0000 7faef2800640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeec0cbfc0 con 0x7faeec0afe10 2024-09-13T16:01:22.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.169+0000 7faef2800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeec0cce20 con 0x7faeec0cbac0 2024-09-13T16:01:22.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.169+0000 7faef2800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec0707a0 con 0x7faeec15a5c0 2024-09-13T16:01:22.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.169+0000 7faef1e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7faeec0afe10 0x7faeec06f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39042/0 (socket says 172.21.15.70:39042) 2024-09-13T16:01:22.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.169+0000 7faef1e00640 1 -- 172.21.15.70:0/1782632122 learned_addr learned my addr 172.21.15.70:0/1782632122 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:22.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.169+0000 7faef0a00640 1 --2- 172.21.15.70:0/1782632122 >> v2:172.21.15.70:3300/0 conn(0x7faeec0cbac0 0x7faeec0b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:22.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.169+0000 7faef1400640 1 --2- 172.21.15.70:0/1782632122 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faeec15a5c0 0x7faeec0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:22.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.170+0000 7faeebe00640 1 -- 172.21.15.70:0/1782632122 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584637521 0 0) 0x7faeec0cbfc0 con 0x7faeec0afe10 2024-09-13T16:01:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.170+0000 7faeebe00640 1 -- 172.21.15.70:0/1782632122 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed4003520 con 0x7faeec0afe10 2024-09-13T16:01:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.170+0000 7faef0a00640 1 -- 172.21.15.70:0/1782632122 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faeec15a5c0 msgr2=0x7faeec0b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.170+0000 7faef0a00640 1 --2- 172.21.15.70:0/1782632122 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faeec15a5c0 0x7faeec0b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.170+0000 7faef0a00640 1 -- 172.21.15.70:0/1782632122 >> v1:172.21.15.70:6789/0 conn(0x7faeec0afe10 legacy=0x7faeec06f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.170+0000 7faef0a00640 1 -- 172.21.15.70:0/1782632122 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec070a80 con 0x7faeec0cbac0 2024-09-13T16:01:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.171+0000 7faef0a00640 1 --2- 172.21.15.70:0/1782632122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeec0cbac0 0x7faeec0b3ef0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faed80097a0 tx=0x7faed802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f899342d42002eca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.171+0000 7faeebe00640 1 -- 172.21.15.70:0/1782632122 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8032440 con 0x7faeec0cbac0 2024-09-13T16:01:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.171+0000 7faeebe00640 1 -- 172.21.15.70:0/1782632122 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed80325a0 con 0x7faeec0cbac0 2024-09-13T16:01:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.171+0000 7faeebe00640 1 -- 172.21.15.70:0/1782632122 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8032910 con 0x7faeec0cbac0 2024-09-13T16:01:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.171+0000 7faef2800640 1 -- 172.21.15.70:0/1782632122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeec0cbac0 msgr2=0x7faeec0b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.171+0000 7faef2800640 1 --2- 172.21.15.70:0/1782632122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeec0cbac0 0x7faeec0b3ef0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faed80097a0 tx=0x7faed802a180 comp rx=0 tx=0).stop 2024-09-13T16:01:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.171+0000 7faef2800640 1 -- 172.21.15.70:0/1782632122 shutdown_connections 2024-09-13T16:01:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.171+0000 7faef2800640 1 --2- 172.21.15.70:0/1782632122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeec0cbac0 0x7faeec0b3ef0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.171+0000 7faef2800640 1 --2- 172.21.15.70:0/1782632122 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faeec15a5c0 0x7faeec0b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.172+0000 7faef2800640 1 -- 172.21.15.70:0/1782632122 >> 172.21.15.70:0/1782632122 conn(0x7faeec0ae310 msgr2=0x7faeec0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.172+0000 7faef2800640 1 -- 172.21.15.70:0/1782632122 shutdown_connections 2024-09-13T16:01:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.172+0000 7faef2800640 1 -- 172.21.15.70:0/1782632122 wait complete. 2024-09-13T16:01:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.173+0000 7faef2800640 1 Processor -- start 2024-09-13T16:01:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.173+0000 7faef2800640 1 -- start start 2024-09-13T16:01:22.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.174+0000 7faef2800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faeec0afe10 0x7faeec148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:22.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.174+0000 7faef2800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faeec0cbac0 0x7faeec0b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.174+0000 7faef2800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeec15a5c0 0x7faeec155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.174+0000 7faef2800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec0b26b0 con 0x7faeec15a5c0 2024-09-13T16:01:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.174+0000 7faef2800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec149390 con 0x7faeec0afe10 2024-09-13T16:01:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.174+0000 7faef2800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec0b20f0 con 0x7faeec0cbac0 2024-09-13T16:01:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.174+0000 7faef1e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeec15a5c0 0x7faeec155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.174+0000 7faef1e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeec15a5c0 0x7faeec155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35732/0 (socket says 172.21.15.70:35732) 2024-09-13T16:01:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.174+0000 7faef1e00640 1 -- 172.21.15.70:0/1309510899 learned_addr learned my addr 172.21.15.70:0/1309510899 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.175+0000 7faef0a00640 1 --2- 172.21.15.70:0/1309510899 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faeec0cbac0 0x7faeec0b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.175+0000 7faef1400640 1 --2- 172.21.15.70:0/1309510899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faeec0afe10 0x7faeec148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.175+0000 7faef1e00640 1 -- 172.21.15.70:0/1309510899 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faeec0cbac0 msgr2=0x7faeec0b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.175+0000 7faef1e00640 1 --2- 172.21.15.70:0/1309510899 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faeec0cbac0 0x7faeec0b17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.175+0000 7faef1e00640 1 -- 172.21.15.70:0/1309510899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faeec0afe10 msgr2=0x7faeec148e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.175+0000 7faef1e00640 1 --2- 172.21.15.70:0/1309510899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faeec0afe10 0x7faeec148e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.175+0000 7faef1e00640 1 -- 172.21.15.70:0/1309510899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed8009400 con 0x7faeec15a5c0 2024-09-13T16:01:22.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.175+0000 7faef1400640 1 --2- 172.21.15.70:0/1309510899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faeec0afe10 0x7faeec148e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:22.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.175+0000 7faef1e00640 1 --2- 172.21.15.70:0/1309510899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeec15a5c0 0x7faeec155880 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faee400caa0 tx=0x7faee400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:22.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.175+0000 7faee9600640 1 -- 172.21.15.70:0/1309510899 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee400ac00 con 0x7faeec15a5c0 2024-09-13T16:01:22.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.175+0000 7faee9600640 1 -- 172.21.15.70:0/1309510899 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee400ad60 con 0x7faeec15a5c0 2024-09-13T16:01:22.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.175+0000 7faee9600640 1 -- 172.21.15.70:0/1309510899 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4012600 con 0x7faeec15a5c0 2024-09-13T16:01:22.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.175+0000 7faef2800640 1 -- 172.21.15.70:0/1309510899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeec0b23d0 con 0x7faeec15a5c0 2024-09-13T16:01:22.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.175+0000 7faef2800640 1 -- 172.21.15.70:0/1309510899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeec155360 con 0x7faeec15a5c0 2024-09-13T16:01:22.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.177+0000 7faef2800640 1 -- 172.21.15.70:0/1309510899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeec067360 con 0x7faeec15a5c0 2024-09-13T16:01:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.177+0000 7faee9600640 1 -- 172.21.15.70:0/1309510899 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faee4007070 con 0x7faeec15a5c0 2024-09-13T16:01:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.178+0000 7faee9600640 1 --2- 172.21.15.70:0/1309510899 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7faecc06ac00 0x7faecc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.178+0000 7faee9600640 1 -- 172.21.15.70:0/1309510899 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faee40891f0 con 0x7faeec15a5c0 2024-09-13T16:01:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.178+0000 7faef1400640 1 --2- 172.21.15.70:0/1309510899 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7faecc06ac00 0x7faecc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:22.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.179+0000 7faef1400640 1 --2- 172.21.15.70:0/1309510899 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7faecc06ac00 0x7faecc06d0c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faee0006fd0 tx=0x7faee0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:22.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.182+0000 7faee9600640 1 -- 172.21.15.70:0/1309510899 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faee4054470 con 0x7faeec15a5c0 2024-09-13T16:01:22.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.351+0000 7faef2800640 1 -- 172.21.15.70:0/1309510899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faeec068360 con 0x7faeec15a5c0 2024-09-13T16:01:22.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.353+0000 7faee9600640 1 -- 172.21.15.70:0/1309510899 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7faee4057a90 con 0x7faeec15a5c0 2024-09-13T16:01:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:22.354 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:19.595458+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:22.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.355+0000 7faef2800640 1 -- 172.21.15.70:0/1309510899 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7faecc06ac00 msgr2=0x7faecc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.355+0000 7faef2800640 1 --2- 172.21.15.70:0/1309510899 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7faecc06ac00 0x7faecc06d0c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faee0006fd0 tx=0x7faee0008040 comp rx=0 tx=0).stop 2024-09-13T16:01:22.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.355+0000 7faef2800640 1 -- 172.21.15.70:0/1309510899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeec15a5c0 msgr2=0x7faeec155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.355+0000 7faef2800640 1 --2- 172.21.15.70:0/1309510899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeec15a5c0 0x7faeec155880 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faee400caa0 tx=0x7faee400cf60 comp rx=0 tx=0).stop 2024-09-13T16:01:22.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.355+0000 7faef2800640 1 -- 172.21.15.70:0/1309510899 shutdown_connections 2024-09-13T16:01:22.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.355+0000 7faef2800640 1 --2- 172.21.15.70:0/1309510899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeec15a5c0 0x7faeec155880 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.355+0000 7faef2800640 1 --2- 172.21.15.70:0/1309510899 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faeec0cbac0 0x7faeec0b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.355+0000 7faef2800640 1 --2- 172.21.15.70:0/1309510899 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7faecc06ac00 0x7faecc06d0c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.355+0000 7faef2800640 1 --2- 172.21.15.70:0/1309510899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faeec0afe10 0x7faeec148e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.355+0000 7faef2800640 1 -- 172.21.15.70:0/1309510899 >> 172.21.15.70:0/1309510899 conn(0x7faeec0ae310 msgr2=0x7faeec06f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:22.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.355+0000 7faef2800640 1 -- 172.21.15.70:0/1309510899 shutdown_connections 2024-09-13T16:01:22.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.355+0000 7faef2800640 1 -- 172.21.15.70:0/1309510899 wait complete. 2024-09-13T16:01:22.372 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T16:01:22.372 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T16:01:22.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.522+0000 7f6342a00640 1 Processor -- start 2024-09-13T16:01:22.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.522+0000 7f6342a00640 1 -- start start 2024-09-13T16:01:22.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.523+0000 7f6342a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f633c0ac870 0x7f633c0acc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:22.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.523+0000 7f6342a00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633c13fbc0 con 0x7f633c0b3a40 2024-09-13T16:01:22.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.523+0000 7f6342a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633c15ce80 con 0x7f633c160370 2024-09-13T16:01:22.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.523+0000 7f6342a00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633c06cca0 con 0x7f633c0ac870 2024-09-13T16:01:22.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.523+0000 7f6340a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f633c0ac870 0x7f633c0acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:22.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.523+0000 7f633be00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f633c0b3a40 0x7f633c1428a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39048/0 (socket says 172.21.15.70:39048) 2024-09-13T16:01:22.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.523+0000 7f633be00640 1 -- 172.21.15.70:0/4019963261 learned_addr learned my addr 172.21.15.70:0/4019963261 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:22.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.524+0000 7f633aa00640 1 -- 172.21.15.70:0/4019963261 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474954223 0 0) 0x7f633c13fbc0 con 0x7f633c0b3a40 2024-09-13T16:01:22.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.524+0000 7f633aa00640 1 -- 172.21.15.70:0/4019963261 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6320003520 con 0x7f633c0b3a40 2024-09-13T16:01:22.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.524+0000 7f6340a00640 1 -- 172.21.15.70:0/4019963261 >> v1:172.21.15.107:6789/0 conn(0x7f633c160370 legacy=0x7f633c0b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.524+0000 7f6340a00640 1 -- 172.21.15.70:0/4019963261 >> v1:172.21.15.70:6789/0 conn(0x7f633c0b3a40 legacy=0x7f633c1428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.524+0000 7f6340a00640 1 -- 172.21.15.70:0/4019963261 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c0ad1c0 con 0x7f633c0ac870 2024-09-13T16:01:22.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.525+0000 7f6340a00640 1 --2- 172.21.15.70:0/4019963261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f633c0ac870 0x7f633c0acc80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6334009d90 tx=0x7f633402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d204473ee5c8ba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:22.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.525+0000 7f633aa00640 1 -- 172.21.15.70:0/4019963261 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6334007740 con 0x7f633c0ac870 2024-09-13T16:01:22.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.525+0000 7f633aa00640 1 -- 172.21.15.70:0/4019963261 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633402d050 con 0x7f633c0ac870 2024-09-13T16:01:22.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.525+0000 7f633aa00640 1 -- 172.21.15.70:0/4019963261 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6334007ac0 con 0x7f633c0ac870 2024-09-13T16:01:22.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.526+0000 7f6342a00640 1 -- 172.21.15.70:0/4019963261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f633c0ac870 msgr2=0x7f633c0acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.526+0000 7f6342a00640 1 --2- 172.21.15.70:0/4019963261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f633c0ac870 0x7f633c0acc80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6334009d90 tx=0x7f633402a660 comp rx=0 tx=0).stop 2024-09-13T16:01:22.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.526+0000 7f6342a00640 1 -- 172.21.15.70:0/4019963261 shutdown_connections 2024-09-13T16:01:22.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.526+0000 7f6342a00640 1 --2- 172.21.15.70:0/4019963261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f633c0ac870 0x7f633c0acc80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.526+0000 7f6342a00640 1 -- 172.21.15.70:0/4019963261 >> 172.21.15.70:0/4019963261 conn(0x7f633c0b0510 msgr2=0x7f633c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:22.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.526+0000 7f6342a00640 1 -- 172.21.15.70:0/4019963261 shutdown_connections 2024-09-13T16:01:22.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.526+0000 7f6342a00640 1 -- 172.21.15.70:0/4019963261 wait complete. 2024-09-13T16:01:22.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.527+0000 7f6342a00640 1 Processor -- start 2024-09-13T16:01:22.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.528+0000 7f6342a00640 1 -- start start 2024-09-13T16:01:22.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.528+0000 7f6342a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f633c0ac870 0x7f633c144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:22.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.528+0000 7f6342a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f633c0b3a40 0x7f633c1550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:22.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.529+0000 7f6342a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f633c160370 0x7f633c13ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.529+0000 7f6342a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c154c50 con 0x7f633c0ac870 2024-09-13T16:01:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.529+0000 7f6342a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c154040 con 0x7f633c160370 2024-09-13T16:01:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.529+0000 7f6342a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c154320 con 0x7f633c0b3a40 2024-09-13T16:01:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.529+0000 7f633be00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f633c0ac870 0x7f633c144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.529+0000 7f633be00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f633c0ac870 0x7f633c144bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35754/0 (socket says 172.21.15.70:35754) 2024-09-13T16:01:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.529+0000 7f633be00640 1 -- 172.21.15.70:0/4188487105 learned_addr learned my addr 172.21.15.70:0/4188487105 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.529+0000 7f633b400640 1 --2- 172.21.15.70:0/4188487105 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f633c0b3a40 0x7f633c1550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.529+0000 7f6340a00640 1 --2- 172.21.15.70:0/4188487105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f633c160370 0x7f633c13ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.529+0000 7f633be00640 1 -- 172.21.15.70:0/4188487105 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f633c0b3a40 msgr2=0x7f633c1550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.529+0000 7f633be00640 1 --2- 172.21.15.70:0/4188487105 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f633c0b3a40 0x7f633c1550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.529+0000 7f633be00640 1 -- 172.21.15.70:0/4188487105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f633c160370 msgr2=0x7f633c13ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.529+0000 7f633be00640 1 --2- 172.21.15.70:0/4188487105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f633c160370 0x7f633c13ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.529+0000 7f633be00640 1 -- 172.21.15.70:0/4188487105 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6334009a70 con 0x7f633c0ac870 2024-09-13T16:01:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.529+0000 7f6340a00640 1 --2- 172.21.15.70:0/4188487105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f633c160370 0x7f633c13ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.530+0000 7f633be00640 1 --2- 172.21.15.70:0/4188487105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f633c0ac870 0x7f633c144bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f632c00c500 tx=0x7f632c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.530+0000 7f6333e00640 1 -- 172.21.15.70:0/4188487105 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c005ce0 con 0x7f633c0ac870 2024-09-13T16:01:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.530+0000 7f6333e00640 1 -- 172.21.15.70:0/4188487105 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c005e40 con 0x7f633c0ac870 2024-09-13T16:01:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.530+0000 7f6333e00640 1 -- 172.21.15.70:0/4188487105 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c007330 con 0x7f633c0ac870 2024-09-13T16:01:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.530+0000 7f6342a00640 1 -- 172.21.15.70:0/4188487105 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633c154600 con 0x7f633c0ac870 2024-09-13T16:01:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.530+0000 7f6342a00640 1 -- 172.21.15.70:0/4188487105 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633c145130 con 0x7f633c0ac870 2024-09-13T16:01:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.531+0000 7f6342a00640 1 -- 172.21.15.70:0/4188487105 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633c0acc80 con 0x7f633c0ac870 2024-09-13T16:01:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.532+0000 7f6333e00640 1 -- 172.21.15.70:0/4188487105 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f632c007550 con 0x7f633c0ac870 2024-09-13T16:01:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.533+0000 7f6333e00640 1 --2- 172.21.15.70:0/4188487105 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f631c06ac00 0x7f631c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.533+0000 7f6333e00640 1 -- 172.21.15.70:0/4188487105 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f632c088860 con 0x7f633c0ac870 2024-09-13T16:01:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.533+0000 7f633b400640 1 --2- 172.21.15.70:0/4188487105 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f631c06ac00 0x7f631c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.534+0000 7f633b400640 1 --2- 172.21.15.70:0/4188487105 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f631c06ac00 0x7f631c06d0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f633c0cdb90 tx=0x7f6328009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.537+0000 7f6333e00640 1 -- 172.21.15.70:0/4188487105 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f632c053c40 con 0x7f633c0ac870 2024-09-13T16:01:22.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.703+0000 7f6342a00640 1 -- 172.21.15.70:0/4188487105 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f633c160ed0 con 0x7f631c06ac00 2024-09-13T16:01:22.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.712+0000 7f6333e00640 1 -- 172.21.15.70:0/4188487105 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264600 (secure 0 0 0) 0x7f6328001d10 con 0x7f631c06ac00 2024-09-13T16:01:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:22.717 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-13T16:01:22.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.715+0000 7f6342a00640 1 -- 172.21.15.70:0/4188487105 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f631c06ac00 msgr2=0x7f631c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.715+0000 7f6342a00640 1 --2- 172.21.15.70:0/4188487105 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f631c06ac00 0x7f631c06d0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f633c0cdb90 tx=0x7f6328009040 comp rx=0 tx=0).stop 2024-09-13T16:01:22.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.715+0000 7f6342a00640 1 -- 172.21.15.70:0/4188487105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f633c0ac870 msgr2=0x7f633c144bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.715+0000 7f6342a00640 1 --2- 172.21.15.70:0/4188487105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f633c0ac870 0x7f633c144bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f632c00c500 tx=0x7f632c00c9c0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.716+0000 7f6342a00640 1 -- 172.21.15.70:0/4188487105 shutdown_connections 2024-09-13T16:01:22.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.716+0000 7f6342a00640 1 --2- 172.21.15.70:0/4188487105 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f631c06ac00 0x7f631c06d0c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.716+0000 7f6342a00640 1 --2- 172.21.15.70:0/4188487105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f633c160370 0x7f633c13ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.716+0000 7f6342a00640 1 --2- 172.21.15.70:0/4188487105 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f633c0b3a40 0x7f633c1550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.716+0000 7f6342a00640 1 --2- 172.21.15.70:0/4188487105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f633c0ac870 0x7f633c144bf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.716+0000 7f6342a00640 1 -- 172.21.15.70:0/4188487105 >> 172.21.15.70:0/4188487105 conn(0x7f633c0b0510 msgr2=0x7f633c15f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:22.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.716+0000 7f6342a00640 1 -- 172.21.15.70:0/4188487105 shutdown_connections 2024-09-13T16:01:22.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.716+0000 7f6342a00640 1 -- 172.21.15.70:0/4188487105 wait complete. 2024-09-13T16:01:22.732 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-13T16:01:22.018324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235308,"kb_used_data":2748,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739412,"statfs":{"total":773094113280,"available":772853157888,"internally_reserved":0,"allocated":2813952,"data_stored":1713825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.841833"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.647151+0000","last_change":"2024-09-13T16:01:18.644594+0000","last_active":"2024-09-13T16:01:18.647151+0000","last_peered":"2024-09-13T16:01:18.647151+0000","last_clean":"2024-09-13T16:01:18.647151+0000","last_became_active":"2024-09-13T16:01:18.644356+0000","last_became_peered":"2024-09-13T16:01:18.644356+0000","last_unstale":"2024-09-13T16:01:18.647151+0000","last_undegraded":"2024-09-13T16:01:18.647151+0000","last_fullsized":"2024-09-13T16:01:18.647151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:20.422612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603423+0000","last_change":"2024-09-13T16:01:18.624268+0000","last_active":"2024-09-13T16:01:19.603423+0000","last_peered":"2024-09-13T16:01:19.603423+0000","last_clean":"2024-09-13T16:01:19.603423+0000","last_became_active":"2024-09-13T16:01:18.624050+0000","last_became_peered":"2024-09-13T16:01:18.624050+0000","last_unstale":"2024-09-13T16:01:19.603423+0000","last_undegraded":"2024-09-13T16:01:19.603423+0000","last_fullsized":"2024-09-13T16:01:19.603423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.626454+0000","last_change":"2024-09-13T16:01:18.623991+0000","last_active":"2024-09-13T16:01:18.626454+0000","last_peered":"2024-09-13T16:01:18.626454+0000","last_clean":"2024-09-13T16:01:18.626454+0000","last_became_active":"2024-09-13T16:01:18.623492+0000","last_became_peered":"2024-09-13T16:01:18.623492+0000","last_unstale":"2024-09-13T16:01:18.626454+0000","last_undegraded":"2024-09-13T16:01:18.626454+0000","last_fullsized":"2024-09-13T16:01:18.626454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:33:59.929449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.634599+0000","last_change":"2024-09-13T16:01:18.630873+0000","last_active":"2024-09-13T16:01:18.634599+0000","last_peered":"2024-09-13T16:01:18.634599+0000","last_clean":"2024-09-13T16:01:18.634599+0000","last_became_active":"2024-09-13T16:01:18.630446+0000","last_became_peered":"2024-09-13T16:01:18.630446+0000","last_unstale":"2024-09-13T16:01:18.634599+0000","last_undegraded":"2024-09-13T16:01:18.634599+0000","last_fullsized":"2024-09-13T16:01:18.634599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:43.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.644381+0000","last_change":"2024-09-13T16:01:18.637355+0000","last_active":"2024-09-13T16:01:18.644381+0000","last_peered":"2024-09-13T16:01:18.644381+0000","last_clean":"2024-09-13T16:01:18.644381+0000","last_became_active":"2024-09-13T16:01:18.637053+0000","last_became_peered":"2024-09-13T16:01:18.637053+0000","last_unstale":"2024-09-13T16:01:18.644381+0000","last_undegraded":"2024-09-13T16:01:18.644381+0000","last_fullsized":"2024-09-13T16:01:18.644381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:11.951128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.631756+0000","last_change":"2024-09-13T16:01:18.626648+0000","last_active":"2024-09-13T16:01:18.631756+0000","last_peered":"2024-09-13T16:01:18.631756+0000","last_clean":"2024-09-13T16:01:18.631756+0000","last_became_active":"2024-09-13T16:01:18.625618+0000","last_became_peered":"2024-09-13T16:01:18.625618+0000","last_unstale":"2024-09-13T16:01:18.631756+0000","last_undegraded":"2024-09-13T16:01:18.631756+0000","last_fullsized":"2024-09-13T16:01:18.631756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:50.539415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.640944+0000","last_change":"2024-09-13T16:01:18.632016+0000","last_active":"2024-09-13T16:01:18.640944+0000","last_peered":"2024-09-13T16:01:18.640944+0000","last_clean":"2024-09-13T16:01:18.640944+0000","last_became_active":"2024-09-13T16:01:18.631753+0000","last_became_peered":"2024-09-13T16:01:18.631753+0000","last_unstale":"2024-09-13T16:01:18.640944+0000","last_undegraded":"2024-09-13T16:01:18.640944+0000","last_fullsized":"2024-09-13T16:01:18.640944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:26.431089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.630951+0000","last_change":"2024-09-13T16:01:18.628899+0000","last_active":"2024-09-13T16:01:18.630951+0000","last_peered":"2024-09-13T16:01:18.630951+0000","last_clean":"2024-09-13T16:01:18.630951+0000","last_became_active":"2024-09-13T16:01:18.628268+0000","last_became_peered":"2024-09-13T16:01:18.628268+0000","last_unstale":"2024-09-13T16:01:18.630951+0000","last_undegraded":"2024-09-13T16:01:18.630951+0000","last_fullsized":"2024-09-13T16:01:18.630951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:18.317702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.644982+0000","last_change":"2024-09-13T16:01:18.641494+0000","last_active":"2024-09-13T16:01:18.644982+0000","last_peered":"2024-09-13T16:01:18.644982+0000","last_clean":"2024-09-13T16:01:18.644982+0000","last_became_active":"2024-09-13T16:01:18.641183+0000","last_became_peered":"2024-09-13T16:01:18.641183+0000","last_unstale":"2024-09-13T16:01:18.644982+0000","last_undegraded":"2024-09-13T16:01:18.644982+0000","last_fullsized":"2024-09-13T16:01:18.644982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:10.009263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604131+0000","last_change":"2024-09-13T16:01:18.632143+0000","last_active":"2024-09-13T16:01:19.604131+0000","last_peered":"2024-09-13T16:01:19.604131+0000","last_clean":"2024-09-13T16:01:19.604131+0000","last_became_active":"2024-09-13T16:01:18.630476+0000","last_became_peered":"2024-09-13T16:01:18.630476+0000","last_unstale":"2024-09-13T16:01:19.604131+0000","last_undegraded":"2024-09-13T16:01:19.604131+0000","last_fullsized":"2024-09-13T16:01:19.604131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:52.684760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603862+0000","last_change":"2024-09-13T16:01:18.626009+0000","last_active":"2024-09-13T16:01:19.603862+0000","last_peered":"2024-09-13T16:01:19.603862+0000","last_clean":"2024-09-13T16:01:19.603862+0000","last_became_active":"2024-09-13T16:01:18.625643+0000","last_became_peered":"2024-09-13T16:01:18.625643+0000","last_unstale":"2024-09-13T16:01:19.603862+0000","last_undegraded":"2024-09-13T16:01:19.603862+0000","last_fullsized":"2024-09-13T16:01:19.603862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.627395+0000","last_change":"2024-09-13T16:01:18.619953+0000","last_active":"2024-09-13T16:01:18.627395+0000","last_peered":"2024-09-13T16:01:18.627395+0000","last_clean":"2024-09-13T16:01:18.627395+0000","last_became_active":"2024-09-13T16:01:18.619529+0000","last_became_peered":"2024-09-13T16:01:18.619529+0000","last_unstale":"2024-09-13T16:01:18.627395+0000","last_undegraded":"2024-09-13T16:01:18.627395+0000","last_fullsized":"2024-09-13T16:01:18.627395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:56.513378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.615944+0000","last_change":"2024-09-13T16:01:18.611600+0000","last_active":"2024-09-13T16:01:18.615944+0000","last_peered":"2024-09-13T16:01:18.615944+0000","last_clean":"2024-09-13T16:01:18.615944+0000","last_became_active":"2024-09-13T16:01:18.611355+0000","last_became_peered":"2024-09-13T16:01:18.611355+0000","last_unstale":"2024-09-13T16:01:18.615944+0000","last_undegraded":"2024-09-13T16:01:18.615944+0000","last_fullsized":"2024-09-13T16:01:18.615944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:52.684760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.629446+0000","last_change":"2024-09-13T16:01:18.626872+0000","last_active":"2024-09-13T16:01:18.629446+0000","last_peered":"2024-09-13T16:01:18.629446+0000","last_clean":"2024-09-13T16:01:18.629446+0000","last_became_active":"2024-09-13T16:01:18.625476+0000","last_became_peered":"2024-09-13T16:01:18.625476+0000","last_unstale":"2024-09-13T16:01:18.629446+0000","last_undegraded":"2024-09-13T16:01:18.629446+0000","last_fullsized":"2024-09-13T16:01:18.629446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:28.990573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603123+0000","last_change":"2024-09-13T16:01:18.630422+0000","last_active":"2024-09-13T16:01:19.603123+0000","last_peered":"2024-09-13T16:01:19.603123+0000","last_clean":"2024-09-13T16:01:19.603123+0000","last_became_active":"2024-09-13T16:01:18.630174+0000","last_became_peered":"2024-09-13T16:01:18.630174+0000","last_unstale":"2024-09-13T16:01:19.603123+0000","last_undegraded":"2024-09-13T16:01:19.603123+0000","last_fullsized":"2024-09-13T16:01:19.603123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:52.684760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.631636+0000","last_change":"2024-09-13T16:01:18.625202+0000","last_active":"2024-09-13T16:01:18.631636+0000","last_peered":"2024-09-13T16:01:18.631636+0000","last_clean":"2024-09-13T16:01:18.631636+0000","last_became_active":"2024-09-13T16:01:18.624886+0000","last_became_peered":"2024-09-13T16:01:18.624886+0000","last_unstale":"2024-09-13T16:01:18.631636+0000","last_undegraded":"2024-09-13T16:01:18.631636+0000","last_fullsized":"2024-09-13T16:01:18.631636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:19.302417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.632973+0000","last_change":"2024-09-13T16:01:18.621201+0000","last_active":"2024-09-13T16:01:18.632973+0000","last_peered":"2024-09-13T16:01:18.632973+0000","last_clean":"2024-09-13T16:01:18.632973+0000","last_became_active":"2024-09-13T16:01:18.620822+0000","last_became_peered":"2024-09-13T16:01:18.620822+0000","last_unstale":"2024-09-13T16:01:18.632973+0000","last_undegraded":"2024-09-13T16:01:18.632973+0000","last_fullsized":"2024-09-13T16:01:18.632973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:55.299980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603906+0000","last_change":"2024-09-13T16:01:18.621201+0000","last_active":"2024-09-13T16:01:19.603906+0000","last_peered":"2024-09-13T16:01:19.603906+0000","last_clean":"2024-09-13T16:01:19.603906+0000","last_became_active":"2024-09-13T16:01:18.619264+0000","last_became_peered":"2024-09-13T16:01:18.619264+0000","last_unstale":"2024-09-13T16:01:19.603906+0000","last_undegraded":"2024-09-13T16:01:19.603906+0000","last_fullsized":"2024-09-13T16:01:19.603906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:03.072242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.641026+0000","last_change":"2024-09-13T16:01:18.635920+0000","last_active":"2024-09-13T16:01:18.641026+0000","last_peered":"2024-09-13T16:01:18.641026+0000","last_clean":"2024-09-13T16:01:18.641026+0000","last_became_active":"2024-09-13T16:01:18.634437+0000","last_became_peered":"2024-09-13T16:01:18.634437+0000","last_unstale":"2024-09-13T16:01:18.641026+0000","last_undegraded":"2024-09-13T16:01:18.641026+0000","last_fullsized":"2024-09-13T16:01:18.641026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:43.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603898+0000","last_change":"2024-09-13T16:01:18.618207+0000","last_active":"2024-09-13T16:01:19.603898+0000","last_peered":"2024-09-13T16:01:19.603898+0000","last_clean":"2024-09-13T16:01:19.603898+0000","last_became_active":"2024-09-13T16:01:18.617859+0000","last_became_peered":"2024-09-13T16:01:18.617859+0000","last_unstale":"2024-09-13T16:01:19.603898+0000","last_undegraded":"2024-09-13T16:01:19.603898+0000","last_fullsized":"2024-09-13T16:01:19.603898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:49.813372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.629749+0000","last_change":"2024-09-13T16:01:18.627158+0000","last_active":"2024-09-13T16:01:18.629749+0000","last_peered":"2024-09-13T16:01:18.629749+0000","last_clean":"2024-09-13T16:01:18.629749+0000","last_became_active":"2024-09-13T16:01:18.627010+0000","last_became_peered":"2024-09-13T16:01:18.627010+0000","last_unstale":"2024-09-13T16:01:18.629749+0000","last_undegraded":"2024-09-13T16:01:18.629749+0000","last_fullsized":"2024-09-13T16:01:18.629749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:08.669688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.631776+0000","last_change":"2024-09-13T16:01:18.625912+0000","last_active":"2024-09-13T16:01:18.631776+0000","last_peered":"2024-09-13T16:01:18.631776+0000","last_clean":"2024-09-13T16:01:18.631776+0000","last_became_active":"2024-09-13T16:01:18.625254+0000","last_became_peered":"2024-09-13T16:01:18.625254+0000","last_unstale":"2024-09-13T16:01:18.631776+0000","last_undegraded":"2024-09-13T16:01:18.631776+0000","last_fullsized":"2024-09-13T16:01:18.631776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:10.009263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.630896+0000","last_change":"2024-09-13T16:01:18.628744+0000","last_active":"2024-09-13T16:01:18.630896+0000","last_peered":"2024-09-13T16:01:18.630896+0000","last_clean":"2024-09-13T16:01:18.630896+0000","last_became_active":"2024-09-13T16:01:18.628467+0000","last_became_peered":"2024-09-13T16:01:18.628467+0000","last_unstale":"2024-09-13T16:01:18.630896+0000","last_undegraded":"2024-09-13T16:01:18.630896+0000","last_fullsized":"2024-09-13T16:01:18.630896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:20.422612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.639890+0000","last_change":"2024-09-13T16:01:18.634330+0000","last_active":"2024-09-13T16:01:18.639890+0000","last_peered":"2024-09-13T16:01:18.639890+0000","last_clean":"2024-09-13T16:01:18.639890+0000","last_became_active":"2024-09-13T16:01:18.633542+0000","last_became_peered":"2024-09-13T16:01:18.633542+0000","last_unstale":"2024-09-13T16:01:18.639890+0000","last_undegraded":"2024-09-13T16:01:18.639890+0000","last_fullsized":"2024-09-13T16:01:18.639890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.616503+0000","last_change":"2024-09-13T16:01:18.615790+0000","last_active":"2024-09-13T16:01:18.616503+0000","last_peered":"2024-09-13T16:01:18.616503+0000","last_clean":"2024-09-13T16:01:18.616503+0000","last_became_active":"2024-09-13T16:01:18.615102+0000","last_became_peered":"2024-09-13T16:01:18.615102+0000","last_unstale":"2024-09-13T16:01:18.616503+0000","last_undegraded":"2024-09-13T16:01:18.616503+0000","last_fullsized":"2024-09-13T16:01:18.616503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:28.548177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604211+0000","last_change":"2024-09-13T16:01:18.619972+0000","last_active":"2024-09-13T16:01:19.604211+0000","last_peered":"2024-09-13T16:01:19.604211+0000","last_clean":"2024-09-13T16:01:19.604211+0000","last_became_active":"2024-09-13T16:01:18.619393+0000","last_became_peered":"2024-09-13T16:01:18.619393+0000","last_unstale":"2024-09-13T16:01:19.604211+0000","last_undegraded":"2024-09-13T16:01:19.604211+0000","last_fullsized":"2024-09-13T16:01:19.604211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603306+0000","last_change":"2024-09-13T16:01:18.604836+0000","last_active":"2024-09-13T16:01:19.603306+0000","last_peered":"2024-09-13T16:01:19.603306+0000","last_clean":"2024-09-13T16:01:19.603306+0000","last_became_active":"2024-09-13T16:01:18.604598+0000","last_became_peered":"2024-09-13T16:01:18.604598+0000","last_unstale":"2024-09-13T16:01:19.603306+0000","last_undegraded":"2024-09-13T16:01:19.603306+0000","last_fullsized":"2024-09-13T16:01:19.603306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:19.302417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.626278+0000","last_change":"2024-09-13T16:01:18.624936+0000","last_active":"2024-09-13T16:01:18.626278+0000","last_peered":"2024-09-13T16:01:18.626278+0000","last_clean":"2024-09-13T16:01:18.626278+0000","last_became_active":"2024-09-13T16:01:18.619895+0000","last_became_peered":"2024-09-13T16:01:18.619895+0000","last_unstale":"2024-09-13T16:01:18.626278+0000","last_undegraded":"2024-09-13T16:01:18.626278+0000","last_fullsized":"2024-09-13T16:01:18.626278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:11.951128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.621830+0000","last_change":"2024-09-13T16:01:18.618591+0000","last_active":"2024-09-13T16:01:18.621830+0000","last_peered":"2024-09-13T16:01:18.621830+0000","last_clean":"2024-09-13T16:01:18.621830+0000","last_became_active":"2024-09-13T16:01:18.618365+0000","last_became_peered":"2024-09-13T16:01:18.618365+0000","last_unstale":"2024-09-13T16:01:18.621830+0000","last_undegraded":"2024-09-13T16:01:18.621830+0000","last_fullsized":"2024-09-13T16:01:18.621830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:52.684760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.625432+0000","last_change":"2024-09-13T16:01:18.618017+0000","last_active":"2024-09-13T16:01:18.625432+0000","last_peered":"2024-09-13T16:01:18.625432+0000","last_clean":"2024-09-13T16:01:18.625432+0000","last_became_active":"2024-09-13T16:01:18.617614+0000","last_became_peered":"2024-09-13T16:01:18.617614+0000","last_unstale":"2024-09-13T16:01:18.625432+0000","last_undegraded":"2024-09-13T16:01:18.625432+0000","last_fullsized":"2024-09-13T16:01:18.625432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:49.331305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603841+0000","last_change":"2024-09-13T16:01:18.619441+0000","last_active":"2024-09-13T16:01:19.603841+0000","last_peered":"2024-09-13T16:01:19.603841+0000","last_clean":"2024-09-13T16:01:19.603841+0000","last_became_active":"2024-09-13T16:01:18.619196+0000","last_became_peered":"2024-09-13T16:01:18.619196+0000","last_unstale":"2024-09-13T16:01:19.603841+0000","last_undegraded":"2024-09-13T16:01:19.603841+0000","last_fullsized":"2024-09-13T16:01:19.603841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:56.513378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603751+0000","last_change":"2024-09-13T16:01:18.629618+0000","last_active":"2024-09-13T16:01:19.603751+0000","last_peered":"2024-09-13T16:01:19.603751+0000","last_clean":"2024-09-13T16:01:19.603751+0000","last_became_active":"2024-09-13T16:01:18.625774+0000","last_became_peered":"2024-09-13T16:01:18.625774+0000","last_unstale":"2024-09-13T16:01:19.603751+0000","last_undegraded":"2024-09-13T16:01:19.603751+0000","last_fullsized":"2024-09-13T16:01:19.603751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:54.527079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.627391+0000","last_change":"2024-09-13T16:01:18.617833+0000","last_active":"2024-09-13T16:01:18.627391+0000","last_peered":"2024-09-13T16:01:18.627391+0000","last_clean":"2024-09-13T16:01:18.627391+0000","last_became_active":"2024-09-13T16:01:18.614256+0000","last_became_peered":"2024-09-13T16:01:18.614256+0000","last_unstale":"2024-09-13T16:01:18.627391+0000","last_undegraded":"2024-09-13T16:01:18.627391+0000","last_fullsized":"2024-09-13T16:01:18.627391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:28.217399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.614442+0000","last_change":"2024-09-13T16:01:18.208438+0000","last_active":"2024-09-13T16:01:18.614442+0000","last_peered":"2024-09-13T16:01:18.614442+0000","last_clean":"2024-09-13T16:01:18.614442+0000","last_became_active":"2024-09-13T16:01:18.207954+0000","last_became_peered":"2024-09-13T16:01:18.207954+0000","last_unstale":"2024-09-13T16:01:18.614442+0000","last_undegraded":"2024-09-13T16:01:18.614442+0000","last_fullsized":"2024-09-13T16:01:18.614442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:41.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.633026+0000","last_change":"2024-09-13T16:01:18.632108+0000","last_active":"2024-09-13T16:01:18.633026+0000","last_peered":"2024-09-13T16:01:18.633026+0000","last_clean":"2024-09-13T16:01:18.633026+0000","last_became_active":"2024-09-13T16:01:18.631731+0000","last_became_peered":"2024-09-13T16:01:18.631731+0000","last_unstale":"2024-09-13T16:01:18.633026+0000","last_undegraded":"2024-09-13T16:01:18.633026+0000","last_fullsized":"2024-09-13T16:01:18.633026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604145+0000","last_change":"2024-09-13T16:01:18.207085+0000","last_active":"2024-09-13T16:01:19.604145+0000","last_peered":"2024-09-13T16:01:19.604145+0000","last_clean":"2024-09-13T16:01:19.604145+0000","last_became_active":"2024-09-13T16:01:18.205734+0000","last_became_peered":"2024-09-13T16:01:18.205734+0000","last_unstale":"2024-09-13T16:01:19.604145+0000","last_undegraded":"2024-09-13T16:01:19.604145+0000","last_fullsized":"2024-09-13T16:01:19.604145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.601249+0000","last_change":"2024-09-13T16:01:18.206489+0000","last_active":"2024-09-13T16:01:18.601249+0000","last_peered":"2024-09-13T16:01:18.601249+0000","last_clean":"2024-09-13T16:01:18.601249+0000","last_became_active":"2024-09-13T16:01:18.206251+0000","last_became_peered":"2024-09-13T16:01:18.206251+0000","last_unstale":"2024-09-13T16:01:18.601249+0000","last_undegraded":"2024-09-13T16:01:18.601249+0000","last_fullsized":"2024-09-13T16:01:18.601249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.631116+0000","last_change":"2024-09-13T16:01:18.629111+0000","last_active":"2024-09-13T16:01:18.631116+0000","last_peered":"2024-09-13T16:01:18.631116+0000","last_clean":"2024-09-13T16:01:18.631116+0000","last_became_active":"2024-09-13T16:01:18.628667+0000","last_became_peered":"2024-09-13T16:01:18.628667+0000","last_unstale":"2024-09-13T16:01:18.631116+0000","last_undegraded":"2024-09-13T16:01:18.631116+0000","last_fullsized":"2024-09-13T16:01:18.631116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:49.813372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.617495+0000","last_change":"2024-09-13T16:01:18.201791+0000","last_active":"2024-09-13T16:01:18.617495+0000","last_peered":"2024-09-13T16:01:18.617495+0000","last_clean":"2024-09-13T16:01:18.617495+0000","last_became_active":"2024-09-13T16:01:18.201494+0000","last_became_peered":"2024-09-13T16:01:18.201494+0000","last_unstale":"2024-09-13T16:01:18.617495+0000","last_undegraded":"2024-09-13T16:01:18.617495+0000","last_fullsized":"2024-09-13T16:01:18.617495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:29.574043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603176+0000","last_change":"2024-09-13T16:01:18.606975+0000","last_active":"2024-09-13T16:01:19.603176+0000","last_peered":"2024-09-13T16:01:19.603176+0000","last_clean":"2024-09-13T16:01:19.603176+0000","last_became_active":"2024-09-13T16:01:18.604210+0000","last_became_peered":"2024-09-13T16:01:18.604210+0000","last_unstale":"2024-09-13T16:01:19.603176+0000","last_undegraded":"2024-09-13T16:01:19.603176+0000","last_fullsized":"2024-09-13T16:01:19.603176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:18.317702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603997+0000","last_change":"2024-09-13T16:01:18.209833+0000","last_active":"2024-09-13T16:01:19.603997+0000","last_peered":"2024-09-13T16:01:19.603997+0000","last_clean":"2024-09-13T16:01:19.603997+0000","last_became_active":"2024-09-13T16:01:18.209539+0000","last_became_peered":"2024-09-13T16:01:18.209539+0000","last_unstale":"2024-09-13T16:01:19.603997+0000","last_undegraded":"2024-09-13T16:01:19.603997+0000","last_fullsized":"2024-09-13T16:01:19.603997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:29.574043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.629292+0000","last_change":"2024-09-13T16:01:18.625735+0000","last_active":"2024-09-13T16:01:18.629292+0000","last_peered":"2024-09-13T16:01:18.629292+0000","last_clean":"2024-09-13T16:01:18.629292+0000","last_became_active":"2024-09-13T16:01:18.625512+0000","last_became_peered":"2024-09-13T16:01:18.625512+0000","last_unstale":"2024-09-13T16:01:18.629292+0000","last_undegraded":"2024-09-13T16:01:18.629292+0000","last_fullsized":"2024-09-13T16:01:18.629292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:26.431089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.620699+0000","last_change":"2024-09-13T16:01:18.211782+0000","last_active":"2024-09-13T16:01:18.620699+0000","last_peered":"2024-09-13T16:01:18.620699+0000","last_clean":"2024-09-13T16:01:18.620699+0000","last_became_active":"2024-09-13T16:01:18.211163+0000","last_became_peered":"2024-09-13T16:01:18.211163+0000","last_unstale":"2024-09-13T16:01:18.620699+0000","last_undegraded":"2024-09-13T16:01:18.620699+0000","last_fullsized":"2024-09-13T16:01:18.620699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:33.908621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.629714+0000","last_change":"2024-09-13T16:01:18.627394+0000","last_active":"2024-09-13T16:01:18.629714+0000","last_peered":"2024-09-13T16:01:18.629714+0000","last_clean":"2024-09-13T16:01:18.629714+0000","last_became_active":"2024-09-13T16:01:18.624519+0000","last_became_peered":"2024-09-13T16:01:18.624519+0000","last_unstale":"2024-09-13T16:01:18.629714+0000","last_undegraded":"2024-09-13T16:01:18.629714+0000","last_fullsized":"2024-09-13T16:01:18.629714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:49.813372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603339+0000","last_change":"2024-09-13T16:01:18.210433+0000","last_active":"2024-09-13T16:01:19.603339+0000","last_peered":"2024-09-13T16:01:19.603339+0000","last_clean":"2024-09-13T16:01:19.603339+0000","last_became_active":"2024-09-13T16:01:18.210161+0000","last_became_peered":"2024-09-13T16:01:18.210161+0000","last_unstale":"2024-09-13T16:01:19.603339+0000","last_undegraded":"2024-09-13T16:01:19.603339+0000","last_fullsized":"2024-09-13T16:01:19.603339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:55.507079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.637525+0000","last_change":"2024-09-13T16:01:18.630661+0000","last_active":"2024-09-13T16:01:18.637525+0000","last_peered":"2024-09-13T16:01:18.637525+0000","last_clean":"2024-09-13T16:01:18.637525+0000","last_became_active":"2024-09-13T16:01:18.630386+0000","last_became_peered":"2024-09-13T16:01:18.630386+0000","last_unstale":"2024-09-13T16:01:18.637525+0000","last_undegraded":"2024-09-13T16:01:18.637525+0000","last_fullsized":"2024-09-13T16:01:18.637525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:34.993393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603975+0000","last_change":"2024-09-13T16:01:18.197317+0000","last_active":"2024-09-13T16:01:19.603975+0000","last_peered":"2024-09-13T16:01:19.603975+0000","last_clean":"2024-09-13T16:01:19.603975+0000","last_became_active":"2024-09-13T16:01:18.197022+0000","last_became_peered":"2024-09-13T16:01:18.197022+0000","last_unstale":"2024-09-13T16:01:19.603975+0000","last_undegraded":"2024-09-13T16:01:19.603975+0000","last_fullsized":"2024-09-13T16:01:19.603975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:11.867906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.641067+0000","last_change":"2024-09-13T16:01:18.636601+0000","last_active":"2024-09-13T16:01:18.641067+0000","last_peered":"2024-09-13T16:01:18.641067+0000","last_clean":"2024-09-13T16:01:18.641067+0000","last_became_active":"2024-09-13T16:01:18.636246+0000","last_became_peered":"2024-09-13T16:01:18.636246+0000","last_unstale":"2024-09-13T16:01:18.641067+0000","last_undegraded":"2024-09-13T16:01:18.641067+0000","last_fullsized":"2024-09-13T16:01:18.641067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:55.299980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.632078+0000","last_change":"2024-09-13T16:01:18.207068+0000","last_active":"2024-09-13T16:01:18.632078+0000","last_peered":"2024-09-13T16:01:18.632078+0000","last_clean":"2024-09-13T16:01:18.632078+0000","last_became_active":"2024-09-13T16:01:18.206783+0000","last_became_peered":"2024-09-13T16:01:18.206783+0000","last_unstale":"2024-09-13T16:01:18.632078+0000","last_undegraded":"2024-09-13T16:01:18.632078+0000","last_fullsized":"2024-09-13T16:01:18.632078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:47.286118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.622539+0000","last_change":"2024-09-13T16:01:18.618465+0000","last_active":"2024-09-13T16:01:18.622539+0000","last_peered":"2024-09-13T16:01:18.622539+0000","last_clean":"2024-09-13T16:01:18.622539+0000","last_became_active":"2024-09-13T16:01:18.618200+0000","last_became_peered":"2024-09-13T16:01:18.618200+0000","last_unstale":"2024-09-13T16:01:18.622539+0000","last_undegraded":"2024-09-13T16:01:18.622539+0000","last_fullsized":"2024-09-13T16:01:18.622539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:54.527079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.618743+0000","last_change":"2024-09-13T16:01:18.208243+0000","last_active":"2024-09-13T16:01:18.618743+0000","last_peered":"2024-09-13T16:01:18.618743+0000","last_clean":"2024-09-13T16:01:18.618743+0000","last_became_active":"2024-09-13T16:01:18.207672+0000","last_became_peered":"2024-09-13T16:01:18.207672+0000","last_unstale":"2024-09-13T16:01:18.618743+0000","last_undegraded":"2024-09-13T16:01:18.618743+0000","last_fullsized":"2024-09-13T16:01:18.618743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.644401+0000","last_change":"2024-09-13T16:01:18.639262+0000","last_active":"2024-09-13T16:01:18.644401+0000","last_peered":"2024-09-13T16:01:18.644401+0000","last_clean":"2024-09-13T16:01:18.644401+0000","last_became_active":"2024-09-13T16:01:18.639026+0000","last_became_peered":"2024-09-13T16:01:18.639026+0000","last_unstale":"2024-09-13T16:01:18.644401+0000","last_undegraded":"2024-09-13T16:01:18.644401+0000","last_fullsized":"2024-09-13T16:01:18.644401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:49.331305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603731+0000","last_change":"2024-09-13T16:01:18.201169+0000","last_active":"2024-09-13T16:01:19.603731+0000","last_peered":"2024-09-13T16:01:19.603731+0000","last_clean":"2024-09-13T16:01:19.603731+0000","last_became_active":"2024-09-13T16:01:18.199492+0000","last_became_peered":"2024-09-13T16:01:18.199492+0000","last_unstale":"2024-09-13T16:01:19.603731+0000","last_undegraded":"2024-09-13T16:01:19.603731+0000","last_fullsized":"2024-09-13T16:01:19.603731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:41.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603772+0000","last_change":"2024-09-13T16:01:18.623233+0000","last_active":"2024-09-13T16:01:19.603772+0000","last_peered":"2024-09-13T16:01:19.603772+0000","last_clean":"2024-09-13T16:01:19.603772+0000","last_became_active":"2024-09-13T16:01:18.622853+0000","last_became_peered":"2024-09-13T16:01:18.622853+0000","last_unstale":"2024-09-13T16:01:19.603772+0000","last_undegraded":"2024-09-13T16:01:19.603772+0000","last_fullsized":"2024-09-13T16:01:19.603772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:08.669688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603832+0000","last_change":"2024-09-13T16:01:18.199011+0000","last_active":"2024-09-13T16:01:19.603832+0000","last_peered":"2024-09-13T16:01:19.603832+0000","last_clean":"2024-09-13T16:01:19.603832+0000","last_became_active":"2024-09-13T16:01:18.198645+0000","last_became_peered":"2024-09-13T16:01:18.198645+0000","last_unstale":"2024-09-13T16:01:19.603832+0000","last_undegraded":"2024-09-13T16:01:19.603832+0000","last_fullsized":"2024-09-13T16:01:19.603832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:37.847292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.644615+0000","last_change":"2024-09-13T16:01:18.638935+0000","last_active":"2024-09-13T16:01:18.644615+0000","last_peered":"2024-09-13T16:01:18.644615+0000","last_clean":"2024-09-13T16:01:18.644615+0000","last_became_active":"2024-09-13T16:01:18.638609+0000","last_became_peered":"2024-09-13T16:01:18.638609+0000","last_unstale":"2024-09-13T16:01:18.644615+0000","last_undegraded":"2024-09-13T16:01:18.644615+0000","last_fullsized":"2024-09-13T16:01:18.644615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.618592+0000","last_change":"2024-09-13T16:01:18.203508+0000","last_active":"2024-09-13T16:01:18.618592+0000","last_peered":"2024-09-13T16:01:18.618592+0000","last_clean":"2024-09-13T16:01:18.618592+0000","last_became_active":"2024-09-13T16:01:18.203203+0000","last_became_peered":"2024-09-13T16:01:18.203203+0000","last_unstale":"2024-09-13T16:01:18.618592+0000","last_undegraded":"2024-09-13T16:01:18.618592+0000","last_fullsized":"2024-09-13T16:01:18.618592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:47.286118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.644506+0000","last_change":"2024-09-13T16:01:18.639508+0000","last_active":"2024-09-13T16:01:18.644506+0000","last_peered":"2024-09-13T16:01:18.644506+0000","last_clean":"2024-09-13T16:01:18.644506+0000","last_became_active":"2024-09-13T16:01:18.638478+0000","last_became_peered":"2024-09-13T16:01:18.638478+0000","last_unstale":"2024-09-13T16:01:18.644506+0000","last_undegraded":"2024-09-13T16:01:18.644506+0000","last_fullsized":"2024-09-13T16:01:18.644506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:50.539415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603994+0000","last_change":"2024-09-13T16:01:18.201769+0000","last_active":"2024-09-13T16:01:19.603994+0000","last_peered":"2024-09-13T16:01:19.603994+0000","last_clean":"2024-09-13T16:01:19.603994+0000","last_became_active":"2024-09-13T16:01:18.198080+0000","last_became_peered":"2024-09-13T16:01:18.198080+0000","last_unstale":"2024-09-13T16:01:19.603994+0000","last_undegraded":"2024-09-13T16:01:19.603994+0000","last_fullsized":"2024-09-13T16:01:19.603994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.644502+0000","last_change":"2024-09-13T16:01:18.638606+0000","last_active":"2024-09-13T16:01:18.644502+0000","last_peered":"2024-09-13T16:01:18.644502+0000","last_clean":"2024-09-13T16:01:18.644502+0000","last_became_active":"2024-09-13T16:01:18.638374+0000","last_became_peered":"2024-09-13T16:01:18.638374+0000","last_unstale":"2024-09-13T16:01:18.644502+0000","last_undegraded":"2024-09-13T16:01:18.644502+0000","last_fullsized":"2024-09-13T16:01:18.644502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:28.548177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603399+0000","last_change":"2024-09-13T16:01:18.210255+0000","last_active":"2024-09-13T16:01:19.603399+0000","last_peered":"2024-09-13T16:01:19.603399+0000","last_clean":"2024-09-13T16:01:19.603399+0000","last_became_active":"2024-09-13T16:01:18.210014+0000","last_became_peered":"2024-09-13T16:01:18.210014+0000","last_unstale":"2024-09-13T16:01:19.603399+0000","last_undegraded":"2024-09-13T16:01:19.603399+0000","last_fullsized":"2024-09-13T16:01:19.603399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:02.065942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.634582+0000","last_change":"2024-09-13T16:01:18.630699+0000","last_active":"2024-09-13T16:01:18.634582+0000","last_peered":"2024-09-13T16:01:18.634582+0000","last_clean":"2024-09-13T16:01:18.634582+0000","last_became_active":"2024-09-13T16:01:18.630007+0000","last_became_peered":"2024-09-13T16:01:18.630007+0000","last_unstale":"2024-09-13T16:01:18.634582+0000","last_undegraded":"2024-09-13T16:01:18.634582+0000","last_fullsized":"2024-09-13T16:01:18.634582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:28.548177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603901+0000","last_change":"2024-09-13T16:01:18.208200+0000","last_active":"2024-09-13T16:01:19.603901+0000","last_peered":"2024-09-13T16:01:19.603901+0000","last_clean":"2024-09-13T16:01:19.603901+0000","last_became_active":"2024-09-13T16:01:18.206473+0000","last_became_peered":"2024-09-13T16:01:18.206473+0000","last_unstale":"2024-09-13T16:01:19.603901+0000","last_undegraded":"2024-09-13T16:01:19.603901+0000","last_fullsized":"2024-09-13T16:01:19.603901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:41.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.644429+0000","last_change":"2024-09-13T16:01:18.637343+0000","last_active":"2024-09-13T16:01:18.644429+0000","last_peered":"2024-09-13T16:01:18.644429+0000","last_clean":"2024-09-13T16:01:18.644429+0000","last_became_active":"2024-09-13T16:01:18.637052+0000","last_became_peered":"2024-09-13T16:01:18.637052+0000","last_unstale":"2024-09-13T16:01:18.644429+0000","last_undegraded":"2024-09-13T16:01:18.644429+0000","last_fullsized":"2024-09-13T16:01:18.644429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:40:45.237966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.202288+0000","last_change":"2024-09-13T16:01:07.580186+0000","last_active":"2024-09-13T16:01:18.202288+0000","last_peered":"2024-09-13T16:01:18.202288+0000","last_clean":"2024-09-13T16:01:18.202288+0000","last_became_active":"2024-09-13T16:01:07.579877+0000","last_became_peered":"2024-09-13T16:01:07.579877+0000","last_unstale":"2024-09-13T16:01:18.202288+0000","last_undegraded":"2024-09-13T16:01:18.202288+0000","last_fullsized":"2024-09-13T16:01:18.202288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_clean_scrub_stamp":"2024-09-13T16:01:06.070807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:40.645649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.619288+0000","last_change":"2024-09-13T16:01:18.204628+0000","last_active":"2024-09-13T16:01:18.619288+0000","last_peered":"2024-09-13T16:01:18.619288+0000","last_clean":"2024-09-13T16:01:18.619288+0000","last_became_active":"2024-09-13T16:01:18.204302+0000","last_became_peered":"2024-09-13T16:01:18.204302+0000","last_unstale":"2024-09-13T16:01:18.619288+0000","last_undegraded":"2024-09-13T16:01:18.619288+0000","last_fullsized":"2024-09-13T16:01:18.619288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:33.987093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.624114+0000","last_change":"2024-09-13T16:01:18.622448+0000","last_active":"2024-09-13T16:01:18.624114+0000","last_peered":"2024-09-13T16:01:18.624114+0000","last_clean":"2024-09-13T16:01:18.624114+0000","last_became_active":"2024-09-13T16:01:18.621087+0000","last_became_peered":"2024-09-13T16:01:18.621087+0000","last_unstale":"2024-09-13T16:01:18.624114+0000","last_undegraded":"2024-09-13T16:01:18.624114+0000","last_fullsized":"2024-09-13T16:01:18.624114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:19.302417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.620980+0000","last_change":"2024-09-13T16:01:18.210964+0000","last_active":"2024-09-13T16:01:18.620980+0000","last_peered":"2024-09-13T16:01:18.620980+0000","last_clean":"2024-09-13T16:01:18.620980+0000","last_became_active":"2024-09-13T16:01:18.210292+0000","last_became_peered":"2024-09-13T16:01:18.210292+0000","last_unstale":"2024-09-13T16:01:18.620980+0000","last_undegraded":"2024-09-13T16:01:18.620980+0000","last_fullsized":"2024-09-13T16:01:18.620980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:02.065942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.632155+0000","last_change":"2024-09-13T16:01:18.630964+0000","last_active":"2024-09-13T16:01:18.632155+0000","last_peered":"2024-09-13T16:01:18.632155+0000","last_clean":"2024-09-13T16:01:18.632155+0000","last_became_active":"2024-09-13T16:01:18.630721+0000","last_became_peered":"2024-09-13T16:01:18.630721+0000","last_unstale":"2024-09-13T16:01:18.632155+0000","last_undegraded":"2024-09-13T16:01:18.632155+0000","last_fullsized":"2024-09-13T16:01:18.632155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:25.722121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604000+0000","last_change":"2024-09-13T16:01:18.194594+0000","last_active":"2024-09-13T16:01:19.604000+0000","last_peered":"2024-09-13T16:01:19.604000+0000","last_clean":"2024-09-13T16:01:19.604000+0000","last_became_active":"2024-09-13T16:01:18.194321+0000","last_became_peered":"2024-09-13T16:01:18.194321+0000","last_unstale":"2024-09-13T16:01:19.604000+0000","last_undegraded":"2024-09-13T16:01:19.604000+0000","last_fullsized":"2024-09-13T16:01:19.604000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:46.038225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603131+0000","last_change":"2024-09-13T16:01:18.620982+0000","last_active":"2024-09-13T16:01:19.603131+0000","last_peered":"2024-09-13T16:01:19.603131+0000","last_clean":"2024-09-13T16:01:19.603131+0000","last_became_active":"2024-09-13T16:01:18.620567+0000","last_became_peered":"2024-09-13T16:01:18.620567+0000","last_unstale":"2024-09-13T16:01:19.603131+0000","last_undegraded":"2024-09-13T16:01:19.603131+0000","last_fullsized":"2024-09-13T16:01:19.603131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.622189+0000","last_change":"2024-09-13T16:01:18.205821+0000","last_active":"2024-09-13T16:01:18.622189+0000","last_peered":"2024-09-13T16:01:18.622189+0000","last_clean":"2024-09-13T16:01:18.622189+0000","last_became_active":"2024-09-13T16:01:18.205559+0000","last_became_peered":"2024-09-13T16:01:18.205559+0000","last_unstale":"2024-09-13T16:01:18.622189+0000","last_undegraded":"2024-09-13T16:01:18.622189+0000","last_fullsized":"2024-09-13T16:01:18.622189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:41.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.630261+0000","last_change":"2024-09-13T16:01:18.621751+0000","last_active":"2024-09-13T16:01:18.630261+0000","last_peered":"2024-09-13T16:01:18.630261+0000","last_clean":"2024-09-13T16:01:18.630261+0000","last_became_active":"2024-09-13T16:01:18.621504+0000","last_became_peered":"2024-09-13T16:01:18.621504+0000","last_unstale":"2024-09-13T16:01:18.630261+0000","last_undegraded":"2024-09-13T16:01:18.630261+0000","last_fullsized":"2024-09-13T16:01:18.630261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:03.072242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603362+0000","last_change":"2024-09-13T16:01:18.199824+0000","last_active":"2024-09-13T16:01:19.603362+0000","last_peered":"2024-09-13T16:01:19.603362+0000","last_clean":"2024-09-13T16:01:19.603362+0000","last_became_active":"2024-09-13T16:01:18.199321+0000","last_became_peered":"2024-09-13T16:01:18.199321+0000","last_unstale":"2024-09-13T16:01:19.603362+0000","last_undegraded":"2024-09-13T16:01:19.603362+0000","last_fullsized":"2024-09-13T16:01:19.603362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.634626+0000","last_change":"2024-09-13T16:01:18.632613+0000","last_active":"2024-09-13T16:01:18.634626+0000","last_peered":"2024-09-13T16:01:18.634626+0000","last_clean":"2024-09-13T16:01:18.634626+0000","last_became_active":"2024-09-13T16:01:18.632389+0000","last_became_peered":"2024-09-13T16:01:18.632389+0000","last_unstale":"2024-09-13T16:01:18.634626+0000","last_undegraded":"2024-09-13T16:01:18.634626+0000","last_fullsized":"2024-09-13T16:01:18.634626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.622683+0000","last_change":"2024-09-13T16:01:18.212308+0000","last_active":"2024-09-13T16:01:18.622683+0000","last_peered":"2024-09-13T16:01:18.622683+0000","last_clean":"2024-09-13T16:01:18.622683+0000","last_became_active":"2024-09-13T16:01:18.210307+0000","last_became_peered":"2024-09-13T16:01:18.210307+0000","last_unstale":"2024-09-13T16:01:18.622683+0000","last_undegraded":"2024-09-13T16:01:18.622683+0000","last_fullsized":"2024-09-13T16:01:18.622683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:33.908621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603286+0000","last_change":"2024-09-13T16:01:18.616853+0000","last_active":"2024-09-13T16:01:19.603286+0000","last_peered":"2024-09-13T16:01:19.603286+0000","last_clean":"2024-09-13T16:01:19.603286+0000","last_became_active":"2024-09-13T16:01:18.616581+0000","last_became_peered":"2024-09-13T16:01:18.616581+0000","last_unstale":"2024-09-13T16:01:19.603286+0000","last_undegraded":"2024-09-13T16:01:19.603286+0000","last_fullsized":"2024-09-13T16:01:19.603286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:49.813372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603500+0000","last_change":"2024-09-13T16:01:18.211147+0000","last_active":"2024-09-13T16:01:19.603500+0000","last_peered":"2024-09-13T16:01:19.603500+0000","last_clean":"2024-09-13T16:01:19.603500+0000","last_became_active":"2024-09-13T16:01:18.210496+0000","last_became_peered":"2024-09-13T16:01:18.210496+0000","last_unstale":"2024-09-13T16:01:19.603500+0000","last_undegraded":"2024-09-13T16:01:19.603500+0000","last_fullsized":"2024-09-13T16:01:19.603500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:33.987093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.622532+0000","last_change":"2024-09-13T16:01:18.618984+0000","last_active":"2024-09-13T16:01:18.622532+0000","last_peered":"2024-09-13T16:01:18.622532+0000","last_clean":"2024-09-13T16:01:18.622532+0000","last_became_active":"2024-09-13T16:01:18.617587+0000","last_became_peered":"2024-09-13T16:01:18.617587+0000","last_unstale":"2024-09-13T16:01:18.622532+0000","last_undegraded":"2024-09-13T16:01:18.622532+0000","last_fullsized":"2024-09-13T16:01:18.622532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:43.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604083+0000","last_change":"2024-09-13T16:01:18.208715+0000","last_active":"2024-09-13T16:01:19.604083+0000","last_peered":"2024-09-13T16:01:19.604083+0000","last_clean":"2024-09-13T16:01:19.604083+0000","last_became_active":"2024-09-13T16:01:18.208008+0000","last_became_peered":"2024-09-13T16:01:18.208008+0000","last_unstale":"2024-09-13T16:01:19.604083+0000","last_undegraded":"2024-09-13T16:01:19.604083+0000","last_fullsized":"2024-09-13T16:01:19.604083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:33.908621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.631387+0000","last_change":"2024-09-13T16:01:18.627736+0000","last_active":"2024-09-13T16:01:18.631387+0000","last_peered":"2024-09-13T16:01:18.631387+0000","last_clean":"2024-09-13T16:01:18.631387+0000","last_became_active":"2024-09-13T16:01:18.627485+0000","last_became_peered":"2024-09-13T16:01:18.627485+0000","last_unstale":"2024-09-13T16:01:18.631387+0000","last_undegraded":"2024-09-13T16:01:18.631387+0000","last_fullsized":"2024-09-13T16:01:18.631387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:30.675930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.618726+0000","last_change":"2024-09-13T16:01:18.208002+0000","last_active":"2024-09-13T16:01:18.618726+0000","last_peered":"2024-09-13T16:01:18.618726+0000","last_clean":"2024-09-13T16:01:18.618726+0000","last_became_active":"2024-09-13T16:01:18.207573+0000","last_became_peered":"2024-09-13T16:01:18.207573+0000","last_unstale":"2024-09-13T16:01:18.618726+0000","last_undegraded":"2024-09-13T16:01:18.618726+0000","last_fullsized":"2024-09-13T16:01:18.618726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:29.574043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.635051+0000","last_change":"2024-09-13T16:01:18.624658+0000","last_active":"2024-09-13T16:01:18.635051+0000","last_peered":"2024-09-13T16:01:18.635051+0000","last_clean":"2024-09-13T16:01:18.635051+0000","last_became_active":"2024-09-13T16:01:18.623850+0000","last_became_peered":"2024-09-13T16:01:18.623850+0000","last_unstale":"2024-09-13T16:01:18.635051+0000","last_undegraded":"2024-09-13T16:01:18.635051+0000","last_fullsized":"2024-09-13T16:01:18.635051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:30.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603214+0000","last_change":"2024-09-13T16:01:18.207621+0000","last_active":"2024-09-13T16:01:19.603214+0000","last_peered":"2024-09-13T16:01:19.603214+0000","last_clean":"2024-09-13T16:01:19.603214+0000","last_became_active":"2024-09-13T16:01:18.207360+0000","last_became_peered":"2024-09-13T16:01:18.207360+0000","last_unstale":"2024-09-13T16:01:19.603214+0000","last_undegraded":"2024-09-13T16:01:19.603214+0000","last_fullsized":"2024-09-13T16:01:19.603214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:27.211100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.606031+0000","last_change":"2024-09-13T16:01:18.604618+0000","last_active":"2024-09-13T16:01:18.606031+0000","last_peered":"2024-09-13T16:01:18.606031+0000","last_clean":"2024-09-13T16:01:18.606031+0000","last_became_active":"2024-09-13T16:01:18.604304+0000","last_became_peered":"2024-09-13T16:01:18.604304+0000","last_unstale":"2024-09-13T16:01:18.606031+0000","last_undegraded":"2024-09-13T16:01:18.606031+0000","last_fullsized":"2024-09-13T16:01:18.606031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603327+0000","last_change":"2024-09-13T16:01:18.199347+0000","last_active":"2024-09-13T16:01:19.603327+0000","last_peered":"2024-09-13T16:01:19.603327+0000","last_clean":"2024-09-13T16:01:19.603327+0000","last_became_active":"2024-09-13T16:01:18.198961+0000","last_became_peered":"2024-09-13T16:01:18.198961+0000","last_unstale":"2024-09-13T16:01:19.603327+0000","last_undegraded":"2024-09-13T16:01:19.603327+0000","last_fullsized":"2024-09-13T16:01:19.603327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:29.574043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.620012+0000","last_change":"2024-09-13T16:01:18.616823+0000","last_active":"2024-09-13T16:01:18.620012+0000","last_peered":"2024-09-13T16:01:18.620012+0000","last_clean":"2024-09-13T16:01:18.620012+0000","last_became_active":"2024-09-13T16:01:18.616569+0000","last_became_peered":"2024-09-13T16:01:18.616569+0000","last_unstale":"2024-09-13T16:01:18.620012+0000","last_undegraded":"2024-09-13T16:01:18.620012+0000","last_fullsized":"2024-09-13T16:01:18.620012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.638906+0000","last_change":"2024-09-13T16:01:18.214426+0000","last_active":"2024-09-13T16:01:18.638906+0000","last_peered":"2024-09-13T16:01:18.638906+0000","last_clean":"2024-09-13T16:01:18.638906+0000","last_became_active":"2024-09-13T16:01:18.214087+0000","last_became_peered":"2024-09-13T16:01:18.214087+0000","last_unstale":"2024-09-13T16:01:18.638906+0000","last_undegraded":"2024-09-13T16:01:18.638906+0000","last_fullsized":"2024-09-13T16:01:18.638906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604128+0000","last_change":"2024-09-13T16:01:18.620356+0000","last_active":"2024-09-13T16:01:19.604128+0000","last_peered":"2024-09-13T16:01:19.604128+0000","last_clean":"2024-09-13T16:01:19.604128+0000","last_became_active":"2024-09-13T16:01:18.620060+0000","last_became_peered":"2024-09-13T16:01:18.620060+0000","last_unstale":"2024-09-13T16:01:19.604128+0000","last_undegraded":"2024-09-13T16:01:19.604128+0000","last_fullsized":"2024-09-13T16:01:19.604128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:25.722121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.642155+0000","last_change":"2024-09-13T16:01:18.638326+0000","last_active":"2024-09-13T16:01:18.642155+0000","last_peered":"2024-09-13T16:01:18.642155+0000","last_clean":"2024-09-13T16:01:18.642155+0000","last_became_active":"2024-09-13T16:01:18.638047+0000","last_became_peered":"2024-09-13T16:01:18.638047+0000","last_unstale":"2024-09-13T16:01:18.642155+0000","last_undegraded":"2024-09-13T16:01:18.642155+0000","last_fullsized":"2024-09-13T16:01:18.642155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:20.422612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.637623+0000","last_change":"2024-09-13T16:01:18.213077+0000","last_active":"2024-09-13T16:01:18.637623+0000","last_peered":"2024-09-13T16:01:18.637623+0000","last_clean":"2024-09-13T16:01:18.637623+0000","last_became_active":"2024-09-13T16:01:18.212732+0000","last_became_peered":"2024-09-13T16:01:18.212732+0000","last_unstale":"2024-09-13T16:01:18.637623+0000","last_undegraded":"2024-09-13T16:01:18.637623+0000","last_fullsized":"2024-09-13T16:01:18.637623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:55.507079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.630268+0000","last_change":"2024-09-13T16:01:18.623915+0000","last_active":"2024-09-13T16:01:18.630268+0000","last_peered":"2024-09-13T16:01:18.630268+0000","last_clean":"2024-09-13T16:01:18.630268+0000","last_became_active":"2024-09-13T16:01:18.623420+0000","last_became_peered":"2024-09-13T16:01:18.623420+0000","last_unstale":"2024-09-13T16:01:18.630268+0000","last_undegraded":"2024-09-13T16:01:18.630268+0000","last_fullsized":"2024-09-13T16:01:18.630268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:11.951128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.636019+0000","last_change":"2024-09-13T16:01:18.213257+0000","last_active":"2024-09-13T16:01:18.636019+0000","last_peered":"2024-09-13T16:01:18.636019+0000","last_clean":"2024-09-13T16:01:18.636019+0000","last_became_active":"2024-09-13T16:01:18.212675+0000","last_became_peered":"2024-09-13T16:01:18.212675+0000","last_unstale":"2024-09-13T16:01:18.636019+0000","last_undegraded":"2024-09-13T16:01:18.636019+0000","last_fullsized":"2024-09-13T16:01:18.636019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:33.987093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.635470+0000","last_change":"2024-09-13T16:01:18.634167+0000","last_active":"2024-09-13T16:01:18.635470+0000","last_peered":"2024-09-13T16:01:18.635470+0000","last_clean":"2024-09-13T16:01:18.635470+0000","last_became_active":"2024-09-13T16:01:18.633922+0000","last_became_peered":"2024-09-13T16:01:18.633922+0000","last_unstale":"2024-09-13T16:01:18.635470+0000","last_undegraded":"2024-09-13T16:01:18.635470+0000","last_fullsized":"2024-09-13T16:01:18.635470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.611548+0000","last_change":"2024-09-13T16:01:18.196431+0000","last_active":"2024-09-13T16:01:18.611548+0000","last_peered":"2024-09-13T16:01:18.611548+0000","last_clean":"2024-09-13T16:01:18.611548+0000","last_became_active":"2024-09-13T16:01:18.195952+0000","last_became_peered":"2024-09-13T16:01:18.195952+0000","last_unstale":"2024-09-13T16:01:18.611548+0000","last_undegraded":"2024-09-13T16:01:18.611548+0000","last_fullsized":"2024-09-13T16:01:18.611548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:11.867906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.615318+0000","last_change":"2024-09-13T16:01:18.608250+0000","last_active":"2024-09-13T16:01:18.615318+0000","last_peered":"2024-09-13T16:01:18.615318+0000","last_clean":"2024-09-13T16:01:18.615318+0000","last_became_active":"2024-09-13T16:01:18.607998+0000","last_became_peered":"2024-09-13T16:01:18.607998+0000","last_unstale":"2024-09-13T16:01:18.615318+0000","last_undegraded":"2024-09-13T16:01:18.615318+0000","last_fullsized":"2024-09-13T16:01:18.615318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:25.722121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.637197+0000","last_change":"2024-09-13T16:01:18.209539+0000","last_active":"2024-09-13T16:01:18.637197+0000","last_peered":"2024-09-13T16:01:18.637197+0000","last_clean":"2024-09-13T16:01:18.637197+0000","last_became_active":"2024-09-13T16:01:18.209329+0000","last_became_peered":"2024-09-13T16:01:18.209329+0000","last_unstale":"2024-09-13T16:01:18.637197+0000","last_undegraded":"2024-09-13T16:01:18.637197+0000","last_fullsized":"2024-09-13T16:01:18.637197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:46.038225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":64688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":204800,"data_stored":66162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31304,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340536,"statfs":{"total":96636764160,"available":96604708864,"internally_reserved":0,"allocated":192512,"data_stored":64598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":794624,"data_stored":654585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:01:22.737 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T16:01:22.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.922+0000 7f47b9200640 1 Processor -- start 2024-09-13T16:01:22.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.922+0000 7f47b9200640 1 -- start start 2024-09-13T16:01:22.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.924+0000 7f47b9200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f47b4070c20 0x7f47b406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:22.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.924+0000 7f47b9200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b415d9a0 0x7f47b40b2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:22.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.924+0000 7f47b9200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b415cd50 con 0x7f47b415c970 2024-09-13T16:01:22.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.924+0000 7f47b9200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b406d170 con 0x7f47b4070c20 2024-09-13T16:01:22.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.924+0000 7f47b9200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b406d450 con 0x7f47b415d9a0 2024-09-13T16:01:22.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.924+0000 7f47b1400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f47b4070c20 0x7f47b406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:22.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.924+0000 7f47b1400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f47b4070c20 0x7f47b406cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35764/0 (socket says 172.21.15.70:35764) 2024-09-13T16:01:22.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.924+0000 7f47b1400640 1 -- 172.21.15.70:0/921693326 learned_addr learned my addr 172.21.15.70:0/921693326 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:22.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.924+0000 7f47b2800640 1 --2- 172.21.15.70:0/921693326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b415d9a0 0x7f47b40b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:22.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.924+0000 7f47b1400640 1 -- 172.21.15.70:0/921693326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b415d9a0 msgr2=0x7f47b40b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:22.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.924+0000 7f47b1400640 1 --2- 172.21.15.70:0/921693326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b415d9a0 0x7f47b40b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.924+0000 7f47b1400640 1 -- 172.21.15.70:0/921693326 >> v1:172.21.15.107:6789/0 conn(0x7f47b415c970 legacy=0x7f47b4070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.924+0000 7f47b1400640 1 -- 172.21.15.70:0/921693326 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b40b1d80 con 0x7f47b4070c20 2024-09-13T16:01:22.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.924+0000 7f47b2800640 1 --2- 172.21.15.70:0/921693326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b415d9a0 0x7f47b40b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:22.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.925+0000 7f47b1400640 1 --2- 172.21.15.70:0/921693326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b4070c20 0x7f47b406cab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009870 tx=0x7f47a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cae91ceff146817 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:22.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.926+0000 7f47b0a00640 1 -- 172.21.15.70:0/921693326 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0032440 con 0x7f47b4070c20 2024-09-13T16:01:22.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.926+0000 7f47b0a00640 1 -- 172.21.15.70:0/921693326 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a00325a0 con 0x7f47b4070c20 2024-09-13T16:01:22.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.926+0000 7f47b0a00640 1 -- 172.21.15.70:0/921693326 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0032930 con 0x7f47b4070c20 2024-09-13T16:01:22.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.926+0000 7f47b9200640 1 -- 172.21.15.70:0/921693326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b4070c20 msgr2=0x7f47b406cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.926+0000 7f47b9200640 1 --2- 172.21.15.70:0/921693326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b4070c20 0x7f47b406cab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009870 tx=0x7f47a002a270 comp rx=0 tx=0).stop 2024-09-13T16:01:22.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.926+0000 7f47b9200640 1 -- 172.21.15.70:0/921693326 shutdown_connections 2024-09-13T16:01:22.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.926+0000 7f47b9200640 1 --2- 172.21.15.70:0/921693326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b415d9a0 0x7f47b40b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.926+0000 7f47b9200640 1 --2- 172.21.15.70:0/921693326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b4070c20 0x7f47b406cab0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.926+0000 7f47b9200640 1 -- 172.21.15.70:0/921693326 >> 172.21.15.70:0/921693326 conn(0x7f47b40b09e0 msgr2=0x7f47b40b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:22.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.926+0000 7f47b9200640 1 -- 172.21.15.70:0/921693326 shutdown_connections 2024-09-13T16:01:22.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.926+0000 7f47b9200640 1 -- 172.21.15.70:0/921693326 wait complete. 2024-09-13T16:01:22.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.928+0000 7f47b9200640 1 Processor -- start 2024-09-13T16:01:22.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.928+0000 7f47b9200640 1 -- start start 2024-09-13T16:01:22.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.929+0000 7f47b9200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b4070c20 0x7f47b4150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:22.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.929+0000 7f47b9200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b415c970 0x7f47b4155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:22.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.929+0000 7f47b9200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47b415d9a0 0x7f47b4157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:22.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.929+0000 7f47b9200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b4155e40 con 0x7f47b415c970 2024-09-13T16:01:22.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.929+0000 7f47b9200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b4156120 con 0x7f47b415d9a0 2024-09-13T16:01:22.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.929+0000 7f47b9200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b4156400 con 0x7f47b4070c20 2024-09-13T16:01:22.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.929+0000 7f47b1400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b415c970 0x7f47b4155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:22.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.929+0000 7f47b1400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b415c970 0x7f47b4155480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35772/0 (socket says 172.21.15.70:35772) 2024-09-13T16:01:22.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.929+0000 7f47b1400640 1 -- 172.21.15.70:0/2246334799 learned_addr learned my addr 172.21.15.70:0/2246334799 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:22.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.929+0000 7f47b1e00640 1 --2- 172.21.15.70:0/2246334799 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b4070c20 0x7f47b4150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:22.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.929+0000 7f47b2800640 1 --2- 172.21.15.70:0/2246334799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47b415d9a0 0x7f47b4157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:22.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.929+0000 7f47b1400640 1 -- 172.21.15.70:0/2246334799 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b4070c20 msgr2=0x7f47b4150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.929+0000 7f47b1400640 1 --2- 172.21.15.70:0/2246334799 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b4070c20 0x7f47b4150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.929+0000 7f47b1400640 1 -- 172.21.15.70:0/2246334799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47b415d9a0 msgr2=0x7f47b4157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:22.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.929+0000 7f47b1400640 1 --2- 172.21.15.70:0/2246334799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47b415d9a0 0x7f47b4157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:22.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.929+0000 7f47b1400640 1 -- 172.21.15.70:0/2246334799 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a00094d0 con 0x7f47b415c970 2024-09-13T16:01:22.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.930+0000 7f47b1400640 1 --2- 172.21.15.70:0/2246334799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b415c970 0x7f47b4155480 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47a0000c00 tx=0x7f47a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:22.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.930+0000 7f47aa000640 1 -- 172.21.15.70:0/2246334799 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0032440 con 0x7f47b415c970 2024-09-13T16:01:22.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.930+0000 7f47aa000640 1 -- 172.21.15.70:0/2246334799 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a0030b80 con 0x7f47b415c970 2024-09-13T16:01:22.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.930+0000 7f47aa000640 1 -- 172.21.15.70:0/2246334799 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a003d440 con 0x7f47b415c970 2024-09-13T16:01:22.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.930+0000 7f47b9200640 1 -- 172.21.15.70:0/2246334799 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b4151fa0 con 0x7f47b415c970 2024-09-13T16:01:22.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.930+0000 7f47b9200640 1 -- 172.21.15.70:0/2246334799 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b41513d0 con 0x7f47b415c970 2024-09-13T16:01:22.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.931+0000 7f47b9200640 1 -- 172.21.15.70:0/2246334799 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b4152460 con 0x7f47b415c970 2024-09-13T16:01:22.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.932+0000 7f47aa000640 1 -- 172.21.15.70:0/2246334799 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f47a0039040 con 0x7f47b415c970 2024-09-13T16:01:22.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.933+0000 7f47aa000640 1 --2- 172.21.15.70:0/2246334799 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f479406ac00 0x7f479406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:22.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.933+0000 7f47aa000640 1 -- 172.21.15.70:0/2246334799 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47a00a9d80 con 0x7f47b415c970 2024-09-13T16:01:22.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.933+0000 7f47b1e00640 1 --2- 172.21.15.70:0/2246334799 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f479406ac00 0x7f479406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:22.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.934+0000 7f47b1e00640 1 --2- 172.21.15.70:0/2246334799 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f479406ac00 0x7f479406d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f47b4156e00 tx=0x7f47a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:22.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:22.937+0000 7f47aa000640 1 -- 172.21.15.70:0/2246334799 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f47a0075000 con 0x7f47b415c970 2024-09-13T16:01:23.046 INFO:tasks.ceph.mds.d.smithi107.stderr:2024-09-13T16:01:23.044+0000 7efed7000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T16:01:23.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.103+0000 7f47b9200640 1 -- 172.21.15.70:0/2246334799 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47b4156290 con 0x7f479406ac00 2024-09-13T16:01:23.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.110+0000 7f47aa000640 1 -- 172.21.15.70:0/2246334799 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264600 (secure 0 0 0) 0x7f47b4156290 con 0x7f479406ac00 2024-09-13T16:01:23.114 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:23.115 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-13T16:01:23.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.113+0000 7f47b9200640 1 -- 172.21.15.70:0/2246334799 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f479406ac00 msgr2=0x7f479406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:23.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.113+0000 7f47b9200640 1 --2- 172.21.15.70:0/2246334799 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f479406ac00 0x7f479406d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f47b4156e00 tx=0x7f47a4009040 comp rx=0 tx=0).stop 2024-09-13T16:01:23.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.113+0000 7f47b9200640 1 -- 172.21.15.70:0/2246334799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b415c970 msgr2=0x7f47b4155480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:23.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.113+0000 7f47b9200640 1 --2- 172.21.15.70:0/2246334799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b415c970 0x7f47b4155480 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47a0000c00 tx=0x7f47a00046c0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.114+0000 7f47b9200640 1 -- 172.21.15.70:0/2246334799 shutdown_connections 2024-09-13T16:01:23.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.114+0000 7f47b9200640 1 --2- 172.21.15.70:0/2246334799 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f479406ac00 0x7f479406d0c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.114+0000 7f47b9200640 1 --2- 172.21.15.70:0/2246334799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47b415d9a0 0x7f47b4157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.114+0000 7f47b9200640 1 --2- 172.21.15.70:0/2246334799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b415c970 0x7f47b4155480 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.114+0000 7f47b9200640 1 --2- 172.21.15.70:0/2246334799 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b4070c20 0x7f47b4150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.114+0000 7f47b9200640 1 -- 172.21.15.70:0/2246334799 >> 172.21.15.70:0/2246334799 conn(0x7f47b40b09e0 msgr2=0x7f47b41e34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:23.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.114+0000 7f47b9200640 1 -- 172.21.15.70:0/2246334799 shutdown_connections 2024-09-13T16:01:23.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.114+0000 7f47b9200640 1 -- 172.21.15.70:0/2246334799 wait complete. 2024-09-13T16:01:23.131 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-13T16:01:22.018324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235308,"kb_used_data":2748,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739412,"statfs":{"total":773094113280,"available":772853157888,"internally_reserved":0,"allocated":2813952,"data_stored":1713825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.841833"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.647151+0000","last_change":"2024-09-13T16:01:18.644594+0000","last_active":"2024-09-13T16:01:18.647151+0000","last_peered":"2024-09-13T16:01:18.647151+0000","last_clean":"2024-09-13T16:01:18.647151+0000","last_became_active":"2024-09-13T16:01:18.644356+0000","last_became_peered":"2024-09-13T16:01:18.644356+0000","last_unstale":"2024-09-13T16:01:18.647151+0000","last_undegraded":"2024-09-13T16:01:18.647151+0000","last_fullsized":"2024-09-13T16:01:18.647151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:20.422612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603423+0000","last_change":"2024-09-13T16:01:18.624268+0000","last_active":"2024-09-13T16:01:19.603423+0000","last_peered":"2024-09-13T16:01:19.603423+0000","last_clean":"2024-09-13T16:01:19.603423+0000","last_became_active":"2024-09-13T16:01:18.624050+0000","last_became_peered":"2024-09-13T16:01:18.624050+0000","last_unstale":"2024-09-13T16:01:19.603423+0000","last_undegraded":"2024-09-13T16:01:19.603423+0000","last_fullsized":"2024-09-13T16:01:19.603423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.626454+0000","last_change":"2024-09-13T16:01:18.623991+0000","last_active":"2024-09-13T16:01:18.626454+0000","last_peered":"2024-09-13T16:01:18.626454+0000","last_clean":"2024-09-13T16:01:18.626454+0000","last_became_active":"2024-09-13T16:01:18.623492+0000","last_became_peered":"2024-09-13T16:01:18.623492+0000","last_unstale":"2024-09-13T16:01:18.626454+0000","last_undegraded":"2024-09-13T16:01:18.626454+0000","last_fullsized":"2024-09-13T16:01:18.626454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:33:59.929449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.634599+0000","last_change":"2024-09-13T16:01:18.630873+0000","last_active":"2024-09-13T16:01:18.634599+0000","last_peered":"2024-09-13T16:01:18.634599+0000","last_clean":"2024-09-13T16:01:18.634599+0000","last_became_active":"2024-09-13T16:01:18.630446+0000","last_became_peered":"2024-09-13T16:01:18.630446+0000","last_unstale":"2024-09-13T16:01:18.634599+0000","last_undegraded":"2024-09-13T16:01:18.634599+0000","last_fullsized":"2024-09-13T16:01:18.634599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:43.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.644381+0000","last_change":"2024-09-13T16:01:18.637355+0000","last_active":"2024-09-13T16:01:18.644381+0000","last_peered":"2024-09-13T16:01:18.644381+0000","last_clean":"2024-09-13T16:01:18.644381+0000","last_became_active":"2024-09-13T16:01:18.637053+0000","last_became_peered":"2024-09-13T16:01:18.637053+0000","last_unstale":"2024-09-13T16:01:18.644381+0000","last_undegraded":"2024-09-13T16:01:18.644381+0000","last_fullsized":"2024-09-13T16:01:18.644381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:11.951128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.631756+0000","last_change":"2024-09-13T16:01:18.626648+0000","last_active":"2024-09-13T16:01:18.631756+0000","last_peered":"2024-09-13T16:01:18.631756+0000","last_clean":"2024-09-13T16:01:18.631756+0000","last_became_active":"2024-09-13T16:01:18.625618+0000","last_became_peered":"2024-09-13T16:01:18.625618+0000","last_unstale":"2024-09-13T16:01:18.631756+0000","last_undegraded":"2024-09-13T16:01:18.631756+0000","last_fullsized":"2024-09-13T16:01:18.631756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:50.539415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.640944+0000","last_change":"2024-09-13T16:01:18.632016+0000","last_active":"2024-09-13T16:01:18.640944+0000","last_peered":"2024-09-13T16:01:18.640944+0000","last_clean":"2024-09-13T16:01:18.640944+0000","last_became_active":"2024-09-13T16:01:18.631753+0000","last_became_peered":"2024-09-13T16:01:18.631753+0000","last_unstale":"2024-09-13T16:01:18.640944+0000","last_undegraded":"2024-09-13T16:01:18.640944+0000","last_fullsized":"2024-09-13T16:01:18.640944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:26.431089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.630951+0000","last_change":"2024-09-13T16:01:18.628899+0000","last_active":"2024-09-13T16:01:18.630951+0000","last_peered":"2024-09-13T16:01:18.630951+0000","last_clean":"2024-09-13T16:01:18.630951+0000","last_became_active":"2024-09-13T16:01:18.628268+0000","last_became_peered":"2024-09-13T16:01:18.628268+0000","last_unstale":"2024-09-13T16:01:18.630951+0000","last_undegraded":"2024-09-13T16:01:18.630951+0000","last_fullsized":"2024-09-13T16:01:18.630951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:18.317702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.644982+0000","last_change":"2024-09-13T16:01:18.641494+0000","last_active":"2024-09-13T16:01:18.644982+0000","last_peered":"2024-09-13T16:01:18.644982+0000","last_clean":"2024-09-13T16:01:18.644982+0000","last_became_active":"2024-09-13T16:01:18.641183+0000","last_became_peered":"2024-09-13T16:01:18.641183+0000","last_unstale":"2024-09-13T16:01:18.644982+0000","last_undegraded":"2024-09-13T16:01:18.644982+0000","last_fullsized":"2024-09-13T16:01:18.644982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:10.009263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604131+0000","last_change":"2024-09-13T16:01:18.632143+0000","last_active":"2024-09-13T16:01:19.604131+0000","last_peered":"2024-09-13T16:01:19.604131+0000","last_clean":"2024-09-13T16:01:19.604131+0000","last_became_active":"2024-09-13T16:01:18.630476+0000","last_became_peered":"2024-09-13T16:01:18.630476+0000","last_unstale":"2024-09-13T16:01:19.604131+0000","last_undegraded":"2024-09-13T16:01:19.604131+0000","last_fullsized":"2024-09-13T16:01:19.604131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:52.684760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603862+0000","last_change":"2024-09-13T16:01:18.626009+0000","last_active":"2024-09-13T16:01:19.603862+0000","last_peered":"2024-09-13T16:01:19.603862+0000","last_clean":"2024-09-13T16:01:19.603862+0000","last_became_active":"2024-09-13T16:01:18.625643+0000","last_became_peered":"2024-09-13T16:01:18.625643+0000","last_unstale":"2024-09-13T16:01:19.603862+0000","last_undegraded":"2024-09-13T16:01:19.603862+0000","last_fullsized":"2024-09-13T16:01:19.603862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.627395+0000","last_change":"2024-09-13T16:01:18.619953+0000","last_active":"2024-09-13T16:01:18.627395+0000","last_peered":"2024-09-13T16:01:18.627395+0000","last_clean":"2024-09-13T16:01:18.627395+0000","last_became_active":"2024-09-13T16:01:18.619529+0000","last_became_peered":"2024-09-13T16:01:18.619529+0000","last_unstale":"2024-09-13T16:01:18.627395+0000","last_undegraded":"2024-09-13T16:01:18.627395+0000","last_fullsized":"2024-09-13T16:01:18.627395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:56.513378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.615944+0000","last_change":"2024-09-13T16:01:18.611600+0000","last_active":"2024-09-13T16:01:18.615944+0000","last_peered":"2024-09-13T16:01:18.615944+0000","last_clean":"2024-09-13T16:01:18.615944+0000","last_became_active":"2024-09-13T16:01:18.611355+0000","last_became_peered":"2024-09-13T16:01:18.611355+0000","last_unstale":"2024-09-13T16:01:18.615944+0000","last_undegraded":"2024-09-13T16:01:18.615944+0000","last_fullsized":"2024-09-13T16:01:18.615944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:52.684760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.629446+0000","last_change":"2024-09-13T16:01:18.626872+0000","last_active":"2024-09-13T16:01:18.629446+0000","last_peered":"2024-09-13T16:01:18.629446+0000","last_clean":"2024-09-13T16:01:18.629446+0000","last_became_active":"2024-09-13T16:01:18.625476+0000","last_became_peered":"2024-09-13T16:01:18.625476+0000","last_unstale":"2024-09-13T16:01:18.629446+0000","last_undegraded":"2024-09-13T16:01:18.629446+0000","last_fullsized":"2024-09-13T16:01:18.629446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:28.990573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603123+0000","last_change":"2024-09-13T16:01:18.630422+0000","last_active":"2024-09-13T16:01:19.603123+0000","last_peered":"2024-09-13T16:01:19.603123+0000","last_clean":"2024-09-13T16:01:19.603123+0000","last_became_active":"2024-09-13T16:01:18.630174+0000","last_became_peered":"2024-09-13T16:01:18.630174+0000","last_unstale":"2024-09-13T16:01:19.603123+0000","last_undegraded":"2024-09-13T16:01:19.603123+0000","last_fullsized":"2024-09-13T16:01:19.603123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:52.684760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.631636+0000","last_change":"2024-09-13T16:01:18.625202+0000","last_active":"2024-09-13T16:01:18.631636+0000","last_peered":"2024-09-13T16:01:18.631636+0000","last_clean":"2024-09-13T16:01:18.631636+0000","last_became_active":"2024-09-13T16:01:18.624886+0000","last_became_peered":"2024-09-13T16:01:18.624886+0000","last_unstale":"2024-09-13T16:01:18.631636+0000","last_undegraded":"2024-09-13T16:01:18.631636+0000","last_fullsized":"2024-09-13T16:01:18.631636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:19.302417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.632973+0000","last_change":"2024-09-13T16:01:18.621201+0000","last_active":"2024-09-13T16:01:18.632973+0000","last_peered":"2024-09-13T16:01:18.632973+0000","last_clean":"2024-09-13T16:01:18.632973+0000","last_became_active":"2024-09-13T16:01:18.620822+0000","last_became_peered":"2024-09-13T16:01:18.620822+0000","last_unstale":"2024-09-13T16:01:18.632973+0000","last_undegraded":"2024-09-13T16:01:18.632973+0000","last_fullsized":"2024-09-13T16:01:18.632973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:55.299980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603906+0000","last_change":"2024-09-13T16:01:18.621201+0000","last_active":"2024-09-13T16:01:19.603906+0000","last_peered":"2024-09-13T16:01:19.603906+0000","last_clean":"2024-09-13T16:01:19.603906+0000","last_became_active":"2024-09-13T16:01:18.619264+0000","last_became_peered":"2024-09-13T16:01:18.619264+0000","last_unstale":"2024-09-13T16:01:19.603906+0000","last_undegraded":"2024-09-13T16:01:19.603906+0000","last_fullsized":"2024-09-13T16:01:19.603906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:03.072242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.641026+0000","last_change":"2024-09-13T16:01:18.635920+0000","last_active":"2024-09-13T16:01:18.641026+0000","last_peered":"2024-09-13T16:01:18.641026+0000","last_clean":"2024-09-13T16:01:18.641026+0000","last_became_active":"2024-09-13T16:01:18.634437+0000","last_became_peered":"2024-09-13T16:01:18.634437+0000","last_unstale":"2024-09-13T16:01:18.641026+0000","last_undegraded":"2024-09-13T16:01:18.641026+0000","last_fullsized":"2024-09-13T16:01:18.641026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:43.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603898+0000","last_change":"2024-09-13T16:01:18.618207+0000","last_active":"2024-09-13T16:01:19.603898+0000","last_peered":"2024-09-13T16:01:19.603898+0000","last_clean":"2024-09-13T16:01:19.603898+0000","last_became_active":"2024-09-13T16:01:18.617859+0000","last_became_peered":"2024-09-13T16:01:18.617859+0000","last_unstale":"2024-09-13T16:01:19.603898+0000","last_undegraded":"2024-09-13T16:01:19.603898+0000","last_fullsized":"2024-09-13T16:01:19.603898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:49.813372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.629749+0000","last_change":"2024-09-13T16:01:18.627158+0000","last_active":"2024-09-13T16:01:18.629749+0000","last_peered":"2024-09-13T16:01:18.629749+0000","last_clean":"2024-09-13T16:01:18.629749+0000","last_became_active":"2024-09-13T16:01:18.627010+0000","last_became_peered":"2024-09-13T16:01:18.627010+0000","last_unstale":"2024-09-13T16:01:18.629749+0000","last_undegraded":"2024-09-13T16:01:18.629749+0000","last_fullsized":"2024-09-13T16:01:18.629749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:08.669688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.631776+0000","last_change":"2024-09-13T16:01:18.625912+0000","last_active":"2024-09-13T16:01:18.631776+0000","last_peered":"2024-09-13T16:01:18.631776+0000","last_clean":"2024-09-13T16:01:18.631776+0000","last_became_active":"2024-09-13T16:01:18.625254+0000","last_became_peered":"2024-09-13T16:01:18.625254+0000","last_unstale":"2024-09-13T16:01:18.631776+0000","last_undegraded":"2024-09-13T16:01:18.631776+0000","last_fullsized":"2024-09-13T16:01:18.631776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:10.009263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.630896+0000","last_change":"2024-09-13T16:01:18.628744+0000","last_active":"2024-09-13T16:01:18.630896+0000","last_peered":"2024-09-13T16:01:18.630896+0000","last_clean":"2024-09-13T16:01:18.630896+0000","last_became_active":"2024-09-13T16:01:18.628467+0000","last_became_peered":"2024-09-13T16:01:18.628467+0000","last_unstale":"2024-09-13T16:01:18.630896+0000","last_undegraded":"2024-09-13T16:01:18.630896+0000","last_fullsized":"2024-09-13T16:01:18.630896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:20.422612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.639890+0000","last_change":"2024-09-13T16:01:18.634330+0000","last_active":"2024-09-13T16:01:18.639890+0000","last_peered":"2024-09-13T16:01:18.639890+0000","last_clean":"2024-09-13T16:01:18.639890+0000","last_became_active":"2024-09-13T16:01:18.633542+0000","last_became_peered":"2024-09-13T16:01:18.633542+0000","last_unstale":"2024-09-13T16:01:18.639890+0000","last_undegraded":"2024-09-13T16:01:18.639890+0000","last_fullsized":"2024-09-13T16:01:18.639890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.616503+0000","last_change":"2024-09-13T16:01:18.615790+0000","last_active":"2024-09-13T16:01:18.616503+0000","last_peered":"2024-09-13T16:01:18.616503+0000","last_clean":"2024-09-13T16:01:18.616503+0000","last_became_active":"2024-09-13T16:01:18.615102+0000","last_became_peered":"2024-09-13T16:01:18.615102+0000","last_unstale":"2024-09-13T16:01:18.616503+0000","last_undegraded":"2024-09-13T16:01:18.616503+0000","last_fullsized":"2024-09-13T16:01:18.616503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:28.548177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604211+0000","last_change":"2024-09-13T16:01:18.619972+0000","last_active":"2024-09-13T16:01:19.604211+0000","last_peered":"2024-09-13T16:01:19.604211+0000","last_clean":"2024-09-13T16:01:19.604211+0000","last_became_active":"2024-09-13T16:01:18.619393+0000","last_became_peered":"2024-09-13T16:01:18.619393+0000","last_unstale":"2024-09-13T16:01:19.604211+0000","last_undegraded":"2024-09-13T16:01:19.604211+0000","last_fullsized":"2024-09-13T16:01:19.604211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603306+0000","last_change":"2024-09-13T16:01:18.604836+0000","last_active":"2024-09-13T16:01:19.603306+0000","last_peered":"2024-09-13T16:01:19.603306+0000","last_clean":"2024-09-13T16:01:19.603306+0000","last_became_active":"2024-09-13T16:01:18.604598+0000","last_became_peered":"2024-09-13T16:01:18.604598+0000","last_unstale":"2024-09-13T16:01:19.603306+0000","last_undegraded":"2024-09-13T16:01:19.603306+0000","last_fullsized":"2024-09-13T16:01:19.603306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:19.302417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.626278+0000","last_change":"2024-09-13T16:01:18.624936+0000","last_active":"2024-09-13T16:01:18.626278+0000","last_peered":"2024-09-13T16:01:18.626278+0000","last_clean":"2024-09-13T16:01:18.626278+0000","last_became_active":"2024-09-13T16:01:18.619895+0000","last_became_peered":"2024-09-13T16:01:18.619895+0000","last_unstale":"2024-09-13T16:01:18.626278+0000","last_undegraded":"2024-09-13T16:01:18.626278+0000","last_fullsized":"2024-09-13T16:01:18.626278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:11.951128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.621830+0000","last_change":"2024-09-13T16:01:18.618591+0000","last_active":"2024-09-13T16:01:18.621830+0000","last_peered":"2024-09-13T16:01:18.621830+0000","last_clean":"2024-09-13T16:01:18.621830+0000","last_became_active":"2024-09-13T16:01:18.618365+0000","last_became_peered":"2024-09-13T16:01:18.618365+0000","last_unstale":"2024-09-13T16:01:18.621830+0000","last_undegraded":"2024-09-13T16:01:18.621830+0000","last_fullsized":"2024-09-13T16:01:18.621830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:52.684760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.625432+0000","last_change":"2024-09-13T16:01:18.618017+0000","last_active":"2024-09-13T16:01:18.625432+0000","last_peered":"2024-09-13T16:01:18.625432+0000","last_clean":"2024-09-13T16:01:18.625432+0000","last_became_active":"2024-09-13T16:01:18.617614+0000","last_became_peered":"2024-09-13T16:01:18.617614+0000","last_unstale":"2024-09-13T16:01:18.625432+0000","last_undegraded":"2024-09-13T16:01:18.625432+0000","last_fullsized":"2024-09-13T16:01:18.625432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:49.331305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603841+0000","last_change":"2024-09-13T16:01:18.619441+0000","last_active":"2024-09-13T16:01:19.603841+0000","last_peered":"2024-09-13T16:01:19.603841+0000","last_clean":"2024-09-13T16:01:19.603841+0000","last_became_active":"2024-09-13T16:01:18.619196+0000","last_became_peered":"2024-09-13T16:01:18.619196+0000","last_unstale":"2024-09-13T16:01:19.603841+0000","last_undegraded":"2024-09-13T16:01:19.603841+0000","last_fullsized":"2024-09-13T16:01:19.603841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:56.513378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603751+0000","last_change":"2024-09-13T16:01:18.629618+0000","last_active":"2024-09-13T16:01:19.603751+0000","last_peered":"2024-09-13T16:01:19.603751+0000","last_clean":"2024-09-13T16:01:19.603751+0000","last_became_active":"2024-09-13T16:01:18.625774+0000","last_became_peered":"2024-09-13T16:01:18.625774+0000","last_unstale":"2024-09-13T16:01:19.603751+0000","last_undegraded":"2024-09-13T16:01:19.603751+0000","last_fullsized":"2024-09-13T16:01:19.603751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:54.527079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.627391+0000","last_change":"2024-09-13T16:01:18.617833+0000","last_active":"2024-09-13T16:01:18.627391+0000","last_peered":"2024-09-13T16:01:18.627391+0000","last_clean":"2024-09-13T16:01:18.627391+0000","last_became_active":"2024-09-13T16:01:18.614256+0000","last_became_peered":"2024-09-13T16:01:18.614256+0000","last_unstale":"2024-09-13T16:01:18.627391+0000","last_undegraded":"2024-09-13T16:01:18.627391+0000","last_fullsized":"2024-09-13T16:01:18.627391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:28.217399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.614442+0000","last_change":"2024-09-13T16:01:18.208438+0000","last_active":"2024-09-13T16:01:18.614442+0000","last_peered":"2024-09-13T16:01:18.614442+0000","last_clean":"2024-09-13T16:01:18.614442+0000","last_became_active":"2024-09-13T16:01:18.207954+0000","last_became_peered":"2024-09-13T16:01:18.207954+0000","last_unstale":"2024-09-13T16:01:18.614442+0000","last_undegraded":"2024-09-13T16:01:18.614442+0000","last_fullsized":"2024-09-13T16:01:18.614442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:41.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.633026+0000","last_change":"2024-09-13T16:01:18.632108+0000","last_active":"2024-09-13T16:01:18.633026+0000","last_peered":"2024-09-13T16:01:18.633026+0000","last_clean":"2024-09-13T16:01:18.633026+0000","last_became_active":"2024-09-13T16:01:18.631731+0000","last_became_peered":"2024-09-13T16:01:18.631731+0000","last_unstale":"2024-09-13T16:01:18.633026+0000","last_undegraded":"2024-09-13T16:01:18.633026+0000","last_fullsized":"2024-09-13T16:01:18.633026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604145+0000","last_change":"2024-09-13T16:01:18.207085+0000","last_active":"2024-09-13T16:01:19.604145+0000","last_peered":"2024-09-13T16:01:19.604145+0000","last_clean":"2024-09-13T16:01:19.604145+0000","last_became_active":"2024-09-13T16:01:18.205734+0000","last_became_peered":"2024-09-13T16:01:18.205734+0000","last_unstale":"2024-09-13T16:01:19.604145+0000","last_undegraded":"2024-09-13T16:01:19.604145+0000","last_fullsized":"2024-09-13T16:01:19.604145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.601249+0000","last_change":"2024-09-13T16:01:18.206489+0000","last_active":"2024-09-13T16:01:18.601249+0000","last_peered":"2024-09-13T16:01:18.601249+0000","last_clean":"2024-09-13T16:01:18.601249+0000","last_became_active":"2024-09-13T16:01:18.206251+0000","last_became_peered":"2024-09-13T16:01:18.206251+0000","last_unstale":"2024-09-13T16:01:18.601249+0000","last_undegraded":"2024-09-13T16:01:18.601249+0000","last_fullsized":"2024-09-13T16:01:18.601249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.631116+0000","last_change":"2024-09-13T16:01:18.629111+0000","last_active":"2024-09-13T16:01:18.631116+0000","last_peered":"2024-09-13T16:01:18.631116+0000","last_clean":"2024-09-13T16:01:18.631116+0000","last_became_active":"2024-09-13T16:01:18.628667+0000","last_became_peered":"2024-09-13T16:01:18.628667+0000","last_unstale":"2024-09-13T16:01:18.631116+0000","last_undegraded":"2024-09-13T16:01:18.631116+0000","last_fullsized":"2024-09-13T16:01:18.631116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:49.813372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.617495+0000","last_change":"2024-09-13T16:01:18.201791+0000","last_active":"2024-09-13T16:01:18.617495+0000","last_peered":"2024-09-13T16:01:18.617495+0000","last_clean":"2024-09-13T16:01:18.617495+0000","last_became_active":"2024-09-13T16:01:18.201494+0000","last_became_peered":"2024-09-13T16:01:18.201494+0000","last_unstale":"2024-09-13T16:01:18.617495+0000","last_undegraded":"2024-09-13T16:01:18.617495+0000","last_fullsized":"2024-09-13T16:01:18.617495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:29.574043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603176+0000","last_change":"2024-09-13T16:01:18.606975+0000","last_active":"2024-09-13T16:01:19.603176+0000","last_peered":"2024-09-13T16:01:19.603176+0000","last_clean":"2024-09-13T16:01:19.603176+0000","last_became_active":"2024-09-13T16:01:18.604210+0000","last_became_peered":"2024-09-13T16:01:18.604210+0000","last_unstale":"2024-09-13T16:01:19.603176+0000","last_undegraded":"2024-09-13T16:01:19.603176+0000","last_fullsized":"2024-09-13T16:01:19.603176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:18.317702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603997+0000","last_change":"2024-09-13T16:01:18.209833+0000","last_active":"2024-09-13T16:01:19.603997+0000","last_peered":"2024-09-13T16:01:19.603997+0000","last_clean":"2024-09-13T16:01:19.603997+0000","last_became_active":"2024-09-13T16:01:18.209539+0000","last_became_peered":"2024-09-13T16:01:18.209539+0000","last_unstale":"2024-09-13T16:01:19.603997+0000","last_undegraded":"2024-09-13T16:01:19.603997+0000","last_fullsized":"2024-09-13T16:01:19.603997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:29.574043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.629292+0000","last_change":"2024-09-13T16:01:18.625735+0000","last_active":"2024-09-13T16:01:18.629292+0000","last_peered":"2024-09-13T16:01:18.629292+0000","last_clean":"2024-09-13T16:01:18.629292+0000","last_became_active":"2024-09-13T16:01:18.625512+0000","last_became_peered":"2024-09-13T16:01:18.625512+0000","last_unstale":"2024-09-13T16:01:18.629292+0000","last_undegraded":"2024-09-13T16:01:18.629292+0000","last_fullsized":"2024-09-13T16:01:18.629292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:26.431089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.620699+0000","last_change":"2024-09-13T16:01:18.211782+0000","last_active":"2024-09-13T16:01:18.620699+0000","last_peered":"2024-09-13T16:01:18.620699+0000","last_clean":"2024-09-13T16:01:18.620699+0000","last_became_active":"2024-09-13T16:01:18.211163+0000","last_became_peered":"2024-09-13T16:01:18.211163+0000","last_unstale":"2024-09-13T16:01:18.620699+0000","last_undegraded":"2024-09-13T16:01:18.620699+0000","last_fullsized":"2024-09-13T16:01:18.620699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:33.908621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.629714+0000","last_change":"2024-09-13T16:01:18.627394+0000","last_active":"2024-09-13T16:01:18.629714+0000","last_peered":"2024-09-13T16:01:18.629714+0000","last_clean":"2024-09-13T16:01:18.629714+0000","last_became_active":"2024-09-13T16:01:18.624519+0000","last_became_peered":"2024-09-13T16:01:18.624519+0000","last_unstale":"2024-09-13T16:01:18.629714+0000","last_undegraded":"2024-09-13T16:01:18.629714+0000","last_fullsized":"2024-09-13T16:01:18.629714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:49.813372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603339+0000","last_change":"2024-09-13T16:01:18.210433+0000","last_active":"2024-09-13T16:01:19.603339+0000","last_peered":"2024-09-13T16:01:19.603339+0000","last_clean":"2024-09-13T16:01:19.603339+0000","last_became_active":"2024-09-13T16:01:18.210161+0000","last_became_peered":"2024-09-13T16:01:18.210161+0000","last_unstale":"2024-09-13T16:01:19.603339+0000","last_undegraded":"2024-09-13T16:01:19.603339+0000","last_fullsized":"2024-09-13T16:01:19.603339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:55.507079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.637525+0000","last_change":"2024-09-13T16:01:18.630661+0000","last_active":"2024-09-13T16:01:18.637525+0000","last_peered":"2024-09-13T16:01:18.637525+0000","last_clean":"2024-09-13T16:01:18.637525+0000","last_became_active":"2024-09-13T16:01:18.630386+0000","last_became_peered":"2024-09-13T16:01:18.630386+0000","last_unstale":"2024-09-13T16:01:18.637525+0000","last_undegraded":"2024-09-13T16:01:18.637525+0000","last_fullsized":"2024-09-13T16:01:18.637525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:34.993393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603975+0000","last_change":"2024-09-13T16:01:18.197317+0000","last_active":"2024-09-13T16:01:19.603975+0000","last_peered":"2024-09-13T16:01:19.603975+0000","last_clean":"2024-09-13T16:01:19.603975+0000","last_became_active":"2024-09-13T16:01:18.197022+0000","last_became_peered":"2024-09-13T16:01:18.197022+0000","last_unstale":"2024-09-13T16:01:19.603975+0000","last_undegraded":"2024-09-13T16:01:19.603975+0000","last_fullsized":"2024-09-13T16:01:19.603975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:11.867906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.641067+0000","last_change":"2024-09-13T16:01:18.636601+0000","last_active":"2024-09-13T16:01:18.641067+0000","last_peered":"2024-09-13T16:01:18.641067+0000","last_clean":"2024-09-13T16:01:18.641067+0000","last_became_active":"2024-09-13T16:01:18.636246+0000","last_became_peered":"2024-09-13T16:01:18.636246+0000","last_unstale":"2024-09-13T16:01:18.641067+0000","last_undegraded":"2024-09-13T16:01:18.641067+0000","last_fullsized":"2024-09-13T16:01:18.641067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:55.299980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.632078+0000","last_change":"2024-09-13T16:01:18.207068+0000","last_active":"2024-09-13T16:01:18.632078+0000","last_peered":"2024-09-13T16:01:18.632078+0000","last_clean":"2024-09-13T16:01:18.632078+0000","last_became_active":"2024-09-13T16:01:18.206783+0000","last_became_peered":"2024-09-13T16:01:18.206783+0000","last_unstale":"2024-09-13T16:01:18.632078+0000","last_undegraded":"2024-09-13T16:01:18.632078+0000","last_fullsized":"2024-09-13T16:01:18.632078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:47.286118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.622539+0000","last_change":"2024-09-13T16:01:18.618465+0000","last_active":"2024-09-13T16:01:18.622539+0000","last_peered":"2024-09-13T16:01:18.622539+0000","last_clean":"2024-09-13T16:01:18.622539+0000","last_became_active":"2024-09-13T16:01:18.618200+0000","last_became_peered":"2024-09-13T16:01:18.618200+0000","last_unstale":"2024-09-13T16:01:18.622539+0000","last_undegraded":"2024-09-13T16:01:18.622539+0000","last_fullsized":"2024-09-13T16:01:18.622539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:54.527079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.618743+0000","last_change":"2024-09-13T16:01:18.208243+0000","last_active":"2024-09-13T16:01:18.618743+0000","last_peered":"2024-09-13T16:01:18.618743+0000","last_clean":"2024-09-13T16:01:18.618743+0000","last_became_active":"2024-09-13T16:01:18.207672+0000","last_became_peered":"2024-09-13T16:01:18.207672+0000","last_unstale":"2024-09-13T16:01:18.618743+0000","last_undegraded":"2024-09-13T16:01:18.618743+0000","last_fullsized":"2024-09-13T16:01:18.618743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.644401+0000","last_change":"2024-09-13T16:01:18.639262+0000","last_active":"2024-09-13T16:01:18.644401+0000","last_peered":"2024-09-13T16:01:18.644401+0000","last_clean":"2024-09-13T16:01:18.644401+0000","last_became_active":"2024-09-13T16:01:18.639026+0000","last_became_peered":"2024-09-13T16:01:18.639026+0000","last_unstale":"2024-09-13T16:01:18.644401+0000","last_undegraded":"2024-09-13T16:01:18.644401+0000","last_fullsized":"2024-09-13T16:01:18.644401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:49.331305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603731+0000","last_change":"2024-09-13T16:01:18.201169+0000","last_active":"2024-09-13T16:01:19.603731+0000","last_peered":"2024-09-13T16:01:19.603731+0000","last_clean":"2024-09-13T16:01:19.603731+0000","last_became_active":"2024-09-13T16:01:18.199492+0000","last_became_peered":"2024-09-13T16:01:18.199492+0000","last_unstale":"2024-09-13T16:01:19.603731+0000","last_undegraded":"2024-09-13T16:01:19.603731+0000","last_fullsized":"2024-09-13T16:01:19.603731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:41.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603772+0000","last_change":"2024-09-13T16:01:18.623233+0000","last_active":"2024-09-13T16:01:19.603772+0000","last_peered":"2024-09-13T16:01:19.603772+0000","last_clean":"2024-09-13T16:01:19.603772+0000","last_became_active":"2024-09-13T16:01:18.622853+0000","last_became_peered":"2024-09-13T16:01:18.622853+0000","last_unstale":"2024-09-13T16:01:19.603772+0000","last_undegraded":"2024-09-13T16:01:19.603772+0000","last_fullsized":"2024-09-13T16:01:19.603772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:08.669688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603832+0000","last_change":"2024-09-13T16:01:18.199011+0000","last_active":"2024-09-13T16:01:19.603832+0000","last_peered":"2024-09-13T16:01:19.603832+0000","last_clean":"2024-09-13T16:01:19.603832+0000","last_became_active":"2024-09-13T16:01:18.198645+0000","last_became_peered":"2024-09-13T16:01:18.198645+0000","last_unstale":"2024-09-13T16:01:19.603832+0000","last_undegraded":"2024-09-13T16:01:19.603832+0000","last_fullsized":"2024-09-13T16:01:19.603832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:37.847292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.644615+0000","last_change":"2024-09-13T16:01:18.638935+0000","last_active":"2024-09-13T16:01:18.644615+0000","last_peered":"2024-09-13T16:01:18.644615+0000","last_clean":"2024-09-13T16:01:18.644615+0000","last_became_active":"2024-09-13T16:01:18.638609+0000","last_became_peered":"2024-09-13T16:01:18.638609+0000","last_unstale":"2024-09-13T16:01:18.644615+0000","last_undegraded":"2024-09-13T16:01:18.644615+0000","last_fullsized":"2024-09-13T16:01:18.644615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.618592+0000","last_change":"2024-09-13T16:01:18.203508+0000","last_active":"2024-09-13T16:01:18.618592+0000","last_peered":"2024-09-13T16:01:18.618592+0000","last_clean":"2024-09-13T16:01:18.618592+0000","last_became_active":"2024-09-13T16:01:18.203203+0000","last_became_peered":"2024-09-13T16:01:18.203203+0000","last_unstale":"2024-09-13T16:01:18.618592+0000","last_undegraded":"2024-09-13T16:01:18.618592+0000","last_fullsized":"2024-09-13T16:01:18.618592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:47.286118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.644506+0000","last_change":"2024-09-13T16:01:18.639508+0000","last_active":"2024-09-13T16:01:18.644506+0000","last_peered":"2024-09-13T16:01:18.644506+0000","last_clean":"2024-09-13T16:01:18.644506+0000","last_became_active":"2024-09-13T16:01:18.638478+0000","last_became_peered":"2024-09-13T16:01:18.638478+0000","last_unstale":"2024-09-13T16:01:18.644506+0000","last_undegraded":"2024-09-13T16:01:18.644506+0000","last_fullsized":"2024-09-13T16:01:18.644506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:50.539415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603994+0000","last_change":"2024-09-13T16:01:18.201769+0000","last_active":"2024-09-13T16:01:19.603994+0000","last_peered":"2024-09-13T16:01:19.603994+0000","last_clean":"2024-09-13T16:01:19.603994+0000","last_became_active":"2024-09-13T16:01:18.198080+0000","last_became_peered":"2024-09-13T16:01:18.198080+0000","last_unstale":"2024-09-13T16:01:19.603994+0000","last_undegraded":"2024-09-13T16:01:19.603994+0000","last_fullsized":"2024-09-13T16:01:19.603994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.644502+0000","last_change":"2024-09-13T16:01:18.638606+0000","last_active":"2024-09-13T16:01:18.644502+0000","last_peered":"2024-09-13T16:01:18.644502+0000","last_clean":"2024-09-13T16:01:18.644502+0000","last_became_active":"2024-09-13T16:01:18.638374+0000","last_became_peered":"2024-09-13T16:01:18.638374+0000","last_unstale":"2024-09-13T16:01:18.644502+0000","last_undegraded":"2024-09-13T16:01:18.644502+0000","last_fullsized":"2024-09-13T16:01:18.644502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:28.548177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603399+0000","last_change":"2024-09-13T16:01:18.210255+0000","last_active":"2024-09-13T16:01:19.603399+0000","last_peered":"2024-09-13T16:01:19.603399+0000","last_clean":"2024-09-13T16:01:19.603399+0000","last_became_active":"2024-09-13T16:01:18.210014+0000","last_became_peered":"2024-09-13T16:01:18.210014+0000","last_unstale":"2024-09-13T16:01:19.603399+0000","last_undegraded":"2024-09-13T16:01:19.603399+0000","last_fullsized":"2024-09-13T16:01:19.603399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:02.065942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.634582+0000","last_change":"2024-09-13T16:01:18.630699+0000","last_active":"2024-09-13T16:01:18.634582+0000","last_peered":"2024-09-13T16:01:18.634582+0000","last_clean":"2024-09-13T16:01:18.634582+0000","last_became_active":"2024-09-13T16:01:18.630007+0000","last_became_peered":"2024-09-13T16:01:18.630007+0000","last_unstale":"2024-09-13T16:01:18.634582+0000","last_undegraded":"2024-09-13T16:01:18.634582+0000","last_fullsized":"2024-09-13T16:01:18.634582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:28.548177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603901+0000","last_change":"2024-09-13T16:01:18.208200+0000","last_active":"2024-09-13T16:01:19.603901+0000","last_peered":"2024-09-13T16:01:19.603901+0000","last_clean":"2024-09-13T16:01:19.603901+0000","last_became_active":"2024-09-13T16:01:18.206473+0000","last_became_peered":"2024-09-13T16:01:18.206473+0000","last_unstale":"2024-09-13T16:01:19.603901+0000","last_undegraded":"2024-09-13T16:01:19.603901+0000","last_fullsized":"2024-09-13T16:01:19.603901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:41.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.644429+0000","last_change":"2024-09-13T16:01:18.637343+0000","last_active":"2024-09-13T16:01:18.644429+0000","last_peered":"2024-09-13T16:01:18.644429+0000","last_clean":"2024-09-13T16:01:18.644429+0000","last_became_active":"2024-09-13T16:01:18.637052+0000","last_became_peered":"2024-09-13T16:01:18.637052+0000","last_unstale":"2024-09-13T16:01:18.644429+0000","last_undegraded":"2024-09-13T16:01:18.644429+0000","last_fullsized":"2024-09-13T16:01:18.644429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:40:45.237966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.202288+0000","last_change":"2024-09-13T16:01:07.580186+0000","last_active":"2024-09-13T16:01:18.202288+0000","last_peered":"2024-09-13T16:01:18.202288+0000","last_clean":"2024-09-13T16:01:18.202288+0000","last_became_active":"2024-09-13T16:01:07.579877+0000","last_became_peered":"2024-09-13T16:01:07.579877+0000","last_unstale":"2024-09-13T16:01:18.202288+0000","last_undegraded":"2024-09-13T16:01:18.202288+0000","last_fullsized":"2024-09-13T16:01:18.202288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_clean_scrub_stamp":"2024-09-13T16:01:06.070807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:40.645649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.619288+0000","last_change":"2024-09-13T16:01:18.204628+0000","last_active":"2024-09-13T16:01:18.619288+0000","last_peered":"2024-09-13T16:01:18.619288+0000","last_clean":"2024-09-13T16:01:18.619288+0000","last_became_active":"2024-09-13T16:01:18.204302+0000","last_became_peered":"2024-09-13T16:01:18.204302+0000","last_unstale":"2024-09-13T16:01:18.619288+0000","last_undegraded":"2024-09-13T16:01:18.619288+0000","last_fullsized":"2024-09-13T16:01:18.619288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:33.987093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.624114+0000","last_change":"2024-09-13T16:01:18.622448+0000","last_active":"2024-09-13T16:01:18.624114+0000","last_peered":"2024-09-13T16:01:18.624114+0000","last_clean":"2024-09-13T16:01:18.624114+0000","last_became_active":"2024-09-13T16:01:18.621087+0000","last_became_peered":"2024-09-13T16:01:18.621087+0000","last_unstale":"2024-09-13T16:01:18.624114+0000","last_undegraded":"2024-09-13T16:01:18.624114+0000","last_fullsized":"2024-09-13T16:01:18.624114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:19.302417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.620980+0000","last_change":"2024-09-13T16:01:18.210964+0000","last_active":"2024-09-13T16:01:18.620980+0000","last_peered":"2024-09-13T16:01:18.620980+0000","last_clean":"2024-09-13T16:01:18.620980+0000","last_became_active":"2024-09-13T16:01:18.210292+0000","last_became_peered":"2024-09-13T16:01:18.210292+0000","last_unstale":"2024-09-13T16:01:18.620980+0000","last_undegraded":"2024-09-13T16:01:18.620980+0000","last_fullsized":"2024-09-13T16:01:18.620980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:02.065942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.632155+0000","last_change":"2024-09-13T16:01:18.630964+0000","last_active":"2024-09-13T16:01:18.632155+0000","last_peered":"2024-09-13T16:01:18.632155+0000","last_clean":"2024-09-13T16:01:18.632155+0000","last_became_active":"2024-09-13T16:01:18.630721+0000","last_became_peered":"2024-09-13T16:01:18.630721+0000","last_unstale":"2024-09-13T16:01:18.632155+0000","last_undegraded":"2024-09-13T16:01:18.632155+0000","last_fullsized":"2024-09-13T16:01:18.632155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:25.722121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604000+0000","last_change":"2024-09-13T16:01:18.194594+0000","last_active":"2024-09-13T16:01:19.604000+0000","last_peered":"2024-09-13T16:01:19.604000+0000","last_clean":"2024-09-13T16:01:19.604000+0000","last_became_active":"2024-09-13T16:01:18.194321+0000","last_became_peered":"2024-09-13T16:01:18.194321+0000","last_unstale":"2024-09-13T16:01:19.604000+0000","last_undegraded":"2024-09-13T16:01:19.604000+0000","last_fullsized":"2024-09-13T16:01:19.604000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:46.038225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603131+0000","last_change":"2024-09-13T16:01:18.620982+0000","last_active":"2024-09-13T16:01:19.603131+0000","last_peered":"2024-09-13T16:01:19.603131+0000","last_clean":"2024-09-13T16:01:19.603131+0000","last_became_active":"2024-09-13T16:01:18.620567+0000","last_became_peered":"2024-09-13T16:01:18.620567+0000","last_unstale":"2024-09-13T16:01:19.603131+0000","last_undegraded":"2024-09-13T16:01:19.603131+0000","last_fullsized":"2024-09-13T16:01:19.603131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.622189+0000","last_change":"2024-09-13T16:01:18.205821+0000","last_active":"2024-09-13T16:01:18.622189+0000","last_peered":"2024-09-13T16:01:18.622189+0000","last_clean":"2024-09-13T16:01:18.622189+0000","last_became_active":"2024-09-13T16:01:18.205559+0000","last_became_peered":"2024-09-13T16:01:18.205559+0000","last_unstale":"2024-09-13T16:01:18.622189+0000","last_undegraded":"2024-09-13T16:01:18.622189+0000","last_fullsized":"2024-09-13T16:01:18.622189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:41.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.630261+0000","last_change":"2024-09-13T16:01:18.621751+0000","last_active":"2024-09-13T16:01:18.630261+0000","last_peered":"2024-09-13T16:01:18.630261+0000","last_clean":"2024-09-13T16:01:18.630261+0000","last_became_active":"2024-09-13T16:01:18.621504+0000","last_became_peered":"2024-09-13T16:01:18.621504+0000","last_unstale":"2024-09-13T16:01:18.630261+0000","last_undegraded":"2024-09-13T16:01:18.630261+0000","last_fullsized":"2024-09-13T16:01:18.630261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:03.072242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603362+0000","last_change":"2024-09-13T16:01:18.199824+0000","last_active":"2024-09-13T16:01:19.603362+0000","last_peered":"2024-09-13T16:01:19.603362+0000","last_clean":"2024-09-13T16:01:19.603362+0000","last_became_active":"2024-09-13T16:01:18.199321+0000","last_became_peered":"2024-09-13T16:01:18.199321+0000","last_unstale":"2024-09-13T16:01:19.603362+0000","last_undegraded":"2024-09-13T16:01:19.603362+0000","last_fullsized":"2024-09-13T16:01:19.603362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.634626+0000","last_change":"2024-09-13T16:01:18.632613+0000","last_active":"2024-09-13T16:01:18.634626+0000","last_peered":"2024-09-13T16:01:18.634626+0000","last_clean":"2024-09-13T16:01:18.634626+0000","last_became_active":"2024-09-13T16:01:18.632389+0000","last_became_peered":"2024-09-13T16:01:18.632389+0000","last_unstale":"2024-09-13T16:01:18.634626+0000","last_undegraded":"2024-09-13T16:01:18.634626+0000","last_fullsized":"2024-09-13T16:01:18.634626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.622683+0000","last_change":"2024-09-13T16:01:18.212308+0000","last_active":"2024-09-13T16:01:18.622683+0000","last_peered":"2024-09-13T16:01:18.622683+0000","last_clean":"2024-09-13T16:01:18.622683+0000","last_became_active":"2024-09-13T16:01:18.210307+0000","last_became_peered":"2024-09-13T16:01:18.210307+0000","last_unstale":"2024-09-13T16:01:18.622683+0000","last_undegraded":"2024-09-13T16:01:18.622683+0000","last_fullsized":"2024-09-13T16:01:18.622683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:33.908621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603286+0000","last_change":"2024-09-13T16:01:18.616853+0000","last_active":"2024-09-13T16:01:19.603286+0000","last_peered":"2024-09-13T16:01:19.603286+0000","last_clean":"2024-09-13T16:01:19.603286+0000","last_became_active":"2024-09-13T16:01:18.616581+0000","last_became_peered":"2024-09-13T16:01:18.616581+0000","last_unstale":"2024-09-13T16:01:19.603286+0000","last_undegraded":"2024-09-13T16:01:19.603286+0000","last_fullsized":"2024-09-13T16:01:19.603286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:49.813372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603500+0000","last_change":"2024-09-13T16:01:18.211147+0000","last_active":"2024-09-13T16:01:19.603500+0000","last_peered":"2024-09-13T16:01:19.603500+0000","last_clean":"2024-09-13T16:01:19.603500+0000","last_became_active":"2024-09-13T16:01:18.210496+0000","last_became_peered":"2024-09-13T16:01:18.210496+0000","last_unstale":"2024-09-13T16:01:19.603500+0000","last_undegraded":"2024-09-13T16:01:19.603500+0000","last_fullsized":"2024-09-13T16:01:19.603500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:33.987093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.622532+0000","last_change":"2024-09-13T16:01:18.618984+0000","last_active":"2024-09-13T16:01:18.622532+0000","last_peered":"2024-09-13T16:01:18.622532+0000","last_clean":"2024-09-13T16:01:18.622532+0000","last_became_active":"2024-09-13T16:01:18.617587+0000","last_became_peered":"2024-09-13T16:01:18.617587+0000","last_unstale":"2024-09-13T16:01:18.622532+0000","last_undegraded":"2024-09-13T16:01:18.622532+0000","last_fullsized":"2024-09-13T16:01:18.622532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:43.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604083+0000","last_change":"2024-09-13T16:01:18.208715+0000","last_active":"2024-09-13T16:01:19.604083+0000","last_peered":"2024-09-13T16:01:19.604083+0000","last_clean":"2024-09-13T16:01:19.604083+0000","last_became_active":"2024-09-13T16:01:18.208008+0000","last_became_peered":"2024-09-13T16:01:18.208008+0000","last_unstale":"2024-09-13T16:01:19.604083+0000","last_undegraded":"2024-09-13T16:01:19.604083+0000","last_fullsized":"2024-09-13T16:01:19.604083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:33.908621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.631387+0000","last_change":"2024-09-13T16:01:18.627736+0000","last_active":"2024-09-13T16:01:18.631387+0000","last_peered":"2024-09-13T16:01:18.631387+0000","last_clean":"2024-09-13T16:01:18.631387+0000","last_became_active":"2024-09-13T16:01:18.627485+0000","last_became_peered":"2024-09-13T16:01:18.627485+0000","last_unstale":"2024-09-13T16:01:18.631387+0000","last_undegraded":"2024-09-13T16:01:18.631387+0000","last_fullsized":"2024-09-13T16:01:18.631387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:30.675930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.618726+0000","last_change":"2024-09-13T16:01:18.208002+0000","last_active":"2024-09-13T16:01:18.618726+0000","last_peered":"2024-09-13T16:01:18.618726+0000","last_clean":"2024-09-13T16:01:18.618726+0000","last_became_active":"2024-09-13T16:01:18.207573+0000","last_became_peered":"2024-09-13T16:01:18.207573+0000","last_unstale":"2024-09-13T16:01:18.618726+0000","last_undegraded":"2024-09-13T16:01:18.618726+0000","last_fullsized":"2024-09-13T16:01:18.618726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:29.574043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.635051+0000","last_change":"2024-09-13T16:01:18.624658+0000","last_active":"2024-09-13T16:01:18.635051+0000","last_peered":"2024-09-13T16:01:18.635051+0000","last_clean":"2024-09-13T16:01:18.635051+0000","last_became_active":"2024-09-13T16:01:18.623850+0000","last_became_peered":"2024-09-13T16:01:18.623850+0000","last_unstale":"2024-09-13T16:01:18.635051+0000","last_undegraded":"2024-09-13T16:01:18.635051+0000","last_fullsized":"2024-09-13T16:01:18.635051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:30.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603214+0000","last_change":"2024-09-13T16:01:18.207621+0000","last_active":"2024-09-13T16:01:19.603214+0000","last_peered":"2024-09-13T16:01:19.603214+0000","last_clean":"2024-09-13T16:01:19.603214+0000","last_became_active":"2024-09-13T16:01:18.207360+0000","last_became_peered":"2024-09-13T16:01:18.207360+0000","last_unstale":"2024-09-13T16:01:19.603214+0000","last_undegraded":"2024-09-13T16:01:19.603214+0000","last_fullsized":"2024-09-13T16:01:19.603214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:27.211100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.606031+0000","last_change":"2024-09-13T16:01:18.604618+0000","last_active":"2024-09-13T16:01:18.606031+0000","last_peered":"2024-09-13T16:01:18.606031+0000","last_clean":"2024-09-13T16:01:18.606031+0000","last_became_active":"2024-09-13T16:01:18.604304+0000","last_became_peered":"2024-09-13T16:01:18.604304+0000","last_unstale":"2024-09-13T16:01:18.606031+0000","last_undegraded":"2024-09-13T16:01:18.606031+0000","last_fullsized":"2024-09-13T16:01:18.606031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603327+0000","last_change":"2024-09-13T16:01:18.199347+0000","last_active":"2024-09-13T16:01:19.603327+0000","last_peered":"2024-09-13T16:01:19.603327+0000","last_clean":"2024-09-13T16:01:19.603327+0000","last_became_active":"2024-09-13T16:01:18.198961+0000","last_became_peered":"2024-09-13T16:01:18.198961+0000","last_unstale":"2024-09-13T16:01:19.603327+0000","last_undegraded":"2024-09-13T16:01:19.603327+0000","last_fullsized":"2024-09-13T16:01:19.603327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:29.574043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.620012+0000","last_change":"2024-09-13T16:01:18.616823+0000","last_active":"2024-09-13T16:01:18.620012+0000","last_peered":"2024-09-13T16:01:18.620012+0000","last_clean":"2024-09-13T16:01:18.620012+0000","last_became_active":"2024-09-13T16:01:18.616569+0000","last_became_peered":"2024-09-13T16:01:18.616569+0000","last_unstale":"2024-09-13T16:01:18.620012+0000","last_undegraded":"2024-09-13T16:01:18.620012+0000","last_fullsized":"2024-09-13T16:01:18.620012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.638906+0000","last_change":"2024-09-13T16:01:18.214426+0000","last_active":"2024-09-13T16:01:18.638906+0000","last_peered":"2024-09-13T16:01:18.638906+0000","last_clean":"2024-09-13T16:01:18.638906+0000","last_became_active":"2024-09-13T16:01:18.214087+0000","last_became_peered":"2024-09-13T16:01:18.214087+0000","last_unstale":"2024-09-13T16:01:18.638906+0000","last_undegraded":"2024-09-13T16:01:18.638906+0000","last_fullsized":"2024-09-13T16:01:18.638906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604128+0000","last_change":"2024-09-13T16:01:18.620356+0000","last_active":"2024-09-13T16:01:19.604128+0000","last_peered":"2024-09-13T16:01:19.604128+0000","last_clean":"2024-09-13T16:01:19.604128+0000","last_became_active":"2024-09-13T16:01:18.620060+0000","last_became_peered":"2024-09-13T16:01:18.620060+0000","last_unstale":"2024-09-13T16:01:19.604128+0000","last_undegraded":"2024-09-13T16:01:19.604128+0000","last_fullsized":"2024-09-13T16:01:19.604128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:25.722121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.642155+0000","last_change":"2024-09-13T16:01:18.638326+0000","last_active":"2024-09-13T16:01:18.642155+0000","last_peered":"2024-09-13T16:01:18.642155+0000","last_clean":"2024-09-13T16:01:18.642155+0000","last_became_active":"2024-09-13T16:01:18.638047+0000","last_became_peered":"2024-09-13T16:01:18.638047+0000","last_unstale":"2024-09-13T16:01:18.642155+0000","last_undegraded":"2024-09-13T16:01:18.642155+0000","last_fullsized":"2024-09-13T16:01:18.642155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:20.422612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.637623+0000","last_change":"2024-09-13T16:01:18.213077+0000","last_active":"2024-09-13T16:01:18.637623+0000","last_peered":"2024-09-13T16:01:18.637623+0000","last_clean":"2024-09-13T16:01:18.637623+0000","last_became_active":"2024-09-13T16:01:18.212732+0000","last_became_peered":"2024-09-13T16:01:18.212732+0000","last_unstale":"2024-09-13T16:01:18.637623+0000","last_undegraded":"2024-09-13T16:01:18.637623+0000","last_fullsized":"2024-09-13T16:01:18.637623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:55.507079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.630268+0000","last_change":"2024-09-13T16:01:18.623915+0000","last_active":"2024-09-13T16:01:18.630268+0000","last_peered":"2024-09-13T16:01:18.630268+0000","last_clean":"2024-09-13T16:01:18.630268+0000","last_became_active":"2024-09-13T16:01:18.623420+0000","last_became_peered":"2024-09-13T16:01:18.623420+0000","last_unstale":"2024-09-13T16:01:18.630268+0000","last_undegraded":"2024-09-13T16:01:18.630268+0000","last_fullsized":"2024-09-13T16:01:18.630268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:11.951128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.636019+0000","last_change":"2024-09-13T16:01:18.213257+0000","last_active":"2024-09-13T16:01:18.636019+0000","last_peered":"2024-09-13T16:01:18.636019+0000","last_clean":"2024-09-13T16:01:18.636019+0000","last_became_active":"2024-09-13T16:01:18.212675+0000","last_became_peered":"2024-09-13T16:01:18.212675+0000","last_unstale":"2024-09-13T16:01:18.636019+0000","last_undegraded":"2024-09-13T16:01:18.636019+0000","last_fullsized":"2024-09-13T16:01:18.636019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:33.987093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.635470+0000","last_change":"2024-09-13T16:01:18.634167+0000","last_active":"2024-09-13T16:01:18.635470+0000","last_peered":"2024-09-13T16:01:18.635470+0000","last_clean":"2024-09-13T16:01:18.635470+0000","last_became_active":"2024-09-13T16:01:18.633922+0000","last_became_peered":"2024-09-13T16:01:18.633922+0000","last_unstale":"2024-09-13T16:01:18.635470+0000","last_undegraded":"2024-09-13T16:01:18.635470+0000","last_fullsized":"2024-09-13T16:01:18.635470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.611548+0000","last_change":"2024-09-13T16:01:18.196431+0000","last_active":"2024-09-13T16:01:18.611548+0000","last_peered":"2024-09-13T16:01:18.611548+0000","last_clean":"2024-09-13T16:01:18.611548+0000","last_became_active":"2024-09-13T16:01:18.195952+0000","last_became_peered":"2024-09-13T16:01:18.195952+0000","last_unstale":"2024-09-13T16:01:18.611548+0000","last_undegraded":"2024-09-13T16:01:18.611548+0000","last_fullsized":"2024-09-13T16:01:18.611548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:11.867906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.615318+0000","last_change":"2024-09-13T16:01:18.608250+0000","last_active":"2024-09-13T16:01:18.615318+0000","last_peered":"2024-09-13T16:01:18.615318+0000","last_clean":"2024-09-13T16:01:18.615318+0000","last_became_active":"2024-09-13T16:01:18.607998+0000","last_became_peered":"2024-09-13T16:01:18.607998+0000","last_unstale":"2024-09-13T16:01:18.615318+0000","last_undegraded":"2024-09-13T16:01:18.615318+0000","last_fullsized":"2024-09-13T16:01:18.615318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:25.722121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.637197+0000","last_change":"2024-09-13T16:01:18.209539+0000","last_active":"2024-09-13T16:01:18.637197+0000","last_peered":"2024-09-13T16:01:18.637197+0000","last_clean":"2024-09-13T16:01:18.637197+0000","last_became_active":"2024-09-13T16:01:18.209329+0000","last_became_peered":"2024-09-13T16:01:18.209329+0000","last_unstale":"2024-09-13T16:01:18.637197+0000","last_undegraded":"2024-09-13T16:01:18.637197+0000","last_fullsized":"2024-09-13T16:01:18.637197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:46.038225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":64688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":204800,"data_stored":66162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31304,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340536,"statfs":{"total":96636764160,"available":96604708864,"internally_reserved":0,"allocated":192512,"data_stored":64598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":794624,"data_stored":654585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:01:23.135 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T16:01:23.135 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T16:01:23.135 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T16:01:23.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T16:01:23.136 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T16:01:23.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.321+0000 7fd3d6600640 1 Processor -- start 2024-09-13T16:01:23.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.321+0000 7fd3d6600640 1 -- start start 2024-09-13T16:01:23.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.322+0000 7fd3d6600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d0153b20 0x7fd3d00b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:23.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.322+0000 7fd3d6600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d0153f00 con 0x7fd3d006f660 2024-09-13T16:01:23.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.322+0000 7fd3d6600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d00b1a40 con 0x7fd3d0159a80 2024-09-13T16:01:23.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.322+0000 7fd3d6600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d00ce600 con 0x7fd3d0153b20 2024-09-13T16:01:23.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.323+0000 7fd3cfe00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd3d006f660 0x7fd3d006d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39060/0 (socket says 172.21.15.70:39060) 2024-09-13T16:01:23.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.323+0000 7fd3cfe00640 1 -- 172.21.15.70:0/3849063701 learned_addr learned my addr 172.21.15.70:0/3849063701 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:23.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.323+0000 7fd3cf400640 1 --2- 172.21.15.70:0/3849063701 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d0153b20 0x7fd3d00b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:23.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.323+0000 7fd3ce000640 1 -- 172.21.15.70:0/3849063701 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074372521 0 0) 0x7fd3d0153f00 con 0x7fd3d006f660 2024-09-13T16:01:23.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.323+0000 7fd3ce000640 1 -- 172.21.15.70:0/3849063701 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3b4003520 con 0x7fd3d006f660 2024-09-13T16:01:23.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.323+0000 7fd3ce000640 1 -- 172.21.15.70:0/3849063701 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905411996 0 0) 0x7fd3d00b1a40 con 0x7fd3d0159a80 2024-09-13T16:01:23.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.323+0000 7fd3ce000640 1 -- 172.21.15.70:0/3849063701 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3d0153f00 con 0x7fd3d0159a80 2024-09-13T16:01:23.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.323+0000 7fd3cf400640 1 -- 172.21.15.70:0/3849063701 >> v1:172.21.15.107:6789/0 conn(0x7fd3d0159a80 legacy=0x7fd3d00b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:23.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.323+0000 7fd3cf400640 1 -- 172.21.15.70:0/3849063701 >> v1:172.21.15.70:6789/0 conn(0x7fd3d006f660 legacy=0x7fd3d006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:23.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.323+0000 7fd3cf400640 1 -- 172.21.15.70:0/3849063701 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d015a1f0 con 0x7fd3d0153b20 2024-09-13T16:01:23.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.324+0000 7fd3cf400640 1 --2- 172.21.15.70:0/3849063701 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d0153b20 0x7fd3d00b3990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00097d0 tx=0x7fd3c002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af1c0723f5c43d37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:23.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.325+0000 7fd3ce000640 1 -- 172.21.15.70:0/3849063701 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0032440 con 0x7fd3d0153b20 2024-09-13T16:01:23.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.325+0000 7fd3ce000640 1 -- 172.21.15.70:0/3849063701 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c00325a0 con 0x7fd3d0153b20 2024-09-13T16:01:23.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.325+0000 7fd3ce000640 1 -- 172.21.15.70:0/3849063701 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0032930 con 0x7fd3d0153b20 2024-09-13T16:01:23.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.325+0000 7fd3d6600640 1 -- 172.21.15.70:0/3849063701 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d0153b20 msgr2=0x7fd3d00b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:23.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.325+0000 7fd3d6600640 1 --2- 172.21.15.70:0/3849063701 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d0153b20 0x7fd3d00b3990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00097d0 tx=0x7fd3c002a210 comp rx=0 tx=0).stop 2024-09-13T16:01:23.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.325+0000 7fd3d6600640 1 -- 172.21.15.70:0/3849063701 shutdown_connections 2024-09-13T16:01:23.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.325+0000 7fd3d6600640 1 --2- 172.21.15.70:0/3849063701 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d0153b20 0x7fd3d00b3990 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.325+0000 7fd3d6600640 1 -- 172.21.15.70:0/3849063701 >> 172.21.15.70:0/3849063701 conn(0x7fd3d00b0510 msgr2=0x7fd3d00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:23.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.325+0000 7fd3d6600640 1 -- 172.21.15.70:0/3849063701 shutdown_connections 2024-09-13T16:01:23.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.325+0000 7fd3d6600640 1 -- 172.21.15.70:0/3849063701 wait complete. 2024-09-13T16:01:23.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.327+0000 7fd3d6600640 1 Processor -- start 2024-09-13T16:01:23.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.327+0000 7fd3d6600640 1 -- start start 2024-09-13T16:01:23.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.328+0000 7fd3d6600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d006f660 0x7fd3d01f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:23.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.328+0000 7fd3d6600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3d0153b20 0x7fd3d015a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:23.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.328+0000 7fd3d6600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d0159a80 0x7fd3d015af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:23.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.328+0000 7fd3d6600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d01f22a0 con 0x7fd3d0153b20 2024-09-13T16:01:23.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.328+0000 7fd3d6600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d0156ed0 con 0x7fd3d0159a80 2024-09-13T16:01:23.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.328+0000 7fd3d6600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d01571b0 con 0x7fd3d006f660 2024-09-13T16:01:23.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.328+0000 7fd3cea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3d0153b20 0x7fd3d015a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:23.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.328+0000 7fd3cea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3d0153b20 0x7fd3d015a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35776/0 (socket says 172.21.15.70:35776) 2024-09-13T16:01:23.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.328+0000 7fd3cea00640 1 -- 172.21.15.70:0/1929448478 learned_addr learned my addr 172.21.15.70:0/1929448478 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:23.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.328+0000 7fd3cf400640 1 --2- 172.21.15.70:0/1929448478 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d006f660 0x7fd3d01f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:23.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.328+0000 7fd3cfe00640 1 --2- 172.21.15.70:0/1929448478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d0159a80 0x7fd3d015af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:23.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.329+0000 7fd3cea00640 1 -- 172.21.15.70:0/1929448478 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d006f660 msgr2=0x7fd3d01f1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:23.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.329+0000 7fd3cea00640 1 --2- 172.21.15.70:0/1929448478 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d006f660 0x7fd3d01f1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.329+0000 7fd3cea00640 1 -- 172.21.15.70:0/1929448478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d0159a80 msgr2=0x7fd3d015af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:23.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.329+0000 7fd3cea00640 1 --2- 172.21.15.70:0/1929448478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d0159a80 0x7fd3d015af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.329+0000 7fd3cea00640 1 -- 172.21.15.70:0/1929448478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c0009400 con 0x7fd3d0153b20 2024-09-13T16:01:23.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.329+0000 7fd3cea00640 1 --2- 172.21.15.70:0/1929448478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3d0153b20 0x7fd3d015a9f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00c450 tx=0x7fd3bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:23.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.329+0000 7fd3c7400640 1 -- 172.21.15.70:0/1929448478 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc0052d0 con 0x7fd3d0153b20 2024-09-13T16:01:23.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.329+0000 7fd3c7400640 1 -- 172.21.15.70:0/1929448478 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc005430 con 0x7fd3d0153b20 2024-09-13T16:01:23.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.329+0000 7fd3d6600640 1 -- 172.21.15.70:0/1929448478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d013fd40 con 0x7fd3d0153b20 2024-09-13T16:01:23.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.329+0000 7fd3c7400640 1 -- 172.21.15.70:0/1929448478 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc012870 con 0x7fd3d0153b20 2024-09-13T16:01:23.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.329+0000 7fd3d6600640 1 -- 172.21.15.70:0/1929448478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d0156b90 con 0x7fd3d0153b20 2024-09-13T16:01:23.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.330+0000 7fd3d6600640 1 -- 172.21.15.70:0/1929448478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d01573d0 con 0x7fd3d0153b20 2024-09-13T16:01:23.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.331+0000 7fd3c7400640 1 -- 172.21.15.70:0/1929448478 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd3bc0129d0 con 0x7fd3d0153b20 2024-09-13T16:01:23.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.332+0000 7fd3c7400640 1 --2- 172.21.15.70:0/1929448478 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd3b006ac00 0x7fd3b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:23.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.332+0000 7fd3c7400640 1 -- 172.21.15.70:0/1929448478 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3bc088e40 con 0x7fd3d0153b20 2024-09-13T16:01:23.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.332+0000 7fd3cf400640 1 --2- 172.21.15.70:0/1929448478 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd3b006ac00 0x7fd3b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:23.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.333+0000 7fd3cf400640 1 --2- 172.21.15.70:0/1929448478 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd3b006ac00 0x7fd3b006d0c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0034000 tx=0x7fd3c002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:23.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.337+0000 7fd3c7400640 1 -- 172.21.15.70:0/1929448478 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd3bc0540f0 con 0x7fd3d0153b20 2024-09-13T16:01:23.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.551+0000 7fd3d6600640 1 -- 172.21.15.70:0/1929448478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd3d00b3990 con 0x7fd3d0153b20 2024-09-13T16:01:23.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.554+0000 7fd3c7400640 1 -- 172.21.15.70:0/1929448478 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170952 (secure 0 0 0) 0x7fd3bc057710 con 0x7fd3d0153b20 2024-09-13T16:01:23.557 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:23.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.557+0000 7fd3d6600640 1 -- 172.21.15.70:0/1929448478 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd3b006ac00 msgr2=0x7fd3b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:23.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.557+0000 7fd3d6600640 1 --2- 172.21.15.70:0/1929448478 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd3b006ac00 0x7fd3b006d0c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0034000 tx=0x7fd3c002e000 comp rx=0 tx=0).stop 2024-09-13T16:01:23.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.557+0000 7fd3d6600640 1 -- 172.21.15.70:0/1929448478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3d0153b20 msgr2=0x7fd3d015a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:23.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.557+0000 7fd3d6600640 1 --2- 172.21.15.70:0/1929448478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3d0153b20 0x7fd3d015a9f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00c450 tx=0x7fd3bc00c910 comp rx=0 tx=0).stop 2024-09-13T16:01:23.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.557+0000 7fd3d6600640 1 -- 172.21.15.70:0/1929448478 shutdown_connections 2024-09-13T16:01:23.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.557+0000 7fd3d6600640 1 --2- 172.21.15.70:0/1929448478 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd3b006ac00 0x7fd3b006d0c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.557+0000 7fd3d6600640 1 --2- 172.21.15.70:0/1929448478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d0159a80 0x7fd3d015af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.557+0000 7fd3d6600640 1 --2- 172.21.15.70:0/1929448478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3d0153b20 0x7fd3d015a9f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.557+0000 7fd3d6600640 1 --2- 172.21.15.70:0/1929448478 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d006f660 0x7fd3d01f1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.557+0000 7fd3d6600640 1 -- 172.21.15.70:0/1929448478 >> 172.21.15.70:0/1929448478 conn(0x7fd3d00b0510 msgr2=0x7fd3d006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:23.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.557+0000 7fd3d6600640 1 -- 172.21.15.70:0/1929448478 shutdown_connections 2024-09-13T16:01:23.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.557+0000 7fd3d6600640 1 -- 172.21.15.70:0/1929448478 wait complete. 2024-09-13T16:01:23.574 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4156194691},{"type":"v1","addr":"172.21.15.70:6833","nonce":4156194691}]},"active_addr":"172.21.15.70:6833/4156194691","active_change":"2024-09-13T16:00:58.005548+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2788200631}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2088115648}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":1529693018}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":1517350617}]}]} 2024-09-13T16:01:23.579 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T16:01:23.579 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T16:01:23.579 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.731+0000 7f95bb200640 1 Processor -- start 2024-09-13T16:01:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.731+0000 7f95bb200640 1 -- start start 2024-09-13T16:01:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.732+0000 7f95bb200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f95b40b1e40 0x7f95b4159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.732+0000 7f95bb200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f95b40b32d0 0x7f95b4070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.732+0000 7f95bb200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b415a430 con 0x7f95b40b2220 2024-09-13T16:01:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.733+0000 7f95bb200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b41598b0 con 0x7f95b40b32d0 2024-09-13T16:01:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.733+0000 7f95bb200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b4159b90 con 0x7f95b40b1e40 2024-09-13T16:01:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.733+0000 7f95b9200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f95b40b32d0 0x7f95b4070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:23.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.733+0000 7f95b9200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f95b40b32d0 0x7f95b4070720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35784/0 (socket says 172.21.15.70:35784) 2024-09-13T16:01:23.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.733+0000 7f95b9200640 1 -- 172.21.15.70:0/1947585332 learned_addr learned my addr 172.21.15.70:0/1947585332 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:23.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.733+0000 7f95b3e00640 1 --2- 172.21.15.70:0/1947585332 >> v2:172.21.15.107:3300/0 conn(0x7f95b40b1e40 0x7f95b4159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:23.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.733+0000 7f95b9200640 1 -- 172.21.15.70:0/1947585332 >> v2:172.21.15.107:3300/0 conn(0x7f95b40b1e40 msgr2=0x7f95b4159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:23.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.733+0000 7f95b9200640 1 --2- 172.21.15.70:0/1947585332 >> v2:172.21.15.107:3300/0 conn(0x7f95b40b1e40 0x7f95b4159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.733+0000 7f95b9200640 1 -- 172.21.15.70:0/1947585332 >> v1:172.21.15.107:6789/0 conn(0x7f95b40b2220 legacy=0x7f95b40b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:23.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.733+0000 7f95b9200640 1 -- 172.21.15.70:0/1947585332 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b4159e70 con 0x7f95b40b32d0 2024-09-13T16:01:23.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.733+0000 7f95b3e00640 1 --2- 172.21.15.70:0/1947585332 >> v2:172.21.15.107:3300/0 conn(0x7f95b40b1e40 0x7f95b4159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:23.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.734+0000 7f95b9200640 1 --2- 172.21.15.70:0/1947585332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95b40b32d0 0x7f95b4070720 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f95b406daf0 tx=0x7f95ac02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2dd48daf052d1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:23.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.734+0000 7f95b2a00640 1 -- 172.21.15.70:0/1947585332 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac031600 con 0x7f95b40b32d0 2024-09-13T16:01:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.734+0000 7f95b2a00640 1 -- 172.21.15.70:0/1947585332 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac02d050 con 0x7f95b40b32d0 2024-09-13T16:01:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.734+0000 7f95b2a00640 1 -- 172.21.15.70:0/1947585332 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac031980 con 0x7f95b40b32d0 2024-09-13T16:01:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.735+0000 7f95bb200640 1 -- 172.21.15.70:0/1947585332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95b40b32d0 msgr2=0x7f95b4070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.735+0000 7f95bb200640 1 --2- 172.21.15.70:0/1947585332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95b40b32d0 0x7f95b4070720 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f95b406daf0 tx=0x7f95ac02a6a0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.735+0000 7f95bb200640 1 -- 172.21.15.70:0/1947585332 shutdown_connections 2024-09-13T16:01:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.735+0000 7f95bb200640 1 --2- 172.21.15.70:0/1947585332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95b40b32d0 0x7f95b4070720 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.735+0000 7f95bb200640 1 --2- 172.21.15.70:0/1947585332 >> v2:172.21.15.107:3300/0 conn(0x7f95b40b1e40 0x7f95b4159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.735+0000 7f95bb200640 1 -- 172.21.15.70:0/1947585332 >> 172.21.15.70:0/1947585332 conn(0x7f95b40b0510 msgr2=0x7f95b40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.735+0000 7f95bb200640 1 -- 172.21.15.70:0/1947585332 shutdown_connections 2024-09-13T16:01:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.735+0000 7f95bb200640 1 -- 172.21.15.70:0/1947585332 wait complete. 2024-09-13T16:01:23.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.737+0000 7f95bb200640 1 Processor -- start 2024-09-13T16:01:23.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.737+0000 7f95bb200640 1 -- start start 2024-09-13T16:01:23.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.738+0000 7f95bb200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95b40b1e40 0x7f95b4152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:23.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.738+0000 7f95bb200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95b40b2220 0x7f95b4158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.738+0000 7f95bb200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95b40b32d0 0x7f95b415b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.738+0000 7f95bb200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b415bae0 con 0x7f95b40b32d0 2024-09-13T16:01:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.738+0000 7f95bb200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b41580a0 con 0x7f95b40b1e40 2024-09-13T16:01:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.738+0000 7f95bb200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b4157770 con 0x7f95b40b2220 2024-09-13T16:01:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.738+0000 7f95b9200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95b40b32d0 0x7f95b415b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.738+0000 7f95b9200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95b40b32d0 0x7f95b415b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35786/0 (socket says 172.21.15.70:35786) 2024-09-13T16:01:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.738+0000 7f95b9200640 1 -- 172.21.15.70:0/1572231914 learned_addr learned my addr 172.21.15.70:0/1572231914 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.738+0000 7f95b3e00640 1 --2- 172.21.15.70:0/1572231914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95b40b1e40 0x7f95b4152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.738+0000 7f95b3400640 1 --2- 172.21.15.70:0/1572231914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95b40b2220 0x7f95b4158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.738+0000 7f95b9200640 1 -- 172.21.15.70:0/1572231914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95b40b2220 msgr2=0x7f95b4158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.738+0000 7f95b9200640 1 --2- 172.21.15.70:0/1572231914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95b40b2220 0x7f95b4158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.738+0000 7f95b9200640 1 -- 172.21.15.70:0/1572231914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95b40b1e40 msgr2=0x7f95b4152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.738+0000 7f95b9200640 1 --2- 172.21.15.70:0/1572231914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95b40b1e40 0x7f95b4152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.738+0000 7f95b9200640 1 -- 172.21.15.70:0/1572231914 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac009b30 con 0x7f95b40b32d0 2024-09-13T16:01:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.738+0000 7f95b3e00640 1 --2- 172.21.15.70:0/1572231914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95b40b1e40 0x7f95b4152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.738+0000 7f95b3400640 1 --2- 172.21.15.70:0/1572231914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95b40b2220 0x7f95b4158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.739+0000 7f95b9200640 1 --2- 172.21.15.70:0/1572231914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95b40b32d0 0x7f95b415b040 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f95ac034040 tx=0x7f95ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.739+0000 7f95abe00640 1 -- 172.21.15.70:0/1572231914 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac03d860 con 0x7f95b40b32d0 2024-09-13T16:01:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.739+0000 7f95abe00640 1 -- 172.21.15.70:0/1572231914 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac03d9e0 con 0x7f95b40b32d0 2024-09-13T16:01:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.739+0000 7f95bb200640 1 -- 172.21.15.70:0/1572231914 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b4157a50 con 0x7f95b40b32d0 2024-09-13T16:01:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.739+0000 7f95abe00640 1 -- 172.21.15.70:0/1572231914 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac03dd90 con 0x7f95b40b32d0 2024-09-13T16:01:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.739+0000 7f95bb200640 1 -- 172.21.15.70:0/1572231914 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b415d4a0 con 0x7f95b40b32d0 2024-09-13T16:01:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.740+0000 7f95bb200640 1 -- 172.21.15.70:0/1572231914 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b4158230 con 0x7f95b40b32d0 2024-09-13T16:01:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.741+0000 7f95abe00640 1 -- 172.21.15.70:0/1572231914 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f95ac03b400 con 0x7f95b40b32d0 2024-09-13T16:01:23.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.742+0000 7f95abe00640 1 --2- 172.21.15.70:0/1572231914 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f959406ac00 0x7f959406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:23.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.742+0000 7f95abe00640 1 -- 172.21.15.70:0/1572231914 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95ac0a9ff0 con 0x7f95b40b32d0 2024-09-13T16:01:23.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.742+0000 7f95b3e00640 1 --2- 172.21.15.70:0/1572231914 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f959406ac00 0x7f959406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:23.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.743+0000 7f95b3e00640 1 --2- 172.21.15.70:0/1572231914 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f959406ac00 0x7f959406d0c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f95a4006fd0 tx=0x7f95a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:23.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.746+0000 7f95abe00640 1 -- 172.21.15.70:0/1572231914 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f95ac0dd9c0 con 0x7f95b40b32d0 2024-09-13T16:01:23.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.915+0000 7f95bb200640 1 -- 172.21.15.70:0/1572231914 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95b4070720 con 0x7f95b40b32d0 2024-09-13T16:01:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.916+0000 7f95abe00640 1 -- 172.21.15.70:0/1572231914 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f95ac075150 con 0x7f95b40b32d0 2024-09-13T16:01:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:23.918 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:19.595458+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:23.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.918+0000 7f95bb200640 1 -- 172.21.15.70:0/1572231914 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f959406ac00 msgr2=0x7f959406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:23.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.918+0000 7f95bb200640 1 --2- 172.21.15.70:0/1572231914 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f959406ac00 0x7f959406d0c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f95a4006fd0 tx=0x7f95a4008040 comp rx=0 tx=0).stop 2024-09-13T16:01:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.918+0000 7f95bb200640 1 -- 172.21.15.70:0/1572231914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95b40b32d0 msgr2=0x7f95b415b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.918+0000 7f95bb200640 1 --2- 172.21.15.70:0/1572231914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95b40b32d0 0x7f95b415b040 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f95ac034040 tx=0x7f95ac004a40 comp rx=0 tx=0).stop 2024-09-13T16:01:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.918+0000 7f95bb200640 1 -- 172.21.15.70:0/1572231914 shutdown_connections 2024-09-13T16:01:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.918+0000 7f95bb200640 1 --2- 172.21.15.70:0/1572231914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95b40b32d0 0x7f95b415b040 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.918+0000 7f95bb200640 1 --2- 172.21.15.70:0/1572231914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95b40b2220 0x7f95b4158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.918+0000 7f95bb200640 1 --2- 172.21.15.70:0/1572231914 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f959406ac00 0x7f959406d0c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.918+0000 7f95bb200640 1 --2- 172.21.15.70:0/1572231914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95b40b1e40 0x7f95b4152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.918+0000 7f95bb200640 1 -- 172.21.15.70:0/1572231914 >> 172.21.15.70:0/1572231914 conn(0x7f95b40b0510 msgr2=0x7f95b40ad400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.918+0000 7f95bb200640 1 -- 172.21.15.70:0/1572231914 shutdown_connections 2024-09-13T16:01:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:23.918+0000 7f95bb200640 1 -- 172.21.15.70:0/1572231914 wait complete. 2024-09-13T16:01:23.935 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T16:01:23.935 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:24.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.085+0000 7fb083a00640 1 Processor -- start 2024-09-13T16:01:24.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.085+0000 7fb083a00640 1 -- start start 2024-09-13T16:01:24.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.086+0000 7fb083a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb07c0b3990 0x7fb07c159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.087+0000 7fb083a00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c159fc0 con 0x7fb07c153b20 2024-09-13T16:01:24.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.087+0000 7fb083a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c153f00 con 0x7fb07c06f660 2024-09-13T16:01:24.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.087+0000 7fb083a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c0ce600 con 0x7fb07c0b3990 2024-09-13T16:01:24.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.087+0000 7fb081000640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb07c153b20 0x7fb07c0b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39066/0 (socket says 172.21.15.70:39066) 2024-09-13T16:01:24.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.087+0000 7fb081000640 1 -- 172.21.15.70:0/3312991278 learned_addr learned my addr 172.21.15.70:0/3312991278 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:24.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.087+0000 7fb073e00640 1 --2- 172.21.15.70:0/3312991278 >> v2:172.21.15.107:3300/0 conn(0x7fb07c0b3990 0x7fb07c159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.087+0000 7fb07be00640 1 -- 172.21.15.70:0/3312991278 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063426544 0 0) 0x7fb07c159fc0 con 0x7fb07c153b20 2024-09-13T16:01:24.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.087+0000 7fb07be00640 1 -- 172.21.15.70:0/3312991278 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb060003520 con 0x7fb07c153b20 2024-09-13T16:01:24.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.087+0000 7fb07be00640 1 -- 172.21.15.70:0/3312991278 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332392406 0 0) 0x7fb07c153f00 con 0x7fb07c06f660 2024-09-13T16:01:24.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.087+0000 7fb07be00640 1 -- 172.21.15.70:0/3312991278 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb07c159fc0 con 0x7fb07c06f660 2024-09-13T16:01:24.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.087+0000 7fb07be00640 1 -- 172.21.15.70:0/3312991278 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 943507939 0 0) 0x7fb060003520 con 0x7fb07c153b20 2024-09-13T16:01:24.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.087+0000 7fb07be00640 1 -- 172.21.15.70:0/3312991278 >> v2:172.21.15.107:3300/0 conn(0x7fb07c0b3990 msgr2=0x7fb07c159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:24.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb07be00640 1 --2- 172.21.15.70:0/3312991278 >> v2:172.21.15.107:3300/0 conn(0x7fb07c0b3990 0x7fb07c159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb07be00640 1 -- 172.21.15.70:0/3312991278 >> v1:172.21.15.107:6789/0 conn(0x7fb07c06f660 legacy=0x7fb07c06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb07be00640 1 -- 172.21.15.70:0/3312991278 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c0b1a40 con 0x7fb07c153b20 2024-09-13T16:01:24.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb07be00640 1 -- 172.21.15.70:0/3312991278 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7fb06c001670 con 0x7fb07c153b20 2024-09-13T16:01:24.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb07be00640 1 -- 172.21.15.70:0/3312991278 >> v1:172.21.15.70:6789/0 conn(0x7fb07c153b20 legacy=0x7fb07c0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb07be00640 1 --2- 172.21.15.70:0/3312991278 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb060003b00 0x7fb060003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb07be00640 1 --2- 172.21.15.70:0/3312991278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0600047c0 0x7fb060004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb07be00640 1 --2- 172.21.15.70:0/3312991278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb060005180 0x7fb06000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb07be00640 1 -- 172.21.15.70:0/3312991278 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0ce600 con 0x7fb060005180 2024-09-13T16:01:24.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb07be00640 1 -- 172.21.15.70:0/3312991278 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06000e210 con 0x7fb0600047c0 2024-09-13T16:01:24.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb07be00640 1 -- 172.21.15.70:0/3312991278 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06000e3d0 con 0x7fb060003b00 2024-09-13T16:01:24.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb073e00640 1 --2- 172.21.15.70:0/3312991278 >> v2:172.21.15.107:3300/0 conn(0x7fb07c0b3990 0x7fb07c159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:24.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb081a00640 1 --2- 172.21.15.70:0/3312991278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb060005180 0x7fb06000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb081000640 1 --2- 172.21.15.70:0/3312991278 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb060003b00 0x7fb060003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb073e00640 1 --2- 172.21.15.70:0/3312991278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0600047c0 0x7fb060004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb081a00640 1 -- 172.21.15.70:0/3312991278 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb060003b00 msgr2=0x7fb060003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:24.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb081a00640 1 --2- 172.21.15.70:0/3312991278 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb060003b00 0x7fb060003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb081a00640 1 -- 172.21.15.70:0/3312991278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0600047c0 msgr2=0x7fb060004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:24.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb081a00640 1 --2- 172.21.15.70:0/3312991278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0600047c0 0x7fb060004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb081a00640 1 -- 172.21.15.70:0/3312991278 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb060003520 con 0x7fb060005180 2024-09-13T16:01:24.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.088+0000 7fb073e00640 1 --2- 172.21.15.70:0/3312991278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0600047c0 0x7fb060004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:24.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.089+0000 7fb081a00640 1 -- 172.21.15.70:0/3312991278 reap_dead start 2024-09-13T16:01:24.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.089+0000 7fb081a00640 1 --2- 172.21.15.70:0/3312991278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb060005180 0x7fb06000db90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb074001fd0 tx=0x7fb0600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5c31b44a193fa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.089+0000 7fb07be00640 1 -- 172.21.15.70:0/3312991278 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074003b70 con 0x7fb060005180 2024-09-13T16:01:24.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.089+0000 7fb07be00640 1 -- 172.21.15.70:0/3312991278 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07402d050 con 0x7fb060005180 2024-09-13T16:01:24.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.089+0000 7fb07be00640 1 -- 172.21.15.70:0/3312991278 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0740050d0 con 0x7fb060005180 2024-09-13T16:01:24.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.090+0000 7fb083a00640 1 -- 172.21.15.70:0/3312991278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb060005180 msgr2=0x7fb06000db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.090+0000 7fb083a00640 1 --2- 172.21.15.70:0/3312991278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb060005180 0x7fb06000db90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb074001fd0 tx=0x7fb0600057f0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.090+0000 7fb083a00640 1 -- 172.21.15.70:0/3312991278 shutdown_connections 2024-09-13T16:01:24.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.090+0000 7fb083a00640 1 --2- 172.21.15.70:0/3312991278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb060005180 0x7fb06000db90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.090+0000 7fb083a00640 1 -- 172.21.15.70:0/3312991278 >> 172.21.15.70:0/3312991278 conn(0x7fb07c0b0510 msgr2=0x7fb07c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:24.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.090+0000 7fb083a00640 1 -- 172.21.15.70:0/3312991278 shutdown_connections 2024-09-13T16:01:24.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.090+0000 7fb083a00640 1 -- 172.21.15.70:0/3312991278 wait complete. 2024-09-13T16:01:24.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.092+0000 7fb083a00640 1 Processor -- start 2024-09-13T16:01:24.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.092+0000 7fb083a00640 1 -- start start 2024-09-13T16:01:24.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.093+0000 7fb083a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb060005180 0x7fb07c0adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.093+0000 7fb083a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb07c155470 0x7fb07c156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.093+0000 7fb083a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb07c0cd0f0 0x7fb07c0cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.093+0000 7fb083a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0cdae0 con 0x7fb060005180 2024-09-13T16:01:24.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.093+0000 7fb083a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c1f1290 con 0x7fb07c155470 2024-09-13T16:01:24.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.093+0000 7fb083a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c1f14e0 con 0x7fb07c0cd0f0 2024-09-13T16:01:24.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.093+0000 7fb081000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb060005180 0x7fb07c0adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.093+0000 7fb081000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb060005180 0x7fb07c0adb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35808/0 (socket says 172.21.15.70:35808) 2024-09-13T16:01:24.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.093+0000 7fb081000640 1 -- 172.21.15.70:0/1665822248 learned_addr learned my addr 172.21.15.70:0/1665822248 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:24.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.093+0000 7fb073e00640 1 --2- 172.21.15.70:0/1665822248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb07c155470 0x7fb07c156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.093+0000 7fb081a00640 1 --2- 172.21.15.70:0/1665822248 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb07c0cd0f0 0x7fb07c0cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.093+0000 7fb081000640 1 -- 172.21.15.70:0/1665822248 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb07c0cd0f0 msgr2=0x7fb07c0cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.093+0000 7fb081000640 1 --2- 172.21.15.70:0/1665822248 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb07c0cd0f0 0x7fb07c0cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.093+0000 7fb081000640 1 -- 172.21.15.70:0/1665822248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb07c155470 msgr2=0x7fb07c156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.093+0000 7fb081000640 1 --2- 172.21.15.70:0/1665822248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb07c155470 0x7fb07c156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.093+0000 7fb081000640 1 -- 172.21.15.70:0/1665822248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c1f17c0 con 0x7fb060005180 2024-09-13T16:01:24.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.093+0000 7fb073e00640 1 --2- 172.21.15.70:0/1665822248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb07c155470 0x7fb07c156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:24.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.094+0000 7fb081000640 1 --2- 172.21.15.70:0/1665822248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb060005180 0x7fb07c0adb70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb06c004f70 tx=0x7fb06c0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.094+0000 7fb079600640 1 -- 172.21.15.70:0/1665822248 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c00f750 con 0x7fb060005180 2024-09-13T16:01:24.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.094+0000 7fb079600640 1 -- 172.21.15.70:0/1665822248 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c00f8f0 con 0x7fb060005180 2024-09-13T16:01:24.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.094+0000 7fb083a00640 1 -- 172.21.15.70:0/1665822248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c1f1aa0 con 0x7fb060005180 2024-09-13T16:01:24.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.094+0000 7fb079600640 1 -- 172.21.15.70:0/1665822248 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c00fca0 con 0x7fb060005180 2024-09-13T16:01:24.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.094+0000 7fb083a00640 1 -- 172.21.15.70:0/1665822248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c0ae0b0 con 0x7fb060005180 2024-09-13T16:01:24.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.095+0000 7fb083a00640 1 -- 172.21.15.70:0/1665822248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c15a9f0 con 0x7fb060005180 2024-09-13T16:01:24.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.096+0000 7fb079600640 1 -- 172.21.15.70:0/1665822248 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb06c01d460 con 0x7fb060005180 2024-09-13T16:01:24.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.097+0000 7fb079600640 1 --2- 172.21.15.70:0/1665822248 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb05806ac00 0x7fb05806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.097+0000 7fb079600640 1 -- 172.21.15.70:0/1665822248 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb06c0893c0 con 0x7fb060005180 2024-09-13T16:01:24.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.097+0000 7fb073e00640 1 --2- 172.21.15.70:0/1665822248 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb05806ac00 0x7fb05806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.097+0000 7fb073e00640 1 --2- 172.21.15.70:0/1665822248 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb05806ac00 0x7fb05806d0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0ce0c0 tx=0x7fb064008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.101+0000 7fb079600640 1 -- 172.21.15.70:0/1665822248 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb07c15a9f0 con 0x7fb060005180 2024-09-13T16:01:24.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.270+0000 7fb083a00640 1 -- 172.21.15.70:0/1665822248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb07c15a9f0 con 0x7fb060005180 2024-09-13T16:01:24.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.271+0000 7fb079600640 1 -- 172.21.15.70:0/1665822248 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7fb07c15a9f0 con 0x7fb060005180 2024-09-13T16:01:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:24.273 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:19.595458+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:24.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.273+0000 7fb083a00640 1 -- 172.21.15.70:0/1665822248 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb05806ac00 msgr2=0x7fb05806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.273+0000 7fb083a00640 1 --2- 172.21.15.70:0/1665822248 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb05806ac00 0x7fb05806d0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0ce0c0 tx=0x7fb064008040 comp rx=0 tx=0).stop 2024-09-13T16:01:24.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.273+0000 7fb083a00640 1 -- 172.21.15.70:0/1665822248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb060005180 msgr2=0x7fb07c0adb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.273+0000 7fb083a00640 1 --2- 172.21.15.70:0/1665822248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb060005180 0x7fb07c0adb70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb06c004f70 tx=0x7fb06c0074f0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.273+0000 7fb083a00640 1 -- 172.21.15.70:0/1665822248 shutdown_connections 2024-09-13T16:01:24.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.273+0000 7fb083a00640 1 --2- 172.21.15.70:0/1665822248 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb07c0cd0f0 0x7fb07c0cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.273+0000 7fb083a00640 1 --2- 172.21.15.70:0/1665822248 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb05806ac00 0x7fb05806d0c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.274+0000 7fb083a00640 1 --2- 172.21.15.70:0/1665822248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb07c155470 0x7fb07c156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.274+0000 7fb083a00640 1 --2- 172.21.15.70:0/1665822248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb060005180 0x7fb07c0adb70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.274+0000 7fb083a00640 1 -- 172.21.15.70:0/1665822248 >> 172.21.15.70:0/1665822248 conn(0x7fb07c0b0510 msgr2=0x7fb07c06bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:24.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.274+0000 7fb083a00640 1 -- 172.21.15.70:0/1665822248 shutdown_connections 2024-09-13T16:01:24.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.274+0000 7fb083a00640 1 -- 172.21.15.70:0/1665822248 wait complete. 2024-09-13T16:01:24.292 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T16:01:24.292 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T16:01:24.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T16:01:24.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T16:01:24.294 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T16:01:24.294 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T16:01:24.295 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T16:01:24.295 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T16:01:24.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.560+0000 7f28dda00640 1 Processor -- start 2024-09-13T16:01:24.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.560+0000 7f28dda00640 1 -- start start 2024-09-13T16:01:24.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.562+0000 7f28dda00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f28d80adea0 0x7f28d806f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.562+0000 7f28dda00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d80b1810 con 0x7f28d806fec0 2024-09-13T16:01:24.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.562+0000 7f28dda00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d80b2670 con 0x7f28d80ce2c0 2024-09-13T16:01:24.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.562+0000 7f28dda00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d806fa60 con 0x7f28d80adea0 2024-09-13T16:01:24.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.563+0000 7f28d7400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f28d806fec0 0x7f28d80b2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39082/0 (socket says 172.21.15.70:39082) 2024-09-13T16:01:24.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.563+0000 7f28d7400640 1 -- 172.21.15.70:0/2375989818 learned_addr learned my addr 172.21.15.70:0/2375989818 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:24.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.563+0000 7f27a3200640 1 Processor -- start 2024-09-13T16:01:24.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.564+0000 7f27a3200640 1 -- start start 2024-09-13T16:01:24.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.564+0000 7f28d5600640 1 -- 172.21.15.70:0/2375989818 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804852341 0 0) 0x7f28d80b2670 con 0x7f28d80ce2c0 2024-09-13T16:01:24.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.564+0000 7f28d5600640 1 -- 172.21.15.70:0/2375989818 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28bc003520 con 0x7f28d80ce2c0 2024-09-13T16:01:24.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.563+0000 7f28d6a00640 1 --2- 172.21.15.70:0/2375989818 >> v2:172.21.15.70:3300/0 conn(0x7f28d80adea0 0x7f28d806f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.565+0000 7f12a1000640 1 Processor -- start 2024-09-13T16:01:24.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.565+0000 7f12a1000640 1 -- start start 2024-09-13T16:01:24.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.565+0000 7f28d5600640 1 -- 172.21.15.70:0/2375989818 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1473247176 0 0) 0x7f28bc003520 con 0x7f28d80ce2c0 2024-09-13T16:01:24.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.565+0000 7f28d5600640 1 -- 172.21.15.70:0/2375989818 >> v2:172.21.15.70:3300/0 conn(0x7f28d80adea0 msgr2=0x7f28d806f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:24.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.565+0000 7f28d5600640 1 --2- 172.21.15.70:0/2375989818 >> v2:172.21.15.70:3300/0 conn(0x7f28d80adea0 0x7f28d806f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.565+0000 7f28d5600640 1 -- 172.21.15.70:0/2375989818 >> v1:172.21.15.70:6789/0 conn(0x7f28d806fec0 legacy=0x7f28d80b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.565+0000 7f28d5600640 1 -- 172.21.15.70:0/2375989818 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d80ae280 con 0x7f28d80ce2c0 2024-09-13T16:01:24.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.565+0000 7f28d5600640 1 -- 172.21.15.70:0/2375989818 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f28c4001670 con 0x7f28d80ce2c0 2024-09-13T16:01:24.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.565+0000 7f28d5600640 1 -- 172.21.15.70:0/2375989818 >> v1:172.21.15.107:6789/0 conn(0x7f28d80ce2c0 legacy=0x7f28d80cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.565+0000 7f28d5600640 1 --2- 172.21.15.70:0/2375989818 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28bc003970 0x7f28bc003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.565+0000 7f28d5600640 1 --2- 172.21.15.70:0/2375989818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28bc004370 0x7f28bc004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.565+0000 7f28d5600640 1 --2- 172.21.15.70:0/2375989818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28bc005040 0x7f28bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.565+0000 7f28d5600640 1 -- 172.21.15.70:0/2375989818 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d806fa60 con 0x7f28bc004370 2024-09-13T16:01:24.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.565+0000 7f28d5600640 1 -- 172.21.15.70:0/2375989818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc00bfa0 con 0x7f28bc005040 2024-09-13T16:01:24.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.565+0000 7f28d5600640 1 -- 172.21.15.70:0/2375989818 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc00c160 con 0x7f28bc003970 2024-09-13T16:01:24.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.567+0000 7f12a1000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1294055180 0x7f12940ea870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.567+0000 7f12a1000640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12940067f0 con 0x7f1294054c80 2024-09-13T16:01:24.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.567+0000 7f12a1000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1294039600 con 0x7f129400a4c0 2024-09-13T16:01:24.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.567+0000 7f12a1000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12940398e0 con 0x7f1294055180 2024-09-13T16:01:24.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.568+0000 7f129b400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f129400a4c0 0x7f12940059d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:48496/0 (socket says 172.21.15.70:48496) 2024-09-13T16:01:24.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.568+0000 7f129b400640 1 -- 172.21.15.70:0/1504526218 learned_addr learned my addr 172.21.15.70:0/1504526218 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:24.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.566+0000 7f28d6000640 1 --2- 172.21.15.70:0/2375989818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28bc004370 0x7f28bc004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.566+0000 7f28d7400640 1 --2- 172.21.15.70:0/2375989818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28bc005040 0x7f28bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.567+0000 7f28d6a00640 1 --2- 172.21.15.70:0/2375989818 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28bc003970 0x7f28bc003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.569+0000 7f129be00640 1 --2- 172.21.15.70:0/1504526218 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1294055180 0x7f12940ea870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.568+0000 7f27a3200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27a4157db0 0x7f27a40cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.568+0000 7f27a3200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f27a40b39b0 0x7f27a40b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.569+0000 7f27a3200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a40cc190 con 0x7f27a415deb0 2024-09-13T16:01:24.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.569+0000 7f27a1400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f27a415deb0 0x7f27a406fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:48508/0 (socket says 172.21.15.70:48508) 2024-09-13T16:01:24.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.569+0000 7f27a1400640 1 -- 172.21.15.70:0/2200001545 learned_addr learned my addr 172.21.15.70:0/2200001545 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:24.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.569+0000 7f27a3200640 1 -- 172.21.15.70:0/2200001545 --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a406f7e0 con 0x7f27a40b39b0 2024-09-13T16:01:24.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.569+0000 7f27a3200640 1 -- 172.21.15.70:0/2200001545 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a40b4360 con 0x7f27a4157db0 2024-09-13T16:01:24.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.569+0000 7f27a0a00640 1 -- 172.21.15.70:0/2200001545 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029323309 0 0) 0x7f27a40cc190 con 0x7f27a415deb0 2024-09-13T16:01:24.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.569+0000 7f27a0a00640 1 -- 172.21.15.70:0/2200001545 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2788003520 con 0x7f27a415deb0 2024-09-13T16:01:24.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.569+0000 7f27a1e00640 1 --2- 172.21.15.70:0/2200001545 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27a4157db0 0x7f27a40cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.570+0000 7f129be00640 1 -- 172.21.15.70:0/1504526218 >> v1:172.21.15.107:6789/0 conn(0x7f129400a4c0 legacy=0x7f12940059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.570+0000 7f27a0a00640 1 -- 172.21.15.70:0/2200001545 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3566401515 0 0) 0x7f2788003520 con 0x7f27a415deb0 2024-09-13T16:01:24.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.570+0000 7f27a0a00640 1 -- 172.21.15.70:0/2200001545 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27a4157db0 msgr2=0x7f27a40cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:24.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.570+0000 7f27a0a00640 1 --2- 172.21.15.70:0/2200001545 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27a4157db0 0x7f27a40cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.570+0000 7f27a0a00640 1 -- 172.21.15.70:0/2200001545 >> v2:172.21.15.70:3300/0 conn(0x7f27a40b39b0 msgr2=0x7f27a40b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:24.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.570+0000 7f27a0a00640 1 --2- 172.21.15.70:0/2200001545 >> v2:172.21.15.70:3300/0 conn(0x7f27a40b39b0 0x7f27a40b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.570+0000 7f27a0a00640 1 -- 172.21.15.70:0/2200001545 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a4070390 con 0x7f27a415deb0 2024-09-13T16:01:24.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.570+0000 7f27a0a00640 1 -- 172.21.15.70:0/2200001545 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f2790001690 con 0x7f27a415deb0 2024-09-13T16:01:24.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.570+0000 7f27a0a00640 1 -- 172.21.15.70:0/2200001545 >> v1:172.21.15.107:6789/0 conn(0x7f27a415deb0 legacy=0x7f27a406fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.570+0000 7f27a0a00640 1 --2- 172.21.15.70:0/2200001545 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27880039a0 0x7f2788003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.570+0000 7f27a0a00640 1 --2- 172.21.15.70:0/2200001545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27880047c0 0x7f2788004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.570+0000 7f27a0a00640 1 --2- 172.21.15.70:0/2200001545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2788005180 0x7f278800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.570+0000 7f27a0a00640 1 -- 172.21.15.70:0/2200001545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a406f7e0 con 0x7f27880047c0 2024-09-13T16:01:24.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.570+0000 7f27a0a00640 1 -- 172.21.15.70:0/2200001545 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a40b4360 con 0x7f2788005180 2024-09-13T16:01:24.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.570+0000 7f27a0a00640 1 -- 172.21.15.70:0/2200001545 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278800c0d0 con 0x7f27880039a0 2024-09-13T16:01:24.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.570+0000 7f129be00640 1 -- 172.21.15.70:0/1504526218 >> v1:172.21.15.70:6789/0 conn(0x7f1294054c80 legacy=0x7f12940060e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:24.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.571+0000 7f27a1e00640 1 --2- 172.21.15.70:0/2200001545 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27880039a0 0x7f2788003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.569+0000 7f28d6000640 1 -- 172.21.15.70:0/2375989818 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28bc003970 msgr2=0x7f28bc003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:24.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.569+0000 7f28d6000640 1 --2- 172.21.15.70:0/2375989818 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28bc003970 0x7f28bc003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.569+0000 7f28d6000640 1 -- 172.21.15.70:0/2375989818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28bc005040 msgr2=0x7f28bc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:24.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.569+0000 7f28d6000640 1 --2- 172.21.15.70:0/2375989818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28bc005040 0x7f28bc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.569+0000 7f28d6000640 1 -- 172.21.15.70:0/2375989818 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d80ae280 con 0x7f28bc004370 2024-09-13T16:01:24.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.571+0000 7f27a2800640 1 --2- 172.21.15.70:0/2200001545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2788005180 0x7f278800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.571+0000 7f129be00640 1 -- 172.21.15.70:0/1504526218 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1294039bc0 con 0x7f1294055180 2024-09-13T16:01:24.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.571+0000 7f0cbde00640 1 Processor -- start 2024-09-13T16:01:24.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.571+0000 7f27a1e00640 1 -- 172.21.15.70:0/2200001545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2788005180 msgr2=0x7f278800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:24.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.571+0000 7f27a1e00640 1 --2- 172.21.15.70:0/2200001545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2788005180 0x7f278800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.571+0000 7f27a1e00640 1 -- 172.21.15.70:0/2200001545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27880047c0 msgr2=0x7f2788004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:24.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.571+0000 7f27a1e00640 1 --2- 172.21.15.70:0/2200001545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27880047c0 0x7f2788004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.571+0000 7f27a1e00640 1 -- 172.21.15.70:0/2200001545 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a4070390 con 0x7f27880039a0 2024-09-13T16:01:24.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.571+0000 7f0cbde00640 1 -- start start 2024-09-13T16:01:24.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.572+0000 7f28d7400640 1 --2- 172.21.15.70:0/2375989818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28bc005040 0x7f28bc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:24.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.572+0000 7f28d7400640 1 -- 172.21.15.70:0/2375989818 reap_dead start 2024-09-13T16:01:24.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.572+0000 7f28d6000640 1 --2- 172.21.15.70:0/2375989818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28bc004370 0x7f28bc004840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f28c400c0e0 tx=0x7f28bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d6de42d9da9a86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.573+0000 7f129be00640 1 --2- 172.21.15.70:0/1504526218 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1294055180 0x7f12940ea870 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1288009750 tx=0x7f128802a010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33a15998fd7de97c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.573+0000 7f129a000640 1 -- 172.21.15.70:0/1504526218 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128802ad20 con 0x7f1294055180 2024-09-13T16:01:24.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.573+0000 7f28d5600640 1 -- 172.21.15.70:0/2375989818 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4031600 con 0x7f28bc004370 2024-09-13T16:01:24.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.573+0000 7f28d5600640 1 -- 172.21.15.70:0/2375989818 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c402d050 con 0x7f28bc004370 2024-09-13T16:01:24.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.573+0000 7f28d5600640 1 -- 172.21.15.70:0/2375989818 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c40319c0 con 0x7f28bc004370 2024-09-13T16:01:24.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.573+0000 7f27a1e00640 1 --2- 172.21.15.70:0/2200001545 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27880039a0 0x7f2788003dc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f279400b900 tx=0x7f27880057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b76ed9e33f8d2f9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.574+0000 7f0cbde00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cb80d0430 0x7f0cb80b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.573+0000 7f129a000640 1 -- 172.21.15.70:0/1504526218 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128802ae80 con 0x7f1294055180 2024-09-13T16:01:24.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.573+0000 7f129a000640 1 -- 172.21.15.70:0/1504526218 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128802ad20 con 0x7f1294055180 2024-09-13T16:01:24.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.574+0000 7fbae3400640 1 Processor -- start 2024-09-13T16:01:24.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.574+0000 7f0cb6000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cb80d0430 0x7f0cb80b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.574+0000 7f0cb6a00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f0cb815c830 0x7f0cb80d1ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39096/0 (socket says 172.21.15.70:39096) 2024-09-13T16:01:24.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.574+0000 7f0cb6a00640 1 -- 172.21.15.70:0/205680298 learned_addr learned my addr 172.21.15.70:0/205680298 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:24.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.574+0000 7f0cbde00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb80d2480 con 0x7f0cb815c830 2024-09-13T16:01:24.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.574+0000 7f0cbde00640 1 -- 172.21.15.70:0/205680298 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb80b6010 con 0x7f0cb80b7310 2024-09-13T16:01:24.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.574+0000 7f0cbde00640 1 -- 172.21.15.70:0/205680298 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb80b62f0 con 0x7f0cb80d0430 2024-09-13T16:01:24.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.574+0000 7fbae3400640 1 -- start start 2024-09-13T16:01:24.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.575+0000 7f12a1000640 1 -- 172.21.15.70:0/1504526218 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1294055180 msgr2=0x7f12940ea870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.575+0000 7f12a1000640 1 --2- 172.21.15.70:0/1504526218 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1294055180 0x7f12940ea870 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1288009750 tx=0x7f128802a010 comp rx=0 tx=0).stop 2024-09-13T16:01:24.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.575+0000 7f27a0a00640 1 -- 172.21.15.70:0/2200001545 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279402acd0 con 0x7f27880039a0 2024-09-13T16:01:24.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.575+0000 7f0cb6000640 1 -- 172.21.15.70:0/205680298 >> v1:172.21.15.107:6789/0 conn(0x7f0cb80b7310 legacy=0x7f0cb806bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.575+0000 7f0cb6000640 1 -- 172.21.15.70:0/205680298 >> v1:172.21.15.70:6789/0 conn(0x7f0cb815c830 legacy=0x7f0cb80d1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.575+0000 7f0cb5600640 1 -- 172.21.15.70:0/205680298 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144645439 0 0) 0x7f0cb80d2480 con 0x7f0cb815c830 2024-09-13T16:01:24.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.575+0000 7f12a1000640 1 -- 172.21.15.70:0/1504526218 shutdown_connections 2024-09-13T16:01:24.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.575+0000 7f12a1000640 1 --2- 172.21.15.70:0/1504526218 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1294055180 0x7f12940ea870 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.575+0000 7f12a1000640 1 -- 172.21.15.70:0/1504526218 >> 172.21.15.70:0/1504526218 conn(0x7f129401d900 msgr2=0x7f1294054570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:24.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.575+0000 7f12a1000640 1 -- 172.21.15.70:0/1504526218 shutdown_connections 2024-09-13T16:01:24.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.575+0000 7f28dda00640 1 -- 172.21.15.70:0/2375989818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28bc004370 msgr2=0x7f28bc004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.575+0000 7f28dda00640 1 --2- 172.21.15.70:0/2375989818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28bc004370 0x7f28bc004840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f28c400c0e0 tx=0x7f28bc0057f0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.575+0000 7f12a1000640 1 -- 172.21.15.70:0/1504526218 wait complete. 2024-09-13T16:01:24.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.575+0000 7f0cb6000640 1 -- 172.21.15.70:0/205680298 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb80b65d0 con 0x7f0cb80d0430 2024-09-13T16:01:24.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.576+0000 7f28dda00640 1 -- 172.21.15.70:0/2375989818 shutdown_connections 2024-09-13T16:01:24.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.576+0000 7f28dda00640 1 --2- 172.21.15.70:0/2375989818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28bc004370 0x7f28bc004840 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.576+0000 7f28dda00640 1 -- 172.21.15.70:0/2375989818 >> 172.21.15.70:0/2375989818 conn(0x7f28d8069ed0 msgr2=0x7f28d806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:24.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.576+0000 7f28dda00640 1 -- 172.21.15.70:0/2375989818 shutdown_connections 2024-09-13T16:01:24.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.576+0000 7fbae3400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbadc06cb60 0x7fbadc161100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.576+0000 7fbae3400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbadc06f440 0x7fbadc15ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.576+0000 7fbae3400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbadc162350 con 0x7fbadc0add30 2024-09-13T16:01:24.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.576+0000 7fbae3400640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbadc0ce200 con 0x7fbadc06f440 2024-09-13T16:01:24.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.576+0000 7fbae3400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc06f8d0 con 0x7fbadc06cb60 2024-09-13T16:01:24.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.577+0000 7fbae1400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbadc06f440 0x7fbadc15ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.577+0000 7fbae1400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbadc06f440 0x7fbadc15ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35850/0 (socket says 172.21.15.70:35850) 2024-09-13T16:01:24.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.577+0000 7fbae1400640 1 -- 172.21.15.70:0/4005450881 learned_addr learned my addr 172.21.15.70:0/4005450881 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:24.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.577+0000 7f0cb6000640 1 --2- 172.21.15.70:0/205680298 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cb80d0430 0x7f0cb80b6dd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00097d0 tx=0x7f0cb002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c6d24db316bb81 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.577+0000 7f12a1000640 1 Processor -- start 2024-09-13T16:01:24.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.577+0000 7f0cb5600640 1 -- 172.21.15.70:0/205680298 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0032440 con 0x7f0cb80d0430 2024-09-13T16:01:24.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.577+0000 7f0cb5600640 1 -- 172.21.15.70:0/205680298 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb00325a0 con 0x7f0cb80d0430 2024-09-13T16:01:24.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.577+0000 7f0cb5600640 1 -- 172.21.15.70:0/205680298 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0032930 con 0x7f0cb80d0430 2024-09-13T16:01:24.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.577+0000 7fbae1400640 1 -- 172.21.15.70:0/4005450881 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbadc06cb60 msgr2=0x7fbadc161100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:01:24.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.577+0000 7fbae1400640 1 --2- 172.21.15.70:0/4005450881 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbadc06cb60 0x7fbadc161100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.577+0000 7fbae1400640 1 -- 172.21.15.70:0/4005450881 >> v1:172.21.15.107:6789/0 conn(0x7fbadc0add30 legacy=0x7fbadc06c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.577+0000 7fbae1400640 1 -- 172.21.15.70:0/4005450881 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbadc161740 con 0x7fbadc06f440 2024-09-13T16:01:24.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.578+0000 7f12a1000640 1 -- start start 2024-09-13T16:01:24.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.577+0000 7f28dda00640 1 -- 172.21.15.70:0/2375989818 wait complete. 2024-09-13T16:01:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.575+0000 7f27a0a00640 1 -- 172.21.15.70:0/2200001545 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279402e070 con 0x7f27880039a0 2024-09-13T16:01:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.575+0000 7f27a0a00640 1 -- 172.21.15.70:0/2200001545 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794034620 con 0x7f27880039a0 2024-09-13T16:01:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.576+0000 7f27a3200640 1 -- 172.21.15.70:0/2200001545 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27880039a0 msgr2=0x7f2788003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.576+0000 7f27a3200640 1 --2- 172.21.15.70:0/2200001545 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27880039a0 0x7f2788003dc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f279400b900 tx=0x7f27880057f0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.576+0000 7f27a2800640 1 -- 172.21.15.70:0/2200001545 reap_dead start 2024-09-13T16:01:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.578+0000 7f27a3200640 1 -- 172.21.15.70:0/2200001545 shutdown_connections 2024-09-13T16:01:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.578+0000 7f0cbde00640 1 -- 172.21.15.70:0/205680298 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cb80d0430 msgr2=0x7f0cb80b6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.578+0000 7f0cbde00640 1 --2- 172.21.15.70:0/205680298 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cb80d0430 0x7f0cb80b6dd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00097d0 tx=0x7f0cb002a210 comp rx=0 tx=0).stop 2024-09-13T16:01:24.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.578+0000 7f27a3200640 1 -- 172.21.15.70:0/2200001545 >> 172.21.15.70:0/2200001545 conn(0x7f27a40b03a0 msgr2=0x7f27a40b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:24.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.579+0000 7f27a3200640 1 -- 172.21.15.70:0/2200001545 shutdown_connections 2024-09-13T16:01:24.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.579+0000 7f0cbde00640 1 -- 172.21.15.70:0/205680298 shutdown_connections 2024-09-13T16:01:24.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.579+0000 7f0cbde00640 1 --2- 172.21.15.70:0/205680298 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cb80d0430 0x7f0cb80b6dd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.579+0000 7f0cbde00640 1 -- 172.21.15.70:0/205680298 >> 172.21.15.70:0/205680298 conn(0x7f0cb80b4720 msgr2=0x7f0cb80b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:24.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.579+0000 7f865be00640 1 Processor -- start 2024-09-13T16:01:24.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.579+0000 7fbae1400640 1 --2- 172.21.15.70:0/4005450881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbadc06f440 0x7fbadc15ddd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbad4009870 tx=0x7fbad402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08435ff0ddbca8d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.579+0000 7f0cbde00640 1 -- 172.21.15.70:0/205680298 shutdown_connections 2024-09-13T16:01:24.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.579+0000 7f0cbde00640 1 -- 172.21.15.70:0/205680298 wait complete. 2024-09-13T16:01:24.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.580+0000 7f12a1000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1294054c80 0x7f129404d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.579+0000 7f865be00640 1 -- start start 2024-09-13T16:01:24.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.580+0000 7f12a1000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1294055180 0x7f12940dc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.580+0000 7f12a1000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1294005770 0x7f129401eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.580+0000 7f12a1000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129404dd80 con 0x7f1294054c80 2024-09-13T16:01:24.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.580+0000 7f12a1000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129404e060 con 0x7f1294005770 2024-09-13T16:01:24.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.580+0000 7f12a1000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129404e340 con 0x7f1294055180 2024-09-13T16:01:24.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.581+0000 7f129be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1294005770 0x7f129401eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.581+0000 7f129be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1294005770 0x7f129401eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.70:59444/0 (socket says 172.21.15.70:59444) 2024-09-13T16:01:24.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.581+0000 7f129be00640 1 -- 172.21.15.70:0/363210067 learned_addr learned my addr 172.21.15.70:0/363210067 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:24.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.581+0000 7f129aa00640 1 --2- 172.21.15.70:0/363210067 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1294055180 0x7f12940dc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.581+0000 7f129b400640 1 --2- 172.21.15.70:0/363210067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1294054c80 0x7f129404d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.579+0000 7f27a3200640 1 -- 172.21.15.70:0/2200001545 wait complete. 2024-09-13T16:01:24.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.581+0000 7f27a3200640 1 Processor -- start 2024-09-13T16:01:24.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.581+0000 7f129be00640 1 -- 172.21.15.70:0/363210067 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1294055180 msgr2=0x7f12940dc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.581+0000 7f129be00640 1 --2- 172.21.15.70:0/363210067 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1294055180 0x7f12940dc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.581+0000 7f27a3200640 1 -- start start 2024-09-13T16:01:24.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.581+0000 7f129be00640 1 -- 172.21.15.70:0/363210067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1294054c80 msgr2=0x7f129404d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.581+0000 7f129be00640 1 --2- 172.21.15.70:0/363210067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1294054c80 0x7f129404d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.581+0000 7f129be00640 1 -- 172.21.15.70:0/363210067 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1288009400 con 0x7f1294005770 2024-09-13T16:01:24.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.581+0000 7f28dda00640 1 Processor -- start 2024-09-13T16:01:24.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.582+0000 7f28dda00640 1 -- start start 2024-09-13T16:01:24.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.582+0000 7f865be00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f865c143ec0 0x7f865c0b5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.582+0000 7f0cbde00640 1 Processor -- start 2024-09-13T16:01:24.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.582+0000 7f0cbde00640 1 -- start start 2024-09-13T16:01:24.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.582+0000 7f865be00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f865c071950 0x7f865c15e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.582+0000 7f865be00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865c1442a0 con 0x7f865c071510 2024-09-13T16:01:24.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.582+0000 7f865be00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865c15b8b0 con 0x7f865c143ec0 2024-09-13T16:01:24.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.582+0000 7f865be00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865c15a970 con 0x7f865c071950 2024-09-13T16:01:24.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.582+0000 7fbadb400640 1 -- 172.21.15.70:0/4005450881 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4032440 con 0x7fbadc06f440 2024-09-13T16:01:24.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.582+0000 7fbadb400640 1 -- 172.21.15.70:0/4005450881 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad40325a0 con 0x7fbadc06f440 2024-09-13T16:01:24.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.582+0000 7fbadb400640 1 -- 172.21.15.70:0/4005450881 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4032930 con 0x7fbadc06f440 2024-09-13T16:01:24.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.583+0000 7f865aa00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f865c143ec0 0x7f865c0b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.583+0000 7f129be00640 1 --2- 172.21.15.70:0/363210067 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1294005770 0x7f129401eaa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1288009870 tx=0x7f12880046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.583+0000 7f865b400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f865c071950 0x7f865c15e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.583+0000 7f865aa00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f865c143ec0 0x7f865c0b5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35858/0 (socket says 172.21.15.70:35858) 2024-09-13T16:01:24.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.583+0000 7f865aa00640 1 -- 172.21.15.70:0/131490247 learned_addr learned my addr 172.21.15.70:0/131490247 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:24.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.583+0000 7f128f400640 1 -- 172.21.15.70:0/363210067 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288004480 con 0x7f1294005770 2024-09-13T16:01:24.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.583+0000 7f128f400640 1 -- 172.21.15.70:0/363210067 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1288032440 con 0x7f1294005770 2024-09-13T16:01:24.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.583+0000 7f128f400640 1 -- 172.21.15.70:0/363210067 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12880327f0 con 0x7f1294005770 2024-09-13T16:01:24.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.583+0000 7f0cbde00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cb80b7310 0x7f0cb8155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.583+0000 7f0cbde00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cb80d0430 0x7f0cb81431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.583+0000 7f0cbde00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cb815c830 0x7f0cb806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.583+0000 7f0cbde00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb8143700 con 0x7f0cb815c830 2024-09-13T16:01:24.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.583+0000 7f27a3200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27880039a0 0x7f27a415bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.583+0000 7f0cbde00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb8070150 con 0x7f0cb80d0430 2024-09-13T16:01:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.583+0000 7f0cbde00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb8154100 con 0x7f0cb80b7310 2024-09-13T16:01:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7f27a3200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27a4145250 0x7f27a4146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7f27a3200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27a415ae10 0x7f27a414e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7f27a3200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a415c6a0 con 0x7f27a415ae10 2024-09-13T16:01:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7f27a3200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a40adf80 con 0x7f27a4145250 2024-09-13T16:01:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7f27a3200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a415c3c0 con 0x7f27880039a0 2024-09-13T16:01:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7f865b400640 1 -- 172.21.15.70:0/131490247 >> v2:172.21.15.70:3300/0 conn(0x7f865c143ec0 msgr2=0x7f865c0b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7f865b400640 1 --2- 172.21.15.70:0/131490247 >> v2:172.21.15.70:3300/0 conn(0x7f865c143ec0 0x7f865c0b5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7f865b400640 1 -- 172.21.15.70:0/131490247 >> v1:172.21.15.70:6789/0 conn(0x7f865c071510 legacy=0x7f865c15df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7f865b400640 1 -- 172.21.15.70:0/131490247 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c15ac30 con 0x7f865c071950 2024-09-13T16:01:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7fbae3400640 1 -- 172.21.15.70:0/4005450881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbadc06f440 msgr2=0x7fbadc15ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7fbae3400640 1 --2- 172.21.15.70:0/4005450881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbadc06f440 0x7fbadc15ddd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbad4009870 tx=0x7fbad402a270 comp rx=0 tx=0).stop 2024-09-13T16:01:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7fbae3400640 1 -- 172.21.15.70:0/4005450881 shutdown_connections 2024-09-13T16:01:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7fbae3400640 1 --2- 172.21.15.70:0/4005450881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbadc06f440 0x7fbadc15ddd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7fbae3400640 1 --2- 172.21.15.70:0/4005450881 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbadc06cb60 0x7fbadc161100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7fbae3400640 1 -- 172.21.15.70:0/4005450881 >> 172.21.15.70:0/4005450881 conn(0x7fbadc0b0200 msgr2=0x7fbadc0b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7f0cb6000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cb80d0430 0x7f0cb81431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7f0cb7400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cb815c830 0x7f0cb806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7f0cb6000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cb80d0430 0x7f0cb81431c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.70:59460/0 (socket says 172.21.15.70:59460) 2024-09-13T16:01:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.584+0000 7f0cb6000640 1 -- 172.21.15.70:0/2183113117 learned_addr learned my addr 172.21.15.70:0/2183113117 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:24.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.585+0000 7fbae3400640 1 -- 172.21.15.70:0/4005450881 shutdown_connections 2024-09-13T16:01:24.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.585+0000 7fbae3400640 1 -- 172.21.15.70:0/4005450881 wait complete. 2024-09-13T16:01:24.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.585+0000 7f262e400640 1 Processor -- start 2024-09-13T16:01:24.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.585+0000 7f28dda00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28bc004370 0x7f28d8162b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.585+0000 7f28dda00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28d81f6b70 0x7f28d8164680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.585+0000 7f28dda00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28d8155640 0x7f28d8155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.585+0000 7f262e400640 1 -- start start 2024-09-13T16:01:24.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.586+0000 7f12a1000640 1 -- 172.21.15.70:0/363210067 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1294048010 con 0x7f1294005770 2024-09-13T16:01:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.586+0000 7f28dda00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d8155fe0 con 0x7f28d8155640 2024-09-13T16:01:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.586+0000 7f28dda00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d81f6ff0 con 0x7f28d81f6b70 2024-09-13T16:01:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.586+0000 7f28dda00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d8156610 con 0x7f28bc004370 2024-09-13T16:01:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.586+0000 7f28d6000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28d81f6b70 0x7f28d8164680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.586+0000 7f28d6a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28bc004370 0x7f28d8162b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.586+0000 7f28d6000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28d81f6b70 0x7f28d8164680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.70:59484/0 (socket says 172.21.15.70:59484) 2024-09-13T16:01:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.586+0000 7f28d6000640 1 -- 172.21.15.70:0/1793297121 learned_addr learned my addr 172.21.15.70:0/1793297121 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.586+0000 7f28d6a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28bc004370 0x7f28d8162b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:51110/0 (socket says 172.21.15.70:51110) 2024-09-13T16:01:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.585+0000 7f0cb6a00640 1 --2- 172.21.15.70:0/2183113117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cb80b7310 0x7f0cb8155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.586+0000 7f0cb7400640 1 -- 172.21.15.70:0/2183113117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cb80b7310 msgr2=0x7f0cb8155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.586+0000 7f0cb7400640 1 --2- 172.21.15.70:0/2183113117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0cb80b7310 0x7f0cb8155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.586+0000 7f0cb7400640 1 -- 172.21.15.70:0/2183113117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cb80d0430 msgr2=0x7f0cb81431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.586+0000 7f0cb7400640 1 --2- 172.21.15.70:0/2183113117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cb80d0430 0x7f0cb81431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.586+0000 7f0cb7400640 1 -- 172.21.15.70:0/2183113117 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb0009400 con 0x7f0cb815c830 2024-09-13T16:01:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.585+0000 7f27a1e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27880039a0 0x7f27a415bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.585+0000 7f27a1400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27a4145250 0x7f27a4146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.586+0000 7f27a2800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27a415ae10 0x7f27a414e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.586+0000 7f28d7400640 1 --2- 172.21.15.70:0/1793297121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28d8155640 0x7f28d8155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.586+0000 7f27a2800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27a415ae10 0x7f27a414e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35876/0 (socket says 172.21.15.70:35876) 2024-09-13T16:01:24.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.586+0000 7f27a2800640 1 -- 172.21.15.70:0/2090387993 learned_addr learned my addr 172.21.15.70:0/2090387993 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f262e400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f262815c720 0x7f26280d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f262e400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f26280cde70 0x7f26280d2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f262e400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26280d3330 con 0x7f262815cb00 2024-09-13T16:01:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f262e400640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26280cece0 con 0x7f26280cde70 2024-09-13T16:01:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f262e400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26280b1cf0 con 0x7f262815c720 2024-09-13T16:01:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f28d6000640 1 -- 172.21.15.70:0/1793297121 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28bc004370 msgr2=0x7f28d8162b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f28d6000640 1 --2- 172.21.15.70:0/1793297121 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28bc004370 0x7f28d8162b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f28d6000640 1 -- 172.21.15.70:0/1793297121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28d8155640 msgr2=0x7f28d8155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7fbae3400640 1 Processor -- start 2024-09-13T16:01:24.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f28d6000640 1 --2- 172.21.15.70:0/1793297121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28d8155640 0x7f28d8155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f28d6000640 1 -- 172.21.15.70:0/1793297121 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d81568f0 con 0x7f28d81f6b70 2024-09-13T16:01:24.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f12a1000640 1 -- 172.21.15.70:0/363210067 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12940dcd10 con 0x7f1294005770 2024-09-13T16:01:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f27a1e00640 1 -- 172.21.15.70:0/2090387993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27a4145250 msgr2=0x7f27a4146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f27a1e00640 1 --2- 172.21.15.70:0/2090387993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27a4145250 0x7f27a4146e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f27a1e00640 1 -- 172.21.15.70:0/2090387993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27a415ae10 msgr2=0x7f27a414e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f27a1e00640 1 --2- 172.21.15.70:0/2090387993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27a415ae10 0x7f27a414e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f27a1e00640 1 -- 172.21.15.70:0/2090387993 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a40ae220 con 0x7f27880039a0 2024-09-13T16:01:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f27a1e00640 1 --2- 172.21.15.70:0/2090387993 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27880039a0 0x7f27a415bcd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f278800c260 tx=0x7f2794004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7fbae3400640 1 -- start start 2024-09-13T16:01:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f2627e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f26280cde70 0x7f26280d2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f2627e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f26280cde70 0x7f26280d2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35888/0 (socket says 172.21.15.70:35888) 2024-09-13T16:01:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f2627e00640 1 -- 172.21.15.70:0/248284015 learned_addr learned my addr 172.21.15.70:0/248284015 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f2627400640 1 --2- 172.21.15.70:0/248284015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f262815c720 0x7f26280d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.588+0000 7f279a000640 1 -- 172.21.15.70:0/2090387993 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279403f470 con 0x7f27880039a0 2024-09-13T16:01:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.588+0000 7f279a000640 1 -- 172.21.15.70:0/2090387993 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279403f5f0 con 0x7f27880039a0 2024-09-13T16:01:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.588+0000 7f279a000640 1 -- 172.21.15.70:0/2090387993 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279403f9a0 con 0x7f27880039a0 2024-09-13T16:01:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.588+0000 7f27a3200640 1 -- 172.21.15.70:0/2090387993 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a40ae500 con 0x7f27880039a0 2024-09-13T16:01:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.588+0000 7f27a3200640 1 -- 172.21.15.70:0/2090387993 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a4147370 con 0x7f27880039a0 2024-09-13T16:01:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.588+0000 7f0cb7400640 1 --2- 172.21.15.70:0/2183113117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cb815c830 0x7f0cb806d380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80b76f0 tx=0x7f0ca800cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.589+0000 7fbae3400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbadc06cb60 0x7fbadc15a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.589+0000 7fbae3400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbadc06f440 0x7fbadc1582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.589+0000 7fbae3400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbadc0add30 0x7fbadc14b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.589+0000 7fbae3400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc1490d0 con 0x7fbadc06f440 2024-09-13T16:01:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.589+0000 7fbae3400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc149690 con 0x7fbadc06cb60 2024-09-13T16:01:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.589+0000 7fbae3400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc149970 con 0x7fbadc0add30 2024-09-13T16:01:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f865b400640 1 --2- 172.21.15.70:0/131490247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f865c071950 0x7f865c15e670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f865c0ce0f0 tx=0x7f864c02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d0d5561388bf223 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.587+0000 7f8659600640 1 -- 172.21.15.70:0/131490247 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c02aea0 con 0x7f865c071950 2024-09-13T16:01:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.588+0000 7f8659600640 1 -- 172.21.15.70:0/131490247 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c02d050 con 0x7f865c071950 2024-09-13T16:01:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.588+0000 7f8659600640 1 -- 172.21.15.70:0/131490247 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c007960 con 0x7f865c071950 2024-09-13T16:01:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.589+0000 7fbae0a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbadc06cb60 0x7fbadc15a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.589+0000 7fbae0a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbadc06cb60 0x7fbadc15a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.70:59492/0 (socket says 172.21.15.70:59492) 2024-09-13T16:01:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.589+0000 7fbae0a00640 1 -- 172.21.15.70:0/445750448 learned_addr learned my addr 172.21.15.70:0/445750448 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.589+0000 7fbadbe00640 1 --2- 172.21.15.70:0/445750448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbadc06f440 0x7fbadc1582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.590+0000 7f27a3200640 1 -- 172.21.15.70:0/2090387993 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f27a415ea30 con 0x7f27880039a0 2024-09-13T16:01:24.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.590+0000 7fbae1400640 1 --2- 172.21.15.70:0/445750448 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbadc0add30 0x7fbadc14b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.590+0000 7fbae0a00640 1 -- 172.21.15.70:0/445750448 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbadc0add30 msgr2=0x7fbadc14b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.590+0000 7fbae0a00640 1 --2- 172.21.15.70:0/445750448 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbadc0add30 0x7fbadc14b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.590+0000 7fbae0a00640 1 -- 172.21.15.70:0/445750448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbadc06f440 msgr2=0x7fbadc1582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.590+0000 7fbae0a00640 1 --2- 172.21.15.70:0/445750448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbadc06f440 0x7fbadc1582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.590+0000 7fbae0a00640 1 -- 172.21.15.70:0/445750448 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad40094d0 con 0x7fbadc06cb60 2024-09-13T16:01:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.590+0000 7fbae1400640 1 --2- 172.21.15.70:0/445750448 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbadc0add30 0x7fbadc14b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.590+0000 7fbae0a00640 1 --2- 172.21.15.70:0/445750448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbadc06cb60 0x7fbadc15a2b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbad000c730 tx=0x7fbad000cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.589+0000 7f128cc00640 1 -- 172.21.15.70:0/363210067 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1270000fc0 con 0x7f1294005770 2024-09-13T16:01:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.590+0000 7f128f400640 1 -- 172.21.15.70:0/363210067 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1288032950 con 0x7f1294005770 2024-09-13T16:01:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.590+0000 7f865be00640 1 -- 172.21.15.70:0/131490247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f865c071950 msgr2=0x7f865c15e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7fbad8c00640 1 -- 172.21.15.70:0/445750448 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad0003b70 con 0x7fbadc06cb60 2024-09-13T16:01:24.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7fbad8c00640 1 -- 172.21.15.70:0/445750448 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad0003cf0 con 0x7fbadc06cb60 2024-09-13T16:01:24.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7fbad8c00640 1 -- 172.21.15.70:0/445750448 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad0003ea0 con 0x7fbadc06cb60 2024-09-13T16:01:24.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7fbae3400640 1 -- 172.21.15.70:0/445750448 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbadc149c50 con 0x7fbadc06cb60 2024-09-13T16:01:24.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7f0caf400640 1 -- 172.21.15.70:0/2183113117 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8003b70 con 0x7f0cb815c830 2024-09-13T16:01:24.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7f0caf400640 1 -- 172.21.15.70:0/2183113117 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca8003cd0 con 0x7f0cb815c830 2024-09-13T16:01:24.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7f0caf400640 1 -- 172.21.15.70:0/2183113117 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8005310 con 0x7f0cb815c830 2024-09-13T16:01:24.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7f865be00640 1 --2- 172.21.15.70:0/131490247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f865c071950 0x7f865c15e670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f865c0ce0f0 tx=0x7f864c02a680 comp rx=0 tx=0).stop 2024-09-13T16:01:24.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7f7b29a00640 1 Processor -- start 2024-09-13T16:01:24.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7f865be00640 1 -- 172.21.15.70:0/131490247 shutdown_connections 2024-09-13T16:01:24.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7f865be00640 1 --2- 172.21.15.70:0/131490247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f865c071950 0x7f865c15e670 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7f865be00640 1 --2- 172.21.15.70:0/131490247 >> v2:172.21.15.70:3300/0 conn(0x7f865c143ec0 0x7f865c0b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7f865be00640 1 -- 172.21.15.70:0/131490247 >> 172.21.15.70:0/131490247 conn(0x7f865c0b2250 msgr2=0x7f865c0b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:24.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7f128f400640 1 --2- 172.21.15.70:0/363210067 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f127c06acd0 0x7f127c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7f128f400640 1 -- 172.21.15.70:0/363210067 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12880a9f30 con 0x7f1294005770 2024-09-13T16:01:24.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7f128f400640 1 --2- 172.21.15.70:0/363210067 >> [v2:172.21.15.70:6821/1697557929,v1:172.21.15.70:6823/1697557929] conn(0x7f127c072ef0 0x7f127c075310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7f128f400640 1 -- 172.21.15.70:0/363210067 --> [v2:172.21.15.70:6821/1697557929,v1:172.21.15.70:6823/1697557929] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f127c0759c0 con 0x7f127c072ef0 2024-09-13T16:01:24.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7f128f400640 1 -- 172.21.15.70:0/363210067 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12880ac550 con 0x7f1294005770 2024-09-13T16:01:24.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.592+0000 7f28d6000640 1 --2- 172.21.15.70:0/1793297121 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28d81f6b70 0x7f28d8164680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f28c400c0e0 tx=0x7f28c4001930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.592+0000 7f279a000640 1 -- 172.21.15.70:0/2090387993 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f279403fb00 con 0x7f27880039a0 2024-09-13T16:01:24.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7f0cbde00640 1 -- 172.21.15.70:0/2183113117 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb81543e0 con 0x7f0cb815c830 2024-09-13T16:01:24.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7f0cbde00640 1 -- 172.21.15.70:0/2183113117 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb81549a0 con 0x7f0cb815c830 2024-09-13T16:01:24.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7fbae3400640 1 -- 172.21.15.70:0/445750448 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbadc14a210 con 0x7fbadc06cb60 2024-09-13T16:01:24.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.589+0000 7f2627e00640 1 -- 172.21.15.70:0/248284015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f262815c720 msgr2=0x7f26280d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:24.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.589+0000 7f2627e00640 1 --2- 172.21.15.70:0/248284015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f262815c720 0x7f26280d28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.589+0000 7f2627e00640 1 -- 172.21.15.70:0/248284015 >> v1:172.21.15.107:6789/0 conn(0x7f262815cb00 legacy=0x7f26280cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.589+0000 7f2627e00640 1 -- 172.21.15.70:0/248284015 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26280d1c40 con 0x7f26280cde70 2024-09-13T16:01:24.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.592+0000 7f2627e00640 1 --2- 172.21.15.70:0/248284015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26280cde70 0x7f26280d2df0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2610009870 tx=0x7f261002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88535fc61259122 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.593+0000 7fbae3400640 1 -- 172.21.15.70:0/445750448 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbadc161fe0 con 0x7fbadc06cb60 2024-09-13T16:01:24.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.591+0000 7f7b29a00640 1 -- start start 2024-09-13T16:01:24.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.593+0000 7f129aa00640 1 --2- 172.21.15.70:0/363210067 >> [v2:172.21.15.70:6821/1697557929,v1:172.21.15.70:6823/1697557929] conn(0x7f127c072ef0 0x7f127c075310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.592+0000 7f865be00640 1 -- 172.21.15.70:0/131490247 shutdown_connections 2024-09-13T16:01:24.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.592+0000 7f865be00640 1 -- 172.21.15.70:0/131490247 wait complete. 2024-09-13T16:01:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.593+0000 7f28cea00640 1 -- 172.21.15.70:0/1793297121 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4031ea0 con 0x7f28d81f6b70 2024-09-13T16:01:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.593+0000 7f7b29a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b240b2a30 0x7f7b2406bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.593+0000 7f7b29a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7b240adcb0 0x7f7b240cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.593+0000 7f28dda00640 1 -- 172.21.15.70:0/1793297121 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d8156bd0 con 0x7f28d81f6b70 2024-09-13T16:01:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.593+0000 7f28cea00640 1 -- 172.21.15.70:0/1793297121 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c4005070 con 0x7f28d81f6b70 2024-09-13T16:01:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.593+0000 7f28cea00640 1 -- 172.21.15.70:0/1793297121 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4005400 con 0x7f28d81f6b70 2024-09-13T16:01:24.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.593+0000 7f279a000640 1 --2- 172.21.15.70:0/2090387993 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f278406ad00 0x7f278406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.593+0000 7f28dda00640 1 -- 172.21.15.70:0/1793297121 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d8163240 con 0x7f28d81f6b70 2024-09-13T16:01:24.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.594+0000 7f129aa00640 1 --2- 172.21.15.70:0/363210067 >> [v2:172.21.15.70:6821/1697557929,v1:172.21.15.70:6823/1697557929] conn(0x7f127c072ef0 0x7f127c075310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.594+0000 7f7b1be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b240b2a30 0x7f7b2406bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.594+0000 7f7b23400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7b240adcb0 0x7f7b240cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.594+0000 7f7b23400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7b240adcb0 0x7f7b240cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35914/0 (socket says 172.21.15.70:35914) 2024-09-13T16:01:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.594+0000 7f7b1be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b240b2a30 0x7f7b2406bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:51130/0 (socket says 172.21.15.70:51130) 2024-09-13T16:01:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.594+0000 7f7b23400640 1 -- 172.21.15.70:0/3619350928 learned_addr learned my addr 172.21.15.70:0/3619350928 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.594+0000 7f7b29a00640 1 -- 172.21.15.70:0/3619350928 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b24070110 con 0x7f7b24160d10 2024-09-13T16:01:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.594+0000 7f7b29a00640 1 -- 172.21.15.70:0/3619350928 --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b241610f0 con 0x7f7b240adcb0 2024-09-13T16:01:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.594+0000 7f7b29a00640 1 -- 172.21.15.70:0/3619350928 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240703f0 con 0x7f7b240b2a30 2024-09-13T16:01:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.594+0000 7f0cbde00640 1 -- 172.21.15.70:0/2183113117 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c90000fc0 con 0x7f0cb815c830 2024-09-13T16:01:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.595+0000 7f7b1be00640 1 -- 172.21.15.70:0/3619350928 >> v2:172.21.15.70:3300/0 conn(0x7f7b240adcb0 msgr2=0x7f7b240cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.595+0000 7f7b1be00640 1 --2- 172.21.15.70:0/3619350928 >> v2:172.21.15.70:3300/0 conn(0x7f7b240adcb0 0x7f7b240cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.595+0000 7f7b1be00640 1 -- 172.21.15.70:0/3619350928 >> v1:172.21.15.107:6789/0 conn(0x7f7b24160d10 legacy=0x7f7b240b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.595+0000 7f129b400640 1 --2- 172.21.15.70:0/363210067 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f127c06acd0 0x7f127c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.595+0000 7fbad8c00640 1 -- 172.21.15.70:0/445750448 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbad000aa90 con 0x7fbadc06cb60 2024-09-13T16:01:24.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.595+0000 7f7b1be00640 1 -- 172.21.15.70:0/3619350928 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b240706d0 con 0x7f7b240b2a30 2024-09-13T16:01:24.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.595+0000 7f865be00640 1 Processor -- start 2024-09-13T16:01:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.595+0000 7f2626000640 1 -- 172.21.15.70:0/248284015 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610032440 con 0x7f26280cde70 2024-09-13T16:01:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.595+0000 7f2626000640 1 -- 172.21.15.70:0/248284015 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26100325a0 con 0x7f26280cde70 2024-09-13T16:01:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.595+0000 7f2626000640 1 -- 172.21.15.70:0/248284015 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610032970 con 0x7f26280cde70 2024-09-13T16:01:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.595+0000 7f865be00640 1 -- start start 2024-09-13T16:01:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.596+0000 7f129b400640 1 --2- 172.21.15.70:0/363210067 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f127c06acd0 0x7f127c06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f129c04f480 tx=0x7f129c06c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.596+0000 7f128f400640 1 -- 172.21.15.70:0/363210067 <== osd.0 v2:172.21.15.70:6821/1697557929 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f127c0759c0 con 0x7f127c072ef0 2024-09-13T16:01:24.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.596+0000 7f28c3e00640 1 -- 172.21.15.70:0/1793297121 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f28ac000fc0 con 0x7f28d81f6b70 2024-09-13T16:01:24.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.596+0000 7f0caf400640 1 -- 172.21.15.70:0/2183113117 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0ca8005470 con 0x7f0cb815c830 2024-09-13T16:01:24.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.596+0000 7f7b1be00640 1 --2- 172.21.15.70:0/3619350928 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b240b2a30 0x7f7b2406bb60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7b140097a0 tx=0x7f7b1402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5959b90d3da2c8a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.597+0000 7f262e400640 1 -- 172.21.15.70:0/248284015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26280cde70 msgr2=0x7f26280d2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.597+0000 7fbad8c00640 1 --2- 172.21.15.70:0/445750448 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fbabc06ac50 0x7fbabc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.597+0000 7f7b22000640 1 -- 172.21.15.70:0/3619350928 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b14032440 con 0x7f7b240b2a30 2024-09-13T16:01:24.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.597+0000 7f262e400640 1 --2- 172.21.15.70:0/248284015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26280cde70 0x7f26280d2df0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2610009870 tx=0x7f261002a210 comp rx=0 tx=0).stop 2024-09-13T16:01:24.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.597+0000 7f262e400640 1 -- 172.21.15.70:0/248284015 shutdown_connections 2024-09-13T16:01:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.596+0000 7f279a000640 1 -- 172.21.15.70:0/2090387993 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27940a9f80 con 0x7f27880039a0 2024-09-13T16:01:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.597+0000 7f279a000640 1 --2- 172.21.15.70:0/2090387993 >> [v2:172.21.15.70:6800/313203511,v1:172.21.15.70:6801/313203511] conn(0x7f2784072f20 0x7f2784075340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.597+0000 7f279a000640 1 -- 172.21.15.70:0/2090387993 --> [v2:172.21.15.70:6800/313203511,v1:172.21.15.70:6801/313203511] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27840759f0 con 0x7f2784072f20 2024-09-13T16:01:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.597+0000 7f279a000640 1 -- 172.21.15.70:0/2090387993 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27940ac5a0 con 0x7f27880039a0 2024-09-13T16:01:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.597+0000 7f27a1400640 1 --2- 172.21.15.70:0/2090387993 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f278406ad00 0x7f278406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.598+0000 7f865be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f865c071510 0x7f865c13ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.598+0000 7f865be00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f865c071950 0x7f865c13d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.597+0000 7fbad8c00640 1 -- 172.21.15.70:0/445750448 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbad00891f0 con 0x7fbadc06cb60 2024-09-13T16:01:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.598+0000 7fbad8c00640 1 --2- 172.21.15.70:0/445750448 >> [v2:172.21.15.107:6809/951062155,v1:172.21.15.107:6811/951062155] conn(0x7fbabc072e70 0x7fbabc075290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.597+0000 7f262e400640 1 --2- 172.21.15.70:0/248284015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26280cde70 0x7f26280d2df0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.597+0000 7f262e400640 1 --2- 172.21.15.70:0/248284015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f262815c720 0x7f26280d28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.597+0000 7f262e400640 1 -- 172.21.15.70:0/248284015 >> 172.21.15.70:0/248284015 conn(0x7f262808bf90 msgr2=0x7f262808c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.597+0000 7f7b22000640 1 -- 172.21.15.70:0/3619350928 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b140325a0 con 0x7f7b240b2a30 2024-09-13T16:01:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.597+0000 7f7b22000640 1 -- 172.21.15.70:0/3619350928 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b14032910 con 0x7f7b240b2a30 2024-09-13T16:01:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.598+0000 7f0caf400640 1 --2- 172.21.15.70:0/2183113117 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0c9406acd0 0x7f0c9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.598+0000 7f0caf400640 1 -- 172.21.15.70:0/2183113117 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ca8088f80 con 0x7f0cb815c830 2024-09-13T16:01:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.598+0000 7f0caf400640 1 --2- 172.21.15.70:0/2183113117 >> [v2:172.21.15.70:6808/4231595789,v1:172.21.15.70:6809/4231595789] conn(0x7f0c94072e70 0x7f0c94075290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.598+0000 7f262e400640 1 -- 172.21.15.70:0/248284015 shutdown_connections 2024-09-13T16:01:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.598+0000 7f0caf400640 1 -- 172.21.15.70:0/2183113117 --> [v2:172.21.15.70:6808/4231595789,v1:172.21.15.70:6809/4231595789] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c94075940 con 0x7f0c94072e70 2024-09-13T16:01:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.598+0000 7f7b29a00640 1 -- 172.21.15.70:0/3619350928 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b240b2a30 msgr2=0x7f7b2406bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.598+0000 7f7b29a00640 1 --2- 172.21.15.70:0/3619350928 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b240b2a30 0x7f7b2406bb60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7b140097a0 tx=0x7f7b1402a1a0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.598+0000 7f0cb6a00640 1 --2- 172.21.15.70:0/2183113117 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0c9406acd0 0x7f0c9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f0caf400640 1 -- 172.21.15.70:0/2183113117 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ca8054140 con 0x7f0cb815c830 2024-09-13T16:01:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.598+0000 7f865be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f865c143ec0 0x7f865c13da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.598+0000 7f7b29a00640 1 -- 172.21.15.70:0/3619350928 shutdown_connections 2024-09-13T16:01:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f7b29a00640 1 --2- 172.21.15.70:0/3619350928 >> v2:172.21.15.70:3300/0 conn(0x7f7b240adcb0 0x7f7b240cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f7b29a00640 1 --2- 172.21.15.70:0/3619350928 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b240b2a30 0x7f7b2406bb60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f7b29a00640 1 -- 172.21.15.70:0/3619350928 >> 172.21.15.70:0/3619350928 conn(0x7f7b240b0510 msgr2=0x7f7b240b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.598+0000 7f27a2800640 1 --2- 172.21.15.70:0/2090387993 >> [v2:172.21.15.70:6800/313203511,v1:172.21.15.70:6801/313203511] conn(0x7f2784072f20 0x7f2784075340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f0cb6000640 1 --2- 172.21.15.70:0/2183113117 >> [v2:172.21.15.70:6808/4231595789,v1:172.21.15.70:6809/4231595789] conn(0x7f0c94072e70 0x7f0c94075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f7b29a00640 1 -- 172.21.15.70:0/3619350928 shutdown_connections 2024-09-13T16:01:24.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f7b29a00640 1 -- 172.21.15.70:0/3619350928 wait complete. 2024-09-13T16:01:24.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f865aa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f865c071510 0x7f865c13ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.598+0000 7fbadbe00640 1 --2- 172.21.15.70:0/445750448 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fbabc06ac50 0x7fbabc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7fbad8c00640 1 -- 172.21.15.70:0/445750448 --> [v2:172.21.15.107:6809/951062155,v1:172.21.15.107:6811/951062155] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbabc075940 con 0x7fbabc072e70 2024-09-13T16:01:24.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7fbad8c00640 1 -- 172.21.15.70:0/445750448 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbad008b7d0 con 0x7fbadc06cb60 2024-09-13T16:01:24.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f27a1400640 1 --2- 172.21.15.70:0/2090387993 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f278406ad00 0x7f278406d1c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2790001eb0 tx=0x7f2790000f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7fbae1400640 1 --2- 172.21.15.70:0/445750448 >> [v2:172.21.15.107:6809/951062155,v1:172.21.15.107:6811/951062155] conn(0x7fbabc072e70 0x7fbabc075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f865aa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f865c071510 0x7f865c13ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:51134/0 (socket says 172.21.15.70:51134) 2024-09-13T16:01:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f865aa00640 1 -- 172.21.15.70:0/391040556 learned_addr learned my addr 172.21.15.70:0/391040556 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f865b400640 1 --2- 172.21.15.70:0/391040556 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f865c143ec0 0x7f865c13da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f865be00640 1 -- 172.21.15.70:0/391040556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c140430 con 0x7f865c071950 2024-09-13T16:01:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f865a000640 1 --2- 172.21.15.70:0/391040556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f865c071950 0x7f865c13d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f865be00640 1 -- 172.21.15.70:0/391040556 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c13d200 con 0x7f865c143ec0 2024-09-13T16:01:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f865be00640 1 -- 172.21.15.70:0/391040556 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865c13f8b0 con 0x7f865c071510 2024-09-13T16:01:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f865b400640 1 -- 172.21.15.70:0/391040556 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f865c071510 msgr2=0x7f865c13ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f865b400640 1 --2- 172.21.15.70:0/391040556 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f865c071510 0x7f865c13ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.600+0000 7f865b400640 1 -- 172.21.15.70:0/391040556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f865c071950 msgr2=0x7f865c13d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.600+0000 7f865b400640 1 --2- 172.21.15.70:0/391040556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f865c071950 0x7f865c13d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.600+0000 7f865b400640 1 -- 172.21.15.70:0/391040556 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c009a70 con 0x7f865c143ec0 2024-09-13T16:01:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.600+0000 7f865a000640 1 --2- 172.21.15.70:0/391040556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f865c071950 0x7f865c13d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.600+0000 7f0cb6a00640 1 --2- 172.21.15.70:0/2183113117 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0c9406acd0 0x7f0c9406d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0000f60 tx=0x7f0ca0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.600+0000 7f865b400640 1 --2- 172.21.15.70:0/391040556 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f865c143ec0 0x7f865c13da20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f864c031000 tx=0x7f864c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.601+0000 7fbae1400640 1 --2- 172.21.15.70:0/445750448 >> [v2:172.21.15.107:6809/951062155,v1:172.21.15.107:6811/951062155] conn(0x7fbabc072e70 0x7fbabc075290 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.600+0000 7f0cb6000640 1 --2- 172.21.15.70:0/2183113117 >> [v2:172.21.15.70:6808/4231595789,v1:172.21.15.70:6809/4231595789] conn(0x7f0c94072e70 0x7f0c94075290 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f262e400640 1 -- 172.21.15.70:0/248284015 wait complete. 2024-09-13T16:01:24.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.601+0000 7f8652a00640 1 -- 172.21.15.70:0/391040556 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c03c830 con 0x7f865c143ec0 2024-09-13T16:01:24.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.601+0000 7f8652a00640 1 -- 172.21.15.70:0/391040556 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c03c990 con 0x7f865c143ec0 2024-09-13T16:01:24.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.601+0000 7f8652a00640 1 -- 172.21.15.70:0/391040556 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c03cd20 con 0x7f865c143ec0 2024-09-13T16:01:24.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.601+0000 7f7b29a00640 1 Processor -- start 2024-09-13T16:01:24.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.601+0000 7f27a2800640 1 --2- 172.21.15.70:0/2090387993 >> [v2:172.21.15.70:6800/313203511,v1:172.21.15.70:6801/313203511] conn(0x7f2784072f20 0x7f2784075340 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.601+0000 7f7b29a00640 1 -- start start 2024-09-13T16:01:24.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.602+0000 7f0caf400640 1 -- 172.21.15.70:0/2183113117 <== osd.3 v2:172.21.15.70:6808/4231595789 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0c94075940 con 0x7f0c94072e70 2024-09-13T16:01:24.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.602+0000 7f865be00640 1 -- 172.21.15.70:0/391040556 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865c13fb90 con 0x7f865c143ec0 2024-09-13T16:01:24.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.602+0000 7f865be00640 1 -- 172.21.15.70:0/391040556 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865c140150 con 0x7f865c143ec0 2024-09-13T16:01:24.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.599+0000 7f28cea00640 1 -- 172.21.15.70:0/1793297121 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f28c4038040 con 0x7f28d81f6b70 2024-09-13T16:01:24.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.600+0000 7f28cea00640 1 --2- 172.21.15.70:0/1793297121 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f28b806acd0 0x7f28b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.600+0000 7f28cea00640 1 -- 172.21.15.70:0/1793297121 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28c40a9090 con 0x7f28d81f6b70 2024-09-13T16:01:24.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.601+0000 7f28cea00640 1 --2- 172.21.15.70:0/1793297121 >> [v2:172.21.15.70:6816/523483066,v1:172.21.15.70:6817/523483066] conn(0x7f28b8072ef0 0x7f28b8075310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.601+0000 7f28cea00640 1 -- 172.21.15.70:0/1793297121 --> [v2:172.21.15.70:6816/523483066,v1:172.21.15.70:6817/523483066] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f28b80759c0 con 0x7f28b8072ef0 2024-09-13T16:01:24.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.601+0000 7f28cea00640 1 -- 172.21.15.70:0/1793297121 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28c40ab6b0 con 0x7f28d81f6b70 2024-09-13T16:01:24.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.601+0000 7f28d6a00640 1 --2- 172.21.15.70:0/1793297121 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f28b806acd0 0x7f28b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.602+0000 7f28d7400640 1 --2- 172.21.15.70:0/1793297121 >> [v2:172.21.15.70:6816/523483066,v1:172.21.15.70:6817/523483066] conn(0x7f28b8072ef0 0x7f28b8075310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.602+0000 7f28d6a00640 1 --2- 172.21.15.70:0/1793297121 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f28b806acd0 0x7f28b806d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f28d815ca40 tx=0x7f28c8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.601+0000 7fbadbe00640 1 --2- 172.21.15.70:0/445750448 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fbabc06ac50 0x7fbabc06d110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbadc157030 tx=0x7fbac8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.602+0000 7fbad8c00640 1 -- 172.21.15.70:0/445750448 <== osd.5 v2:172.21.15.107:6809/951062155 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbabc075940 con 0x7fbabc072e70 2024-09-13T16:01:24.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.603+0000 7f7b29a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b240adcb0 0x7f7b240cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.603+0000 7f7b29a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b240b2a30 0x7f7b2415a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.603+0000 7f28d7400640 1 --2- 172.21.15.70:0/1793297121 >> [v2:172.21.15.70:6816/523483066,v1:172.21.15.70:6817/523483066] conn(0x7f28b8072ef0 0x7f28b8075310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.603+0000 7f7b29a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b24160d10 0x7f7b240a8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.603+0000 7f7b22a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b240adcb0 0x7f7b240cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.603+0000 7f7b22a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b240adcb0 0x7f7b240cd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:51150/0 (socket says 172.21.15.70:51150) 2024-09-13T16:01:24.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.603+0000 7f7b22a00640 1 -- 172.21.15.70:0/1667894650 learned_addr learned my addr 172.21.15.70:0/1667894650 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:24.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.603+0000 7f7b29a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240cc570 con 0x7f7b24160d10 2024-09-13T16:01:24.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.603+0000 7f7b29a00640 1 -- 172.21.15.70:0/1667894650 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b24163160 con 0x7f7b240b2a30 2024-09-13T16:01:24.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.603+0000 7f7b29a00640 1 -- 172.21.15.70:0/1667894650 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240cc780 con 0x7f7b240adcb0 2024-09-13T16:01:24.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.604+0000 7f279a000640 1 -- 172.21.15.70:0/2090387993 <== osd.2 v2:172.21.15.70:6800/313203511 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f27840759f0 con 0x7f2784072f20 2024-09-13T16:01:24.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.603+0000 7f7b23400640 1 --2- 172.21.15.70:0/1667894650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b24160d10 0x7f7b240a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.604+0000 7f7b1be00640 1 --2- 172.21.15.70:0/1667894650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b240b2a30 0x7f7b2415a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.603+0000 7f262e400640 1 Processor -- start 2024-09-13T16:01:24.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.604+0000 7f7b23400640 1 -- 172.21.15.70:0/1667894650 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b240adcb0 msgr2=0x7f7b240cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.605+0000 7f865be00640 1 -- 172.21.15.70:0/391040556 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f865c157e30 con 0x7f865c143ec0 2024-09-13T16:01:24.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.604+0000 7f7b23400640 1 --2- 172.21.15.70:0/1667894650 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b240adcb0 0x7f7b240cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.604+0000 7f7b23400640 1 -- 172.21.15.70:0/1667894650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b240b2a30 msgr2=0x7f7b2415a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.604+0000 7f7b23400640 1 --2- 172.21.15.70:0/1667894650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b240b2a30 0x7f7b2415a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.604+0000 7f7b23400640 1 -- 172.21.15.70:0/1667894650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14009400 con 0x7f7b24160d10 2024-09-13T16:01:24.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.605+0000 7f28cea00640 1 -- 172.21.15.70:0/1793297121 <== osd.1 v2:172.21.15.70:6816/523483066 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f28b80759c0 con 0x7f28b8072ef0 2024-09-13T16:01:24.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.607+0000 7f8652a00640 1 -- 172.21.15.70:0/391040556 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f864c045460 con 0x7f865c143ec0 2024-09-13T16:01:24.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.605+0000 7f262e400640 1 -- start start 2024-09-13T16:01:24.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.606+0000 7f262e400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26280cde70 0x7f26282021d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.606+0000 7f262e400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f262815c720 0x7f26280c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.607+0000 7f262e400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f262815cb00 0x7f26280c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.607+0000 7f262e400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26281547c0 con 0x7f262815c720 2024-09-13T16:01:24.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.607+0000 7f262e400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2628153a20 con 0x7f262815cb00 2024-09-13T16:01:24.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.607+0000 7f262e400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2628153d00 con 0x7f26280cde70 2024-09-13T16:01:24.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.607+0000 7f2627400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26280cde70 0x7f26282021d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.607+0000 7f2627400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26280cde70 0x7f26282021d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:51154/0 (socket says 172.21.15.70:51154) 2024-09-13T16:01:24.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.607+0000 7f2627400640 1 -- 172.21.15.70:0/2994335550 learned_addr learned my addr 172.21.15.70:0/2994335550 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:24.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.607+0000 7f7b23400640 1 --2- 172.21.15.70:0/1667894650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b24160d10 0x7f7b240a8580 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c007a70 tx=0x7f7b1c007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.607+0000 7f2627e00640 1 --2- 172.21.15.70:0/2994335550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f262815cb00 0x7f26280c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.608+0000 7f2626a00640 1 --2- 172.21.15.70:0/2994335550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f262815c720 0x7f26280c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.608+0000 7f7b1aa00640 1 -- 172.21.15.70:0/1667894650 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c00dc40 con 0x7f7b24160d10 2024-09-13T16:01:24.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.608+0000 7f7b1aa00640 1 -- 172.21.15.70:0/1667894650 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c00f040 con 0x7f7b24160d10 2024-09-13T16:01:24.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.608+0000 7f7b1aa00640 1 -- 172.21.15.70:0/1667894650 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c015400 con 0x7f7b24160d10 2024-09-13T16:01:24.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.608+0000 7f2627400640 1 -- 172.21.15.70:0/2994335550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f262815cb00 msgr2=0x7f26280c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.608+0000 7f2627400640 1 --2- 172.21.15.70:0/2994335550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f262815cb00 0x7f26280c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.608+0000 7f2627400640 1 -- 172.21.15.70:0/2994335550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f262815c720 msgr2=0x7f26280c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.608+0000 7f8652a00640 1 --2- 172.21.15.70:0/391040556 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f863806acd0 0x7f863806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.608+0000 7f7b29a00640 1 -- 172.21.15.70:0/1667894650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b240cca60 con 0x7f7b24160d10 2024-09-13T16:01:24.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.608+0000 7f2627400640 1 --2- 172.21.15.70:0/2994335550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f262815c720 0x7f26280c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.608+0000 7f2627400640 1 -- 172.21.15.70:0/2994335550 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26100094d0 con 0x7f26280cde70 2024-09-13T16:01:24.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.608+0000 7f2626a00640 1 --2- 172.21.15.70:0/2994335550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f262815c720 0x7f26280c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:24.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.609+0000 7f8652a00640 1 -- 172.21.15.70:0/391040556 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f864c0ab0f0 con 0x7f865c143ec0 2024-09-13T16:01:24.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.609+0000 7f2627400640 1 --2- 172.21.15.70:0/2994335550 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26280cde70 0x7f26282021d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2620007ef0 tx=0x7f262000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.608+0000 7f7b29a00640 1 -- 172.21.15.70:0/1667894650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2415d0b0 con 0x7f7b24160d10 2024-09-13T16:01:24.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.609+0000 7f865aa00640 1 --2- 172.21.15.70:0/391040556 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f863806acd0 0x7f863806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.609+0000 7f8652a00640 1 --2- 172.21.15.70:0/391040556 >> [v2:172.21.15.107:6800/679436451,v1:172.21.15.107:6801/679436451] conn(0x7f8638072ef0 0x7f8638075310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.609+0000 7f8652a00640 1 -- 172.21.15.70:0/391040556 --> [v2:172.21.15.107:6800/679436451,v1:172.21.15.107:6801/679436451] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86380759c0 con 0x7f8638072ef0 2024-09-13T16:01:24.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.609+0000 7f8652a00640 1 -- 172.21.15.70:0/391040556 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f864c0ab4a0 con 0x7f865c143ec0 2024-09-13T16:01:24.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.611+0000 7f865a000640 1 --2- 172.21.15.70:0/391040556 >> [v2:172.21.15.107:6800/679436451,v1:172.21.15.107:6801/679436451] conn(0x7f8638072ef0 0x7f8638075310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.611+0000 7f865aa00640 1 --2- 172.21.15.70:0/391040556 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f863806acd0 0x7f863806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f865c06f910 tx=0x7f8654009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.611+0000 7f7b29a00640 1 -- 172.21.15.70:0/1667894650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b24070ed0 con 0x7f7b24160d10 2024-09-13T16:01:24.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.611+0000 7f865a000640 1 --2- 172.21.15.70:0/391040556 >> [v2:172.21.15.107:6800/679436451,v1:172.21.15.107:6801/679436451] conn(0x7f8638072ef0 0x7f8638075310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.612+0000 7f261f400640 1 -- 172.21.15.70:0/2994335550 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620014620 con 0x7f26280cde70 2024-09-13T16:01:24.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.612+0000 7f261f400640 1 -- 172.21.15.70:0/2994335550 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2620014780 con 0x7f26280cde70 2024-09-13T16:01:24.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.612+0000 7f261f400640 1 -- 172.21.15.70:0/2994335550 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620014b30 con 0x7f26280cde70 2024-09-13T16:01:24.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.612+0000 7f262e400640 1 -- 172.21.15.70:0/2994335550 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2628153fe0 con 0x7f26280cde70 2024-09-13T16:01:24.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.612+0000 7f262e400640 1 -- 172.21.15.70:0/2994335550 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26281536e0 con 0x7f26280cde70 2024-09-13T16:01:24.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.613+0000 7f8652a00640 1 -- 172.21.15.70:0/391040556 <== osd.4 v2:172.21.15.107:6800/679436451 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f86380759c0 con 0x7f8638072ef0 2024-09-13T16:01:24.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.614+0000 7f262e400640 1 -- 172.21.15.70:0/2994335550 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f26280cea00 con 0x7f26280cde70 2024-09-13T16:01:24.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.614+0000 7f261f400640 1 -- 172.21.15.70:0/2994335550 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2620014c90 con 0x7f26280cde70 2024-09-13T16:01:24.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.614+0000 7f7b1aa00640 1 -- 172.21.15.70:0/1667894650 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7b1c0143a0 con 0x7f7b24160d10 2024-09-13T16:01:24.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.616+0000 7f7b1aa00640 1 --2- 172.21.15.70:0/1667894650 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7b0006acd0 0x7f7b0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.616+0000 7f261f400640 1 --2- 172.21.15.70:0/2994335550 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f260406acd0 0x7f260406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.616+0000 7f261f400640 1 -- 172.21.15.70:0/2994335550 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2620089d70 con 0x7f26280cde70 2024-09-13T16:01:24.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.616+0000 7f261f400640 1 --2- 172.21.15.70:0/2994335550 >> [v2:172.21.15.107:6822/3873935546,v1:172.21.15.107:6825/3873935546] conn(0x7f2604072ef0 0x7f2604075310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.616+0000 7f261f400640 1 -- 172.21.15.70:0/2994335550 --> [v2:172.21.15.107:6822/3873935546,v1:172.21.15.107:6825/3873935546] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f26040759c0 con 0x7f2604072ef0 2024-09-13T16:01:24.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.616+0000 7f261f400640 1 -- 172.21.15.70:0/2994335550 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f262008c390 con 0x7f26280cde70 2024-09-13T16:01:24.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.616+0000 7f7b1aa00640 1 -- 172.21.15.70:0/1667894650 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b1c089350 con 0x7f7b24160d10 2024-09-13T16:01:24.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.617+0000 7f2626a00640 1 --2- 172.21.15.70:0/2994335550 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f260406acd0 0x7f260406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.617+0000 7f7b1aa00640 1 --2- 172.21.15.70:0/1667894650 >> [v2:172.21.15.107:6808/2642179308,v1:172.21.15.107:6810/2642179308] conn(0x7f7b00072ef0 0x7f7b00075310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.617+0000 7f2627e00640 1 --2- 172.21.15.70:0/2994335550 >> [v2:172.21.15.107:6822/3873935546,v1:172.21.15.107:6825/3873935546] conn(0x7f2604072ef0 0x7f2604075310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.617+0000 7f7b22a00640 1 --2- 172.21.15.70:0/1667894650 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7b0006acd0 0x7f7b0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.618+0000 7f2627e00640 1 --2- 172.21.15.70:0/2994335550 >> [v2:172.21.15.107:6822/3873935546,v1:172.21.15.107:6825/3873935546] conn(0x7f2604072ef0 0x7f2604075310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.618+0000 7f7b1aa00640 1 -- 172.21.15.70:0/1667894650 --> [v2:172.21.15.107:6808/2642179308,v1:172.21.15.107:6810/2642179308] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b000759c0 con 0x7f7b00072ef0 2024-09-13T16:01:24.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.618+0000 7f7b1aa00640 1 -- 172.21.15.70:0/1667894650 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b1c08b970 con 0x7f7b24160d10 2024-09-13T16:01:24.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.618+0000 7f2626a00640 1 --2- 172.21.15.70:0/2994335550 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f260406acd0 0x7f260406d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f262806c100 tx=0x7f2618009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.618+0000 7f7b22a00640 1 --2- 172.21.15.70:0/1667894650 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7b0006acd0 0x7f7b0006d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c001660 tx=0x7f7b0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.618+0000 7f7b1be00640 1 --2- 172.21.15.70:0/1667894650 >> [v2:172.21.15.107:6808/2642179308,v1:172.21.15.107:6810/2642179308] conn(0x7f7b00072ef0 0x7f7b00075310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.619+0000 7f261f400640 1 -- 172.21.15.70:0/2994335550 <== osd.6 v2:172.21.15.107:6822/3873935546 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f26040759c0 con 0x7f2604072ef0 2024-09-13T16:01:24.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.619+0000 7f7b1be00640 1 --2- 172.21.15.70:0/1667894650 >> [v2:172.21.15.107:6808/2642179308,v1:172.21.15.107:6810/2642179308] conn(0x7f7b00072ef0 0x7f7b00075310 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:24.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.621+0000 7f7b1aa00640 1 -- 172.21.15.70:0/1667894650 <== osd.7 v2:172.21.15.107:6808/2642179308 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7b000759c0 con 0x7f7b00072ef0 2024-09-13T16:01:24.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.622+0000 7f128cc00640 1 -- 172.21.15.70:0/363210067 --> [v2:172.21.15.70:6821/1697557929,v1:172.21.15.70:6823/1697557929] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1270002cb0 con 0x7f127c072ef0 2024-09-13T16:01:24.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.623+0000 7f128f400640 1 -- 172.21.15.70:0/363210067 <== osd.0 v2:172.21.15.70:6821/1697557929 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1270002cb0 con 0x7f127c072ef0 2024-09-13T16:01:24.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.627+0000 7f128cc00640 1 -- 172.21.15.70:0/363210067 >> [v2:172.21.15.70:6821/1697557929,v1:172.21.15.70:6823/1697557929] conn(0x7f127c072ef0 msgr2=0x7f127c075310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.627+0000 7f128cc00640 1 --2- 172.21.15.70:0/363210067 >> [v2:172.21.15.70:6821/1697557929,v1:172.21.15.70:6823/1697557929] conn(0x7f127c072ef0 0x7f127c075310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.627+0000 7f128cc00640 1 -- 172.21.15.70:0/363210067 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f127c06acd0 msgr2=0x7f127c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.627+0000 7f128cc00640 1 --2- 172.21.15.70:0/363210067 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f127c06acd0 0x7f127c06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f129c04f480 tx=0x7f129c06c040 comp rx=0 tx=0).stop 2024-09-13T16:01:24.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.627+0000 7f128cc00640 1 -- 172.21.15.70:0/363210067 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1294005770 msgr2=0x7f129401eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.627+0000 7f128cc00640 1 --2- 172.21.15.70:0/363210067 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1294005770 0x7f129401eaa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1288009870 tx=0x7f12880046c0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.627+0000 7f129be00640 1 -- 172.21.15.70:0/363210067 reap_dead start 2024-09-13T16:01:24.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.628+0000 7f128cc00640 1 -- 172.21.15.70:0/363210067 shutdown_connections 2024-09-13T16:01:24.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.628+0000 7f128cc00640 1 -- 172.21.15.70:0/363210067 >> 172.21.15.70:0/363210067 conn(0x7f129401d900 msgr2=0x7f12940e1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:24.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.628+0000 7f128cc00640 1 -- 172.21.15.70:0/363210067 shutdown_connections 2024-09-13T16:01:24.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.628+0000 7f128cc00640 1 -- 172.21.15.70:0/363210067 wait complete. 2024-09-13T16:01:24.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.630+0000 7f28c3e00640 1 -- 172.21.15.70:0/1793297121 --> [v2:172.21.15.70:6816/523483066,v1:172.21.15.70:6817/523483066] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f28ac002cb0 con 0x7f28b8072ef0 2024-09-13T16:01:24.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.629+0000 7fbae3400640 1 -- 172.21.15.70:0/445750448 --> [v2:172.21.15.107:6809/951062155,v1:172.21.15.107:6811/951062155] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbadc161d00 con 0x7fbabc072e70 2024-09-13T16:01:24.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.630+0000 7fbad8c00640 1 -- 172.21.15.70:0/445750448 <== osd.5 v2:172.21.15.107:6809/951062155 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbad4032890 con 0x7fbabc072e70 2024-09-13T16:01:24.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.630+0000 7f28cea00640 1 -- 172.21.15.70:0/1793297121 <== osd.1 v2:172.21.15.70:6816/523483066 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f28ac002cb0 con 0x7f28b8072ef0 2024-09-13T16:01:24.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.631+0000 7fbae3400640 1 -- 172.21.15.70:0/445750448 >> [v2:172.21.15.107:6809/951062155,v1:172.21.15.107:6811/951062155] conn(0x7fbabc072e70 msgr2=0x7fbabc075290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.631+0000 7f28c3e00640 1 -- 172.21.15.70:0/1793297121 >> [v2:172.21.15.70:6816/523483066,v1:172.21.15.70:6817/523483066] conn(0x7f28b8072ef0 msgr2=0x7f28b8075310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.631+0000 7f28c3e00640 1 --2- 172.21.15.70:0/1793297121 >> [v2:172.21.15.70:6816/523483066,v1:172.21.15.70:6817/523483066] conn(0x7f28b8072ef0 0x7f28b8075310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.631+0000 7f28c3e00640 1 -- 172.21.15.70:0/1793297121 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f28b806acd0 msgr2=0x7f28b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.631+0000 7f28c3e00640 1 --2- 172.21.15.70:0/1793297121 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f28b806acd0 0x7f28b806d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f28d815ca40 tx=0x7f28c8009190 comp rx=0 tx=0).stop 2024-09-13T16:01:24.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.631+0000 7fbae3400640 1 --2- 172.21.15.70:0/445750448 >> [v2:172.21.15.107:6809/951062155,v1:172.21.15.107:6811/951062155] conn(0x7fbabc072e70 0x7fbabc075290 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.631+0000 7fbae3400640 1 -- 172.21.15.70:0/445750448 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fbabc06ac50 msgr2=0x7fbabc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.631+0000 7fbae3400640 1 --2- 172.21.15.70:0/445750448 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fbabc06ac50 0x7fbabc06d110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbadc157030 tx=0x7fbac8008040 comp rx=0 tx=0).stop 2024-09-13T16:01:24.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.631+0000 7f28c3e00640 1 -- 172.21.15.70:0/1793297121 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28d81f6b70 msgr2=0x7f28d8164680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.631+0000 7f28c3e00640 1 --2- 172.21.15.70:0/1793297121 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28d81f6b70 0x7f28d8164680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f28c400c0e0 tx=0x7f28c4001930 comp rx=0 tx=0).stop 2024-09-13T16:01:24.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.631+0000 7fbae3400640 1 -- 172.21.15.70:0/445750448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbadc06cb60 msgr2=0x7fbadc15a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.631+0000 7fbae3400640 1 --2- 172.21.15.70:0/445750448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbadc06cb60 0x7fbadc15a2b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbad000c730 tx=0x7fbad000cbf0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.632+0000 7f28d7400640 1 -- 172.21.15.70:0/1793297121 reap_dead start 2024-09-13T16:01:24.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.632+0000 7fbae1400640 1 -- 172.21.15.70:0/445750448 reap_dead start 2024-09-13T16:01:24.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.632+0000 7fbae3400640 1 -- 172.21.15.70:0/445750448 shutdown_connections 2024-09-13T16:01:24.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.632+0000 7fbae3400640 1 -- 172.21.15.70:0/445750448 >> 172.21.15.70:0/445750448 conn(0x7fbadc0b0200 msgr2=0x7fbadc0af960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:24.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.633+0000 7f28c3e00640 1 -- 172.21.15.70:0/1793297121 shutdown_connections 2024-09-13T16:01:24.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.633+0000 7f28c3e00640 1 -- 172.21.15.70:0/1793297121 >> 172.21.15.70:0/1793297121 conn(0x7f28d8069ed0 msgr2=0x7f28d80caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:24.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.635+0000 7fbae3400640 1 -- 172.21.15.70:0/445750448 shutdown_connections 2024-09-13T16:01:24.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.635+0000 7fbae3400640 1 -- 172.21.15.70:0/445750448 wait complete. 2024-09-13T16:01:24.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.635+0000 7f27a3200640 1 -- 172.21.15.70:0/2090387993 --> [v2:172.21.15.70:6800/313203511,v1:172.21.15.70:6801/313203511] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f27a415e750 con 0x7f2784072f20 2024-09-13T16:01:24.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.636+0000 7f279a000640 1 -- 172.21.15.70:0/2090387993 <== osd.2 v2:172.21.15.70:6800/313203511 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f279c0076f0 con 0x7f2784072f20 2024-09-13T16:01:24.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.635+0000 7f28c3e00640 1 -- 172.21.15.70:0/1793297121 shutdown_connections 2024-09-13T16:01:24.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.636+0000 7f28c3e00640 1 -- 172.21.15.70:0/1793297121 wait complete. 2024-09-13T16:01:24.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.637+0000 7f27a3200640 1 -- 172.21.15.70:0/2090387993 >> [v2:172.21.15.70:6800/313203511,v1:172.21.15.70:6801/313203511] conn(0x7f2784072f20 msgr2=0x7f2784075340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.637+0000 7f27a3200640 1 --2- 172.21.15.70:0/2090387993 >> [v2:172.21.15.70:6800/313203511,v1:172.21.15.70:6801/313203511] conn(0x7f2784072f20 0x7f2784075340 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.637+0000 7f27a3200640 1 -- 172.21.15.70:0/2090387993 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f278406ad00 msgr2=0x7f278406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.637+0000 7f27a3200640 1 --2- 172.21.15.70:0/2090387993 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f278406ad00 0x7f278406d1c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2790001eb0 tx=0x7f2790000f50 comp rx=0 tx=0).stop 2024-09-13T16:01:24.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.638+0000 7f0cbde00640 1 -- 172.21.15.70:0/2183113117 --> [v2:172.21.15.70:6808/4231595789,v1:172.21.15.70:6809/4231595789] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0c90002cb0 con 0x7f0c94072e70 2024-09-13T16:01:24.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.639+0000 7f0caf400640 1 -- 172.21.15.70:0/2183113117 <== osd.3 v2:172.21.15.70:6808/4231595789 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0c90002cb0 con 0x7f0c94072e70 2024-09-13T16:01:24.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.638+0000 7f27a3200640 1 -- 172.21.15.70:0/2090387993 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27880039a0 msgr2=0x7f27a415bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.638+0000 7f27a3200640 1 --2- 172.21.15.70:0/2090387993 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27880039a0 0x7f27a415bcd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f278800c260 tx=0x7f2794004730 comp rx=0 tx=0).stop 2024-09-13T16:01:24.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.639+0000 7f27a2800640 1 -- 172.21.15.70:0/2090387993 reap_dead start 2024-09-13T16:01:24.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.640+0000 7f27a3200640 1 -- 172.21.15.70:0/2090387993 shutdown_connections 2024-09-13T16:01:24.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.640+0000 7f27a3200640 1 -- 172.21.15.70:0/2090387993 >> 172.21.15.70:0/2090387993 conn(0x7f27a40b03a0 msgr2=0x7f27a40b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:24.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.640+0000 7f27a3200640 1 -- 172.21.15.70:0/2090387993 shutdown_connections 2024-09-13T16:01:24.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.640+0000 7f27a3200640 1 -- 172.21.15.70:0/2090387993 wait complete. 2024-09-13T16:01:24.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.640+0000 7f0cbde00640 1 -- 172.21.15.70:0/2183113117 >> [v2:172.21.15.70:6808/4231595789,v1:172.21.15.70:6809/4231595789] conn(0x7f0c94072e70 msgr2=0x7f0c94075290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.640+0000 7f0cbde00640 1 --2- 172.21.15.70:0/2183113117 >> [v2:172.21.15.70:6808/4231595789,v1:172.21.15.70:6809/4231595789] conn(0x7f0c94072e70 0x7f0c94075290 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.642+0000 7f0cbde00640 1 -- 172.21.15.70:0/2183113117 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0c9406acd0 msgr2=0x7f0c9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.642+0000 7f0cbde00640 1 --2- 172.21.15.70:0/2183113117 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0c9406acd0 0x7f0c9406d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0000f60 tx=0x7f0ca0009040 comp rx=0 tx=0).stop 2024-09-13T16:01:24.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.642+0000 7f0cbde00640 1 -- 172.21.15.70:0/2183113117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cb815c830 msgr2=0x7f0cb806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.642+0000 7f0cbde00640 1 --2- 172.21.15.70:0/2183113117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cb815c830 0x7f0cb806d380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80b76f0 tx=0x7f0ca800cb20 comp rx=0 tx=0).stop 2024-09-13T16:01:24.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.642+0000 7f0cb7400640 1 -- 172.21.15.70:0/2183113117 reap_dead start 2024-09-13T16:01:24.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.642+0000 7f0cbde00640 1 -- 172.21.15.70:0/2183113117 shutdown_connections 2024-09-13T16:01:24.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.642+0000 7f0cbde00640 1 -- 172.21.15.70:0/2183113117 >> 172.21.15.70:0/2183113117 conn(0x7f0cb80b4720 msgr2=0x7f0cb80d2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:24.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.646+0000 7f0cbde00640 1 -- 172.21.15.70:0/2183113117 shutdown_connections 2024-09-13T16:01:24.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.647+0000 7f0cbde00640 1 -- 172.21.15.70:0/2183113117 wait complete. 2024-09-13T16:01:24.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.651+0000 7f865be00640 1 -- 172.21.15.70:0/391040556 --> [v2:172.21.15.107:6800/679436451,v1:172.21.15.107:6801/679436451] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f865c15b4d0 con 0x7f8638072ef0 2024-09-13T16:01:24.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.651+0000 7f262e400640 1 -- 172.21.15.70:0/2994335550 --> [v2:172.21.15.107:6822/3873935546,v1:172.21.15.107:6825/3873935546] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f26280ce720 con 0x7f2604072ef0 2024-09-13T16:01:24.676 INFO:teuthology.orchestra.run.smithi070.stdout:55834574854 2024-09-13T16:01:24.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.653+0000 7f8652a00640 1 -- 172.21.15.70:0/391040556 <== osd.4 v2:172.21.15.107:6800/679436451 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8644001810 con 0x7f8638072ef0 2024-09-13T16:01:24.677 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T16:01:24.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.653+0000 7f261f400640 1 -- 172.21.15.70:0/2994335550 <== osd.6 v2:172.21.15.107:6822/3873935546 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2610032890 con 0x7f2604072ef0 2024-09-13T16:01:24.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.653+0000 7f865be00640 1 -- 172.21.15.70:0/391040556 >> [v2:172.21.15.107:6800/679436451,v1:172.21.15.107:6801/679436451] conn(0x7f8638072ef0 msgr2=0x7f8638075310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.653+0000 7f865be00640 1 --2- 172.21.15.70:0/391040556 >> [v2:172.21.15.107:6800/679436451,v1:172.21.15.107:6801/679436451] conn(0x7f8638072ef0 0x7f8638075310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.653+0000 7f262e400640 1 -- 172.21.15.70:0/2994335550 >> [v2:172.21.15.107:6822/3873935546,v1:172.21.15.107:6825/3873935546] conn(0x7f2604072ef0 msgr2=0x7f2604075310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.653+0000 7f262e400640 1 --2- 172.21.15.70:0/2994335550 >> [v2:172.21.15.107:6822/3873935546,v1:172.21.15.107:6825/3873935546] conn(0x7f2604072ef0 0x7f2604075310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.654+0000 7f262e400640 1 -- 172.21.15.70:0/2994335550 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f260406acd0 msgr2=0x7f260406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.654+0000 7f262e400640 1 --2- 172.21.15.70:0/2994335550 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f260406acd0 0x7f260406d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f262806c100 tx=0x7f2618009040 comp rx=0 tx=0).stop 2024-09-13T16:01:24.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.654+0000 7f262e400640 1 -- 172.21.15.70:0/2994335550 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26280cde70 msgr2=0x7f26282021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.654+0000 7f262e400640 1 --2- 172.21.15.70:0/2994335550 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26280cde70 0x7f26282021d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2620007ef0 tx=0x7f262000e4b0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.654+0000 7f2627e00640 1 -- 172.21.15.70:0/2994335550 reap_dead start 2024-09-13T16:01:24.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.654+0000 7f865be00640 1 -- 172.21.15.70:0/391040556 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f863806acd0 msgr2=0x7f863806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.654+0000 7f865be00640 1 --2- 172.21.15.70:0/391040556 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f863806acd0 0x7f863806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f865c06f910 tx=0x7f8654009240 comp rx=0 tx=0).stop 2024-09-13T16:01:24.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.654+0000 7f865be00640 1 -- 172.21.15.70:0/391040556 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f865c143ec0 msgr2=0x7f865c13da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.654+0000 7f865be00640 1 --2- 172.21.15.70:0/391040556 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f865c143ec0 0x7f865c13da20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f864c031000 tx=0x7f864c004a40 comp rx=0 tx=0).stop 2024-09-13T16:01:24.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.655+0000 7f865b400640 1 -- 172.21.15.70:0/391040556 reap_dead start 2024-09-13T16:01:24.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.655+0000 7f865be00640 1 -- 172.21.15.70:0/391040556 shutdown_connections 2024-09-13T16:01:24.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.655+0000 7f865be00640 1 -- 172.21.15.70:0/391040556 >> 172.21.15.70:0/391040556 conn(0x7f865c0b2250 msgr2=0x7f865c1413c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:24.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.655+0000 7f7b29a00640 1 -- 172.21.15.70:0/1667894650 --> [v2:172.21.15.107:6808/2642179308,v1:172.21.15.107:6810/2642179308] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7b240ada00 con 0x7f7b00072ef0 2024-09-13T16:01:24.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.655+0000 7f262e400640 1 -- 172.21.15.70:0/2994335550 shutdown_connections 2024-09-13T16:01:24.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.655+0000 7f262e400640 1 -- 172.21.15.70:0/2994335550 >> 172.21.15.70:0/2994335550 conn(0x7f262808bf90 msgr2=0x7f26280b2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:24.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.655+0000 7f865be00640 1 -- 172.21.15.70:0/391040556 shutdown_connections 2024-09-13T16:01:24.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.655+0000 7f865be00640 1 -- 172.21.15.70:0/391040556 wait complete. 2024-09-13T16:01:24.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.655+0000 7f262e400640 1 -- 172.21.15.70:0/2994335550 shutdown_connections 2024-09-13T16:01:24.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.655+0000 7f262e400640 1 -- 172.21.15.70:0/2994335550 wait complete. 2024-09-13T16:01:24.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.656+0000 7f7b1aa00640 1 -- 172.21.15.70:0/1667894650 <== osd.7 v2:172.21.15.107:6808/2642179308 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7b140041c0 con 0x7f7b00072ef0 2024-09-13T16:01:24.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.656+0000 7f7b29a00640 1 -- 172.21.15.70:0/1667894650 >> [v2:172.21.15.107:6808/2642179308,v1:172.21.15.107:6810/2642179308] conn(0x7f7b00072ef0 msgr2=0x7f7b00075310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.656+0000 7f7b29a00640 1 --2- 172.21.15.70:0/1667894650 >> [v2:172.21.15.107:6808/2642179308,v1:172.21.15.107:6810/2642179308] conn(0x7f7b00072ef0 0x7f7b00075310 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.657+0000 7f7b29a00640 1 -- 172.21.15.70:0/1667894650 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7b0006acd0 msgr2=0x7f7b0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.657+0000 7f7b29a00640 1 --2- 172.21.15.70:0/1667894650 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7b0006acd0 0x7f7b0006d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c001660 tx=0x7f7b0c009040 comp rx=0 tx=0).stop 2024-09-13T16:01:24.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.657+0000 7f7b29a00640 1 -- 172.21.15.70:0/1667894650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b24160d10 msgr2=0x7f7b240a8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.657+0000 7f7b29a00640 1 --2- 172.21.15.70:0/1667894650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b24160d10 0x7f7b240a8580 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c007a70 tx=0x7f7b1c007f30 comp rx=0 tx=0).stop 2024-09-13T16:01:24.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.657+0000 7f7b23400640 1 -- 172.21.15.70:0/1667894650 reap_dead start 2024-09-13T16:01:24.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.658+0000 7f7b29a00640 1 -- 172.21.15.70:0/1667894650 shutdown_connections 2024-09-13T16:01:24.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.658+0000 7f7b29a00640 1 -- 172.21.15.70:0/1667894650 >> 172.21.15.70:0/1667894650 conn(0x7f7b240b0510 msgr2=0x7f7b2415e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:24.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.659+0000 7f7b29a00640 1 -- 172.21.15.70:0/1667894650 shutdown_connections 2024-09-13T16:01:24.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.659+0000 7f7b29a00640 1 -- 172.21.15.70:0/1667894650 wait complete. 2024-09-13T16:01:24.684 INFO:teuthology.orchestra.run.smithi070.stdout:55834574853 2024-09-13T16:01:24.684 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T16:01:24.685 INFO:teuthology.orchestra.run.smithi070.stdout:55834574853 2024-09-13T16:01:24.685 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T16:01:24.686 INFO:teuthology.orchestra.run.smithi070.stdout:55834574853 2024-09-13T16:01:24.687 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T16:01:24.687 INFO:teuthology.orchestra.run.smithi070.stdout:55834574854 2024-09-13T16:01:24.688 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T16:01:24.688 INFO:teuthology.orchestra.run.smithi070.stdout:55834574856 2024-09-13T16:01:24.689 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T16:01:24.689 INFO:teuthology.orchestra.run.smithi070.stdout:55834574853 2024-09-13T16:01:24.690 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T16:01:24.690 INFO:teuthology.orchestra.run.smithi070.stdout:55834574853 2024-09-13T16:01:24.691 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T16:01:24.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.991+0000 7f1322800640 1 Processor -- start 2024-09-13T16:01:24.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.991+0000 7f1322800640 1 -- start start 2024-09-13T16:01:24.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.993+0000 7f1322800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f131c158c70 0x7f131c065c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.994+0000 7f1322800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f131c06a330 0x7f131c159760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:24.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.994+0000 7f131b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f131c158c70 0x7f131c065c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.994+0000 7f131b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f131c158c70 0x7f131c065c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:51168/0 (socket says 172.21.15.70:51168) 2024-09-13T16:01:24.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.994+0000 7f131b400640 1 -- 172.21.15.70:0/94878870 learned_addr learned my addr 172.21.15.70:0/94878870 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:24.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.995+0000 7f1322800640 1 -- 172.21.15.70:0/94878870 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131c159ca0 con 0x7f131c069ed0 2024-09-13T16:01:24.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.995+0000 7f1322800640 1 -- 172.21.15.70:0/94878870 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131c06a920 con 0x7f131c06a330 2024-09-13T16:01:24.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.995+0000 7f1322800640 1 -- 172.21.15.70:0/94878870 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131c06ac00 con 0x7f131c158c70 2024-09-13T16:01:24.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.995+0000 7f131be00640 1 --2- 172.21.15.70:0/94878870 >> v2:172.21.15.107:3300/0 conn(0x7f131c06a330 0x7f131c159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:24.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.996+0000 7fb72d600640 1 Processor -- start 2024-09-13T16:01:24.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.996+0000 7f131a000640 1 -- 172.21.15.70:0/94878870 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489349030 0 0) 0x7f131c159ca0 con 0x7f131c069ed0 2024-09-13T16:01:24.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.996+0000 7f94bfc00640 1 Processor -- start 2024-09-13T16:01:24.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.996+0000 7f131a000640 1 -- 172.21.15.70:0/94878870 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1300003520 con 0x7f131c069ed0 2024-09-13T16:01:24.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.996+0000 7f131b400640 1 -- 172.21.15.70:0/94878870 >> v2:172.21.15.107:3300/0 conn(0x7f131c06a330 msgr2=0x7f131c159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:24.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.996+0000 7f131b400640 1 --2- 172.21.15.70:0/94878870 >> v2:172.21.15.107:3300/0 conn(0x7f131c06a330 0x7f131c159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:24.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.996+0000 7f131b400640 1 -- 172.21.15.70:0/94878870 >> v1:172.21.15.107:6789/0 conn(0x7f131c069ed0 legacy=0x7f131c159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:24.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.996+0000 7f131b400640 1 -- 172.21.15.70:0/94878870 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c06aee0 con 0x7f131c158c70 2024-09-13T16:01:24.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.997+0000 7f94bfc00640 1 -- start start 2024-09-13T16:01:24.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.996+0000 7fb72d600640 1 -- start start 2024-09-13T16:01:24.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.998+0000 7f5834e00640 1 Processor -- start 2024-09-13T16:01:24.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.998+0000 7f131b400640 1 --2- 172.21.15.70:0/94878870 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f131c158c70 0x7f131c065c90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f130c009870 tx=0x7f130c02a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=314cb3b100203a08 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.998+0000 7fa94d400640 1 Processor -- start 2024-09-13T16:01:25.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.998+0000 7f94bfc00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f94b815c720 0x7f94b80d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.998+0000 7f94bfc00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b80cece0 con 0x7f94b80cde70 2024-09-13T16:01:25.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.998+0000 7f94bfc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b80b1cf0 con 0x7f94b815cb00 2024-09-13T16:01:25.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.998+0000 7f94bfc00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b80ce440 con 0x7f94b815c720 2024-09-13T16:01:25.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.999+0000 7fa94d400640 1 -- start start 2024-09-13T16:01:25.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.999+0000 7f94b7e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f94b815cb00 0x7f94b80cd760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:48576/0 (socket says 172.21.15.70:48576) 2024-09-13T16:01:25.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.999+0000 7f94b7e00640 1 -- 172.21.15.70:0/2139334157 learned_addr learned my addr 172.21.15.70:0/2139334157 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:25.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.999+0000 7f94bd200640 1 --2- 172.21.15.70:0/2139334157 >> v2:172.21.15.70:3300/0 conn(0x7f94b815c720 0x7f94b80d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:24.998+0000 7f5834e00640 1 -- start start 2024-09-13T16:01:25.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7f131a000640 1 -- 172.21.15.70:0/94878870 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c032440 con 0x7f131c158c70 2024-09-13T16:01:25.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7f131a000640 1 -- 172.21.15.70:0/94878870 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c0325a0 con 0x7f131c158c70 2024-09-13T16:01:25.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7f131a000640 1 -- 172.21.15.70:0/94878870 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c032930 con 0x7f131c158c70 2024-09-13T16:01:25.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7fb72d600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb72815c720 0x7fb7280d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7fb72d600640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb7280cde70 0x7fb7280d2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7fb72d600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7280d3330 con 0x7fb72815cb00 2024-09-13T16:01:25.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7fb72d600640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7280cece0 con 0x7fb7280cde70 2024-09-13T16:01:25.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7fb72d600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7280b1cf0 con 0x7fb72815c720 2024-09-13T16:01:25.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7fb727400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb7280cde70 0x7fb7280d2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7fb727400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb7280cde70 0x7fb7280d2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35944/0 (socket says 172.21.15.70:35944) 2024-09-13T16:01:25.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7fb727400640 1 -- 172.21.15.70:0/1156663379 learned_addr learned my addr 172.21.15.70:0/1156663379 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:25.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7f5834e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58300b2c70 0x7f583006fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7f5834e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f58300ce010 0x7f58300b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7f5834e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58300ce450 con 0x7f58300b16a0 2024-09-13T16:01:25.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7f5834e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58300710b0 con 0x7f58300ce010 2024-09-13T16:01:25.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7f5834e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58300cc3e0 con 0x7f58300b2c70 2024-09-13T16:01:25.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7f5826a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f58300ce010 0x7f58300b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.001+0000 7f582f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58300b2c70 0x7f583006fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.001+0000 7f582fe00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f58300b16a0 0x7f58300b1b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:48590/0 (socket says 172.21.15.70:48590) 2024-09-13T16:01:25.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.001+0000 7f582fe00640 1 -- 172.21.15.70:0/3793017944 learned_addr learned my addr 172.21.15.70:0/3793017944 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:25.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.001+0000 7f1322800640 1 -- 172.21.15.70:0/94878870 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f131c158c70 msgr2=0x7f131c065c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.001+0000 7f1322800640 1 --2- 172.21.15.70:0/94878870 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f131c158c70 0x7f131c065c90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f130c009870 tx=0x7f130c02a2a0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7f94bd200640 1 -- 172.21.15.70:0/2139334157 >> v1:172.21.15.107:6789/0 conn(0x7f94b815cb00 legacy=0x7f94b80cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:25.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7f94bd200640 1 -- 172.21.15.70:0/2139334157 >> v1:172.21.15.70:6789/0 conn(0x7f94b80cde70 legacy=0x7f94b80d0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:25.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.000+0000 7f94bd200640 1 -- 172.21.15.70:0/2139334157 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b80ce720 con 0x7f94b815c720 2024-09-13T16:01:25.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.001+0000 7f582ea00640 1 -- 172.21.15.70:0/3793017944 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885572986 0 0) 0x7f5828001490 con 0x7f58300b16a0 2024-09-13T16:01:25.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.001+0000 7f582f400640 1 -- 172.21.15.70:0/3793017944 >> v2:172.21.15.107:3300/0 conn(0x7f58300ce010 msgr2=0x7f58300b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:25.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.001+0000 7f582f400640 1 --2- 172.21.15.70:0/3793017944 >> v2:172.21.15.107:3300/0 conn(0x7f58300ce010 0x7f58300b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.001+0000 7f582f400640 1 -- 172.21.15.70:0/3793017944 >> v1:172.21.15.107:6789/0 conn(0x7f58300b16a0 legacy=0x7f58300b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7fb726a00640 1 --2- 172.21.15.70:0/1156663379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb72815c720 0x7fb7280d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7f1322800640 1 -- 172.21.15.70:0/94878870 shutdown_connections 2024-09-13T16:01:25.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7f1322800640 1 --2- 172.21.15.70:0/94878870 >> v2:172.21.15.107:3300/0 conn(0x7f131c06a330 0x7f131c159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7f1322800640 1 --2- 172.21.15.70:0/94878870 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f131c158c70 0x7f131c065c90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7f1322800640 1 -- 172.21.15.70:0/94878870 >> 172.21.15.70:0/94878870 conn(0x7f131c0ae480 msgr2=0x7f131c0b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7f94bd200640 1 --2- 172.21.15.70:0/2139334157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94b815c720 0x7f94b80d28b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009a00 tx=0x7f94a402a350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba6fc63916e9c86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7f94b7400640 1 -- 172.21.15.70:0/2139334157 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a402ae50 con 0x7f94b815c720 2024-09-13T16:01:25.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7fa94d400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa94806fec0 0x7fa9480ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7f1322800640 1 -- 172.21.15.70:0/94878870 shutdown_connections 2024-09-13T16:01:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7f1322800640 1 -- 172.21.15.70:0/94878870 wait complete. 2024-09-13T16:01:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7fa94d400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa9480cb3d0 0x7fa9480cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7fa94d400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9480710b0 con 0x7fa9480b2c70 2024-09-13T16:01:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7fa94d400640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9480704a0 con 0x7fa9480cb3d0 2024-09-13T16:01:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7fa94d400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa948070780 con 0x7fa94806fec0 2024-09-13T16:01:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7fa947400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa94806fec0 0x7fa9480ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.003+0000 7fa947400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa94806fec0 0x7fa9480ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.70:59556/0 (socket says 172.21.15.70:59556) 2024-09-13T16:01:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.003+0000 7fa947400640 1 -- 172.21.15.70:0/1932370626 learned_addr learned my addr 172.21.15.70:0/1932370626 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:25.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.003+0000 7f94b7400640 1 -- 172.21.15.70:0/2139334157 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a4032440 con 0x7f94b815c720 2024-09-13T16:01:25.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.003+0000 7f94b7400640 1 -- 172.21.15.70:0/2139334157 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a40327d0 con 0x7f94b815c720 2024-09-13T16:01:25.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7f582f400640 1 -- 172.21.15.70:0/3793017944 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58300b3590 con 0x7f58300b2c70 2024-09-13T16:01:25.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.003+0000 7f5826a00640 1 --2- 172.21.15.70:0/3793017944 >> v2:172.21.15.107:3300/0 conn(0x7f58300ce010 0x7f58300b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:25.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7fb727400640 1 -- 172.21.15.70:0/1156663379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb72815c720 msgr2=0x7fb7280d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:25.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7fb727400640 1 --2- 172.21.15.70:0/1156663379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb72815c720 0x7fb7280d28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7fb727400640 1 -- 172.21.15.70:0/1156663379 >> v1:172.21.15.70:6789/0 conn(0x7fb72815cb00 legacy=0x7fb7280cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:25.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.002+0000 7fb727400640 1 -- 172.21.15.70:0/1156663379 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7280d1c40 con 0x7fb7280cde70 2024-09-13T16:01:25.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.003+0000 7fa947400640 1 -- 172.21.15.70:0/1932370626 >> v2:172.21.15.70:3300/0 conn(0x7fa9480cb3d0 msgr2=0x7fa9480cb860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:01:25.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.004+0000 7f582f400640 1 --2- 172.21.15.70:0/3793017944 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58300b2c70 0x7f583006fec0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f58200097a0 tx=0x7f582002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cff1af3cc88c446c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.004+0000 7f94bfc00640 1 -- 172.21.15.70:0/2139334157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94b815c720 msgr2=0x7f94b80d28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.004+0000 7f94bfc00640 1 --2- 172.21.15.70:0/2139334157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94b815c720 0x7f94b80d28b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009a00 tx=0x7f94a402a350 comp rx=0 tx=0).stop 2024-09-13T16:01:25.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.004+0000 7f582ea00640 1 -- 172.21.15.70:0/3793017944 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820032440 con 0x7f58300b2c70 2024-09-13T16:01:25.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.004+0000 7fb727400640 1 --2- 172.21.15.70:0/1156663379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7280cde70 0x7fb7280d2df0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb710009870 tx=0x7fb71002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56009aa0ab4e745b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.004+0000 7f94bfc00640 1 -- 172.21.15.70:0/2139334157 shutdown_connections 2024-09-13T16:01:25.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.005+0000 7f582ea00640 1 -- 172.21.15.70:0/3793017944 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58200325a0 con 0x7f58300b2c70 2024-09-13T16:01:25.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.005+0000 7f582ea00640 1 -- 172.21.15.70:0/3793017944 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820032970 con 0x7f58300b2c70 2024-09-13T16:01:25.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.004+0000 7fa947400640 1 --2- 172.21.15.70:0/1932370626 >> v2:172.21.15.70:3300/0 conn(0x7fa9480cb3d0 0x7fa9480cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.004+0000 7fa947400640 1 -- 172.21.15.70:0/1932370626 >> v1:172.21.15.107:6789/0 conn(0x7fa9480b2c70 legacy=0x7fa9480b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:25.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.004+0000 7fa947400640 1 -- 172.21.15.70:0/1932370626 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa948070a60 con 0x7fa94806fec0 2024-09-13T16:01:25.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.005+0000 7f94bfc00640 1 --2- 172.21.15.70:0/2139334157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94b815c720 0x7f94b80d28b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.005+0000 7f94bfc00640 1 -- 172.21.15.70:0/2139334157 >> 172.21.15.70:0/2139334157 conn(0x7f94b808bf90 msgr2=0x7f94b808c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.005+0000 7f94bfc00640 1 -- 172.21.15.70:0/2139334157 shutdown_connections 2024-09-13T16:01:25.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.005+0000 7f1322800640 1 Processor -- start 2024-09-13T16:01:25.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.005+0000 7fb725600640 1 -- 172.21.15.70:0/1156663379 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710032440 con 0x7fb7280cde70 2024-09-13T16:01:25.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.005+0000 7fa947400640 1 --2- 172.21.15.70:0/1932370626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa94806fec0 0x7fa9480ce010 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa9480683d0 tx=0x7fa93402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11d6e38c9e8f0010 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.005+0000 7f94bfc00640 1 -- 172.21.15.70:0/2139334157 wait complete. 2024-09-13T16:01:25.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.006+0000 7f1322800640 1 -- start start 2024-09-13T16:01:25.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.005+0000 7fb725600640 1 -- 172.21.15.70:0/1156663379 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7100325a0 con 0x7fb7280cde70 2024-09-13T16:01:25.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.005+0000 7fb725600640 1 -- 172.21.15.70:0/1156663379 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710032970 con 0x7fb7280cde70 2024-09-13T16:01:25.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.006+0000 7fa946a00640 1 -- 172.21.15.70:0/1932370626 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934032440 con 0x7fa94806fec0 2024-09-13T16:01:25.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.006+0000 7fa946a00640 1 -- 172.21.15.70:0/1932370626 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9340325a0 con 0x7fa94806fec0 2024-09-13T16:01:25.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.006+0000 7fa946a00640 1 -- 172.21.15.70:0/1932370626 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934032970 con 0x7fa94806fec0 2024-09-13T16:01:25.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.006+0000 7f5834e00640 1 -- 172.21.15.70:0/3793017944 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58300b2c70 msgr2=0x7f583006fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.006+0000 7f5834e00640 1 --2- 172.21.15.70:0/3793017944 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58300b2c70 0x7f583006fec0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f58200097a0 tx=0x7f582002a1a0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.006+0000 7f5834e00640 1 -- 172.21.15.70:0/3793017944 shutdown_connections 2024-09-13T16:01:25.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.006+0000 7fb72d600640 1 -- 172.21.15.70:0/1156663379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7280cde70 msgr2=0x7fb7280d2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.006+0000 7fb72d600640 1 --2- 172.21.15.70:0/1156663379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7280cde70 0x7fb7280d2df0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb710009870 tx=0x7fb71002a1a0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.006+0000 7f5834e00640 1 --2- 172.21.15.70:0/3793017944 >> v2:172.21.15.107:3300/0 conn(0x7f58300ce010 0x7f58300b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.006+0000 7f5834e00640 1 --2- 172.21.15.70:0/3793017944 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58300b2c70 0x7f583006fec0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.007+0000 7fa94d400640 1 -- 172.21.15.70:0/1932370626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa94806fec0 msgr2=0x7fa9480ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.007+0000 7fa94d400640 1 --2- 172.21.15.70:0/1932370626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa94806fec0 0x7fa9480ce010 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa9480683d0 tx=0x7fa93402a250 comp rx=0 tx=0).stop 2024-09-13T16:01:25.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.007+0000 7fb72d600640 1 -- 172.21.15.70:0/1156663379 shutdown_connections 2024-09-13T16:01:25.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.007+0000 7fb72d600640 1 --2- 172.21.15.70:0/1156663379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7280cde70 0x7fb7280d2df0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.007+0000 7fb72d600640 1 --2- 172.21.15.70:0/1156663379 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb72815c720 0x7fb7280d28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.007+0000 7fb72d600640 1 -- 172.21.15.70:0/1156663379 >> 172.21.15.70:0/1156663379 conn(0x7fb72808bf90 msgr2=0x7fb72808c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.007+0000 7fa94d400640 1 -- 172.21.15.70:0/1932370626 shutdown_connections 2024-09-13T16:01:25.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.006+0000 7f5834e00640 1 -- 172.21.15.70:0/3793017944 >> 172.21.15.70:0/3793017944 conn(0x7f58300ae310 msgr2=0x7f58300ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.007+0000 7fa94d400640 1 --2- 172.21.15.70:0/1932370626 >> v2:172.21.15.70:3300/0 conn(0x7fa9480cb3d0 0x7fa9480cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.007+0000 7fb72d600640 1 -- 172.21.15.70:0/1156663379 shutdown_connections 2024-09-13T16:01:25.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.007+0000 7fa94d400640 1 --2- 172.21.15.70:0/1932370626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa94806fec0 0x7fa9480ce010 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.007+0000 7fa94d400640 1 -- 172.21.15.70:0/1932370626 >> 172.21.15.70:0/1932370626 conn(0x7fa9480ae310 msgr2=0x7fa9480ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.007+0000 7fb72d600640 1 -- 172.21.15.70:0/1156663379 wait complete. 2024-09-13T16:01:25.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.007+0000 7f5834e00640 1 -- 172.21.15.70:0/3793017944 shutdown_connections 2024-09-13T16:01:25.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.008+0000 7f1322800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f131c069ed0 0x7f131c143550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.007+0000 7fa94d400640 1 -- 172.21.15.70:0/1932370626 shutdown_connections 2024-09-13T16:01:25.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.008+0000 7fa94d400640 1 -- 172.21.15.70:0/1932370626 wait complete. 2024-09-13T16:01:25.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.008+0000 7f131b400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f131c069ed0 0x7f131c143550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.008+0000 7f131b400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f131c069ed0 0x7f131c143550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35964/0 (socket says 172.21.15.70:35964) 2024-09-13T16:01:25.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.008+0000 7f1322800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f131c06a330 0x7f131c0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.008+0000 7f1322800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f131c158c70 0x7f131c1490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.008+0000 7f94bfc00640 1 Processor -- start 2024-09-13T16:01:25.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.009+0000 7f131b400640 1 -- 172.21.15.70:0/2819606280 learned_addr learned my addr 172.21.15.70:0/2819606280 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:25.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.009+0000 7f1322800640 1 -- 172.21.15.70:0/2819606280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131c143a90 con 0x7f131c069ed0 2024-09-13T16:01:25.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.009+0000 7f1322800640 1 -- 172.21.15.70:0/2819606280 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131c148030 con 0x7f131c158c70 2024-09-13T16:01:25.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.009+0000 7f1322800640 1 -- 172.21.15.70:0/2819606280 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131c148310 con 0x7f131c06a330 2024-09-13T16:01:25.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.009+0000 7f94bfc00640 1 -- start start 2024-09-13T16:01:25.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.009+0000 7f131b400640 1 -- 172.21.15.70:0/2819606280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f131c06a330 msgr2=0x7f131c0cce20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T16:01:25.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.009+0000 7f131aa00640 1 --2- 172.21.15.70:0/2819606280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f131c06a330 0x7f131c0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.009+0000 7f131be00640 1 --2- 172.21.15.70:0/2819606280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f131c158c70 0x7f131c1490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.009+0000 7f131b400640 1 --2- 172.21.15.70:0/2819606280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f131c06a330 0x7f131c0cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.009+0000 7f131b400640 1 -- 172.21.15.70:0/2819606280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f131c158c70 msgr2=0x7f131c1490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.009+0000 7f131b400640 1 --2- 172.21.15.70:0/2819606280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f131c158c70 0x7f131c1490d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.010+0000 7f131b400640 1 -- 172.21.15.70:0/2819606280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c0094d0 con 0x7f131c069ed0 2024-09-13T16:01:25.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.010+0000 7fb72d600640 1 Processor -- start 2024-09-13T16:01:25.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.010+0000 7fb72d600640 1 -- start start 2024-09-13T16:01:25.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.008+0000 7f5834e00640 1 -- 172.21.15.70:0/3793017944 wait complete. 2024-09-13T16:01:25.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.010+0000 7f131b400640 1 --2- 172.21.15.70:0/2819606280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f131c069ed0 0x7f131c143550 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f130c0090b0 tx=0x7f130c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.010+0000 7f5834e00640 1 Processor -- start 2024-09-13T16:01:25.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.010+0000 7f7ddf800640 1 Processor -- start 2024-09-13T16:01:25.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.010+0000 7f1313400640 1 -- 172.21.15.70:0/2819606280 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c03e920 con 0x7f131c069ed0 2024-09-13T16:01:25.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.011+0000 7f1313400640 1 -- 172.21.15.70:0/2819606280 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c03eac0 con 0x7f131c069ed0 2024-09-13T16:01:25.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.011+0000 7f1313400640 1 -- 172.21.15.70:0/2819606280 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c03ee70 con 0x7f131c069ed0 2024-09-13T16:01:25.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.011+0000 7f94bfc00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94b80cde70 0x7f94b80b8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.011+0000 7f94bfc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94b815c720 0x7f94b80afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.011+0000 7f94bfc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94b815cb00 0x7f94b80b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.011+0000 7f94bfc00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b815e170 con 0x7f94b80cde70 2024-09-13T16:01:25.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.011+0000 7f94bfc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8159ae0 con 0x7f94b815cb00 2024-09-13T16:01:25.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.011+0000 7f94bfc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8159dc0 con 0x7f94b815c720 2024-09-13T16:01:25.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.011+0000 7f1322800640 1 -- 172.21.15.70:0/2819606280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131c1485f0 con 0x7f131c069ed0 2024-09-13T16:01:25.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.011+0000 7f1322800640 1 -- 172.21.15.70:0/2819606280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131c148bb0 con 0x7f131c069ed0 2024-09-13T16:01:25.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.011+0000 7f94b7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94b815c720 0x7f94b80afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7f94bd200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94b80cde70 0x7f94b80b8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7f94bd200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94b80cde70 0x7f94b80b8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35978/0 (socket says 172.21.15.70:35978) 2024-09-13T16:01:25.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7f94bd200640 1 -- 172.21.15.70:0/3636951565 learned_addr learned my addr 172.21.15.70:0/3636951565 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:25.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7fb72d600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7280cde70 0x7fb72814ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7fb72d600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb72815c720 0x7fb7280c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7fb72d600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb72815cb00 0x7fb7280cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7fb72d600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7280cca70 con 0x7fb72815cb00 2024-09-13T16:01:25.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7fb72d600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7280b87d0 con 0x7fb7280cde70 2024-09-13T16:01:25.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7fb72d600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72814f440 con 0x7fb72815c720 2024-09-13T16:01:25.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7fa94d400640 1 Processor -- start 2024-09-13T16:01:25.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7fa94d400640 1 -- start start 2024-09-13T16:01:25.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.010+0000 7f5834e00640 1 -- start start 2024-09-13T16:01:25.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7f5834e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58300b16a0 0x7f583015a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7f5834e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58300b2c70 0x7f5830161820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7f5834e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58300ce010 0x7f5830163830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7f5834e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5830161d60 con 0x7f58300b2c70 2024-09-13T16:01:25.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7f5834e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5830162000 con 0x7f58300ce010 2024-09-13T16:01:25.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7f5834e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58301622e0 con 0x7f58300b16a0 2024-09-13T16:01:25.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7f7ddf800640 1 -- start start 2024-09-13T16:01:25.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.012+0000 7f94bdc00640 1 --2- 172.21.15.70:0/3636951565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94b815cb00 0x7f94b80b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.013+0000 7fb726000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb72815c720 0x7fb7280c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.013+0000 7fb726000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb72815c720 0x7fb7280c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:51220/0 (socket says 172.21.15.70:51220) 2024-09-13T16:01:25.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.013+0000 7fb726000640 1 -- 172.21.15.70:0/2404496172 learned_addr learned my addr 172.21.15.70:0/2404496172 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:25.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.013+0000 7fb726a00640 1 --2- 172.21.15.70:0/2404496172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7280cde70 0x7fb72814ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.013+0000 7f582f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58300b16a0 0x7f583015a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.013+0000 7f7e5f200640 1 Processor -- start 2024-09-13T16:01:25.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.014+0000 7f7e5f200640 1 -- start start 2024-09-13T16:01:25.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.013+0000 7f1322800640 1 -- 172.21.15.70:0/2819606280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131c148dd0 con 0x7f131c069ed0 2024-09-13T16:01:25.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.014+0000 7fb726a00640 1 -- 172.21.15.70:0/2404496172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb72815c720 msgr2=0x7fb7280c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.014+0000 7fb726a00640 1 --2- 172.21.15.70:0/2404496172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb72815c720 0x7fb7280c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.014+0000 7fb726a00640 1 -- 172.21.15.70:0/2404496172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb72815cb00 msgr2=0x7fb7280cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.014+0000 7fb726a00640 1 --2- 172.21.15.70:0/2404496172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb72815cb00 0x7fb7280cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.014+0000 7fb726a00640 1 -- 172.21.15.70:0/2404496172 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7100094d0 con 0x7fb7280cde70 2024-09-13T16:01:25.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.014+0000 7f582f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58300b16a0 0x7f583015a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:51212/0 (socket says 172.21.15.70:51212) 2024-09-13T16:01:25.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.013+0000 7f582fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58300ce010 0x7f5830163830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.014+0000 7fa94d400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa94806fec0 0x7fa948163680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.014+0000 7f582fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58300ce010 0x7f5830163830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.70:59598/0 (socket says 172.21.15.70:59598) 2024-09-13T16:01:25.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.013+0000 7f5826a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58300b2c70 0x7f5830161820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.014+0000 7f582f400640 1 -- 172.21.15.70:0/2614621645 learned_addr learned my addr 172.21.15.70:0/2614621645 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:25.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.014+0000 7f7ddf800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7dd80b2a30 0x7f7dd806bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.014+0000 7f7ddf800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7dd80adcb0 0x7f7dd80cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.014+0000 7f7ddf800640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd8070110 con 0x7f7dd8160d10 2024-09-13T16:01:25.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.014+0000 7f7ddf800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd81610f0 con 0x7f7dd80adcb0 2024-09-13T16:01:25.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.014+0000 7f7ddf800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80703f0 con 0x7f7dd80b2a30 2024-09-13T16:01:25.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.014+0000 7fb726a00640 1 --2- 172.21.15.70:0/2404496172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7280cde70 0x7fb72814ef00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb72000e850 tx=0x7fb72000ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7f7dd7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7dd80b2a30 0x7f7dd806bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7f7dd7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7dd80b2a30 0x7f7dd806bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:51234/0 (socket says 172.21.15.70:51234) 2024-09-13T16:01:25.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7f7dd7e00640 1 -- 172.21.15.70:0/143354297 learned_addr learned my addr 172.21.15.70:0/143354297 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:25.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7f582f400640 1 -- 172.21.15.70:0/2614621645 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58300ce010 msgr2=0x7f5830163830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7f582f400640 1 --2- 172.21.15.70:0/2614621645 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58300ce010 0x7f5830163830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7f7ddd800640 1 --2- 172.21.15.70:0/143354297 >> v2:172.21.15.70:3300/0 conn(0x7f7dd80adcb0 0x7f7dd80cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7f582f400640 1 -- 172.21.15.70:0/2614621645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58300b2c70 msgr2=0x7f5830161820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7f582f400640 1 --2- 172.21.15.70:0/2614621645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58300b2c70 0x7f5830161820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7fb71ea00640 1 -- 172.21.15.70:0/2404496172 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7200095b0 con 0x7fb7280cde70 2024-09-13T16:01:25.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7fb71ea00640 1 -- 172.21.15.70:0/2404496172 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72000c940 con 0x7fb7280cde70 2024-09-13T16:01:25.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7fb71ea00640 1 -- 172.21.15.70:0/2404496172 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72000ccd0 con 0x7fb7280cde70 2024-09-13T16:01:25.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7f582f400640 1 -- 172.21.15.70:0/2614621645 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5818009400 con 0x7f58300b16a0 2024-09-13T16:01:25.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7f582fe00640 1 --2- 172.21.15.70:0/2614621645 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58300ce010 0x7f5830163830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:25.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7f7dd7e00640 1 -- 172.21.15.70:0/143354297 >> v2:172.21.15.70:3300/0 conn(0x7f7dd80adcb0 msgr2=0x7f7dd80cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:25.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7f7dd7e00640 1 --2- 172.21.15.70:0/143354297 >> v2:172.21.15.70:3300/0 conn(0x7f7dd80adcb0 0x7f7dd80cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7f7dd7e00640 1 -- 172.21.15.70:0/143354297 >> v1:172.21.15.70:6789/0 conn(0x7f7dd8160d10 legacy=0x7f7dd80b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:25.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7f7dd7e00640 1 -- 172.21.15.70:0/143354297 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd80706d0 con 0x7f7dd80b2a30 2024-09-13T16:01:25.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7fb72d600640 1 -- 172.21.15.70:0/2404496172 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7280b84f0 con 0x7fb7280cde70 2024-09-13T16:01:25.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.016+0000 7fb72d600640 1 -- 172.21.15.70:0/2404496172 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7280cc700 con 0x7fb7280cde70 2024-09-13T16:01:25.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.016+0000 7f1313400640 1 -- 172.21.15.70:0/2819606280 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f130c050430 con 0x7f131c069ed0 2024-09-13T16:01:25.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.016+0000 7f94b7e00640 1 -- 172.21.15.70:0/3636951565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94b815cb00 msgr2=0x7f94b80b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.016+0000 7f94b7e00640 1 --2- 172.21.15.70:0/3636951565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94b815cb00 0x7f94b80b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.016+0000 7f94b7e00640 1 -- 172.21.15.70:0/3636951565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94b80cde70 msgr2=0x7f94b80b8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.016+0000 7f94b7e00640 1 --2- 172.21.15.70:0/3636951565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94b80cde70 0x7f94b80b8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.016+0000 7f94b7e00640 1 -- 172.21.15.70:0/3636951565 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a4009400 con 0x7f94b815c720 2024-09-13T16:01:25.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7f7e5f200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7e5803cb20 0x7f7e580ed6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.015+0000 7f7e5f200640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e58058720 con 0x7f7e58005ce0 2024-09-13T16:01:25.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.016+0000 7f7e5f200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e580540c0 con 0x7f7e580e2d80 2024-09-13T16:01:25.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.016+0000 7f7e5f200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e58057680 con 0x7f7e5803cb20 2024-09-13T16:01:25.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.016+0000 7f582f400640 1 --2- 172.21.15.70:0/2614621645 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58300b16a0 0x7f583015a960 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f58200098c0 tx=0x7f58200046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.016+0000 7f5827e00640 1 -- 172.21.15.70:0/2614621645 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820030b00 con 0x7f58300b16a0 2024-09-13T16:01:25.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.016+0000 7f5827e00640 1 -- 172.21.15.70:0/2614621645 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5820032e90 con 0x7f58300b16a0 2024-09-13T16:01:25.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.016+0000 7f5827e00640 1 -- 172.21.15.70:0/2614621645 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582003c410 con 0x7f58300b16a0 2024-09-13T16:01:25.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.016+0000 7f5834e00640 1 -- 172.21.15.70:0/2614621645 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5820009400 con 0x7f58300b16a0 2024-09-13T16:01:25.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.016+0000 7f5834e00640 1 -- 172.21.15.70:0/2614621645 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58301628a0 con 0x7f58300b16a0 2024-09-13T16:01:25.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.017+0000 7fbfe7e00640 1 Processor -- start 2024-09-13T16:01:25.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.017+0000 7fb72d600640 1 -- 172.21.15.70:0/2404496172 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7280b1fd0 con 0x7fb7280cde70 2024-09-13T16:01:25.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.017+0000 7f5826a00640 1 --2- 172.21.15.70:0/2614621645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58300b2c70 0x7f5830161820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:25.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.017+0000 7fbfe7e00640 1 -- start start 2024-09-13T16:01:25.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.017+0000 7fa947e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa94806fec0 0x7fa948163680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.017+0000 7fa947e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa94806fec0 0x7fa948163680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:51244/0 (socket says 172.21.15.70:51244) 2024-09-13T16:01:25.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.017+0000 7fa94d400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9480b2c70 0x7fa94815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.017+0000 7fa947400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9480b2c70 0x7fa94815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.017+0000 7fa947400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9480b2c70 0x7fa94815b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.70:59614/0 (socket says 172.21.15.70:59614) 2024-09-13T16:01:25.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.017+0000 7fa94d400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9480cb3d0 0x7fa948157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.017+0000 7f94bdc00640 1 --2- 172.21.15.70:0/3636951565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94b815cb00 0x7f94b80b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:25.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.017+0000 7f94b7e00640 1 --2- 172.21.15.70:0/3636951565 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94b815c720 0x7f94b80afc40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00b410 tx=0x7f94ac00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.017+0000 7f7dd7e00640 1 --2- 172.21.15.70:0/143354297 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7dd80b2a30 0x7f7dd806bb60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009870 tx=0x7f7dc802a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c036ea06a9a44f08 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.018+0000 7f94b4c00640 1 -- 172.21.15.70:0/3636951565 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac011830 con 0x7f94b815c720 2024-09-13T16:01:25.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.018+0000 7f94b4c00640 1 -- 172.21.15.70:0/3636951565 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ac011990 con 0x7f94b815c720 2024-09-13T16:01:25.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.018+0000 7f94bfc00640 1 -- 172.21.15.70:0/3636951565 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b815a0a0 con 0x7f94b815c720 2024-09-13T16:01:25.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.018+0000 7fa94ca00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9480cb3d0 0x7fa948157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.018+0000 7fa94ca00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9480cb3d0 0x7fa948157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36032/0 (socket says 172.21.15.70:36032) 2024-09-13T16:01:25.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.017+0000 7f7e5d400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7e580e2d80 0x7f7e580060c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:48612/0 (socket says 172.21.15.70:48612) 2024-09-13T16:01:25.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.018+0000 7f7e5d400640 1 -- 172.21.15.70:0/4036011316 learned_addr learned my addr 172.21.15.70:0/4036011316 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:25.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.018+0000 7f7e5e800640 1 --2- 172.21.15.70:0/4036011316 >> v2:172.21.15.70:3300/0 conn(0x7f7e5803cb20 0x7f7e580ed6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.018+0000 7fa947e00640 1 -- 172.21.15.70:0/2560084171 learned_addr learned my addr 172.21.15.70:0/2560084171 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:25.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.018+0000 7fa94d400640 1 -- 172.21.15.70:0/2560084171 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9481631f0 con 0x7fa9480cb3d0 2024-09-13T16:01:25.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.018+0000 7f94bfc00640 1 -- 172.21.15.70:0/3636951565 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b8159770 con 0x7f94b815c720 2024-09-13T16:01:25.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.018+0000 7f1313400640 1 --2- 172.21.15.70:0/2819606280 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f12fc06acd0 0x7f12fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.018+0000 7fa94d400640 1 -- 172.21.15.70:0/2560084171 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94815b900 con 0x7fa9480b2c70 2024-09-13T16:01:25.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.018+0000 7fa94d400640 1 -- 172.21.15.70:0/2560084171 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94815a770 con 0x7fa94806fec0 2024-09-13T16:01:25.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.018+0000 7f94b4c00640 1 -- 172.21.15.70:0/3636951565 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac011d40 con 0x7f94b815c720 2024-09-13T16:01:25.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.019+0000 7f7dd7400640 1 -- 172.21.15.70:0/143354297 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8032440 con 0x7f7dd80b2a30 2024-09-13T16:01:25.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.019+0000 7f7dd7400640 1 -- 172.21.15.70:0/143354297 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc80325a0 con 0x7f7dd80b2a30 2024-09-13T16:01:25.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.019+0000 7f7dd7400640 1 -- 172.21.15.70:0/143354297 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8032930 con 0x7f7dd80b2a30 2024-09-13T16:01:25.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.019+0000 7fbfe7e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbfe8160260 0x7fbfe80704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.019+0000 7fbfe7e00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe8160820 con 0x7fbfe80b39d0 2024-09-13T16:01:25.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.019+0000 7fbfe7e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe8160b00 con 0x7fbfe80b2e30 2024-09-13T16:01:25.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.019+0000 7fbfe7e00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe815ce80 con 0x7fbfe8160260 2024-09-13T16:01:25.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.019+0000 7fbfde000640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fbfe80b2e30 0x7fbfe815d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:48614/0 (socket says 172.21.15.70:48614) 2024-09-13T16:01:25.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.020+0000 7fbfde000640 1 -- 172.21.15.70:0/1598185883 learned_addr learned my addr 172.21.15.70:0/1598185883 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:25.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.020+0000 7f94bfc00640 1 -- 172.21.15.70:0/3636951565 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9494005250 con 0x7f94b815c720 2024-09-13T16:01:25.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.020+0000 7f131aa00640 1 --2- 172.21.15.70:0/2819606280 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f12fc06acd0 0x7f12fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.020+0000 7fa947e00640 1 -- 172.21.15.70:0/2560084171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9480b2c70 msgr2=0x7fa94815b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.020+0000 7fa947e00640 1 --2- 172.21.15.70:0/2560084171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9480b2c70 0x7fa94815b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.021+0000 7fa947e00640 1 -- 172.21.15.70:0/2560084171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9480cb3d0 msgr2=0x7fa948157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.021+0000 7fa947e00640 1 --2- 172.21.15.70:0/2560084171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9480cb3d0 0x7fa948157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.021+0000 7f1313400640 1 -- 172.21.15.70:0/2819606280 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f130c0aa5e0 con 0x7f131c069ed0 2024-09-13T16:01:25.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.021+0000 7f5834e00640 1 -- 172.21.15.70:0/2614621645 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5830067360 con 0x7f58300b16a0 2024-09-13T16:01:25.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.021+0000 7f131aa00640 1 --2- 172.21.15.70:0/2819606280 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f12fc06acd0 0x7f12fc06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f131c1f1080 tx=0x7f1308009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.021+0000 7fa947e00640 1 -- 172.21.15.70:0/2560084171 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9340094d0 con 0x7fa94806fec0 2024-09-13T16:01:25.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.021+0000 7fa947400640 1 --2- 172.21.15.70:0/2560084171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9480b2c70 0x7fa94815b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:25.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.021+0000 7f7ddf800640 1 -- 172.21.15.70:0/143354297 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7dd80b2a30 msgr2=0x7f7dd806bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.021+0000 7f7ddf800640 1 --2- 172.21.15.70:0/143354297 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7dd80b2a30 0x7f7dd806bb60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009870 tx=0x7f7dc802a200 comp rx=0 tx=0).stop 2024-09-13T16:01:25.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.022+0000 7fa947e00640 1 --2- 172.21.15.70:0/2560084171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa94806fec0 0x7fa948163680 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa93800c430 tx=0x7fa93800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.022+0000 7f7ddf800640 1 -- 172.21.15.70:0/143354297 shutdown_connections 2024-09-13T16:01:25.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.022+0000 7f7ddf800640 1 --2- 172.21.15.70:0/143354297 >> v2:172.21.15.70:3300/0 conn(0x7f7dd80adcb0 0x7f7dd80cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.022+0000 7f7ddf800640 1 --2- 172.21.15.70:0/143354297 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7dd80b2a30 0x7f7dd806bb60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.022+0000 7f7ddf800640 1 -- 172.21.15.70:0/143354297 >> 172.21.15.70:0/143354297 conn(0x7f7dd80b0510 msgr2=0x7f7dd80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.022+0000 7fbfe7400640 1 --2- 172.21.15.70:0/1598185883 >> v2:172.21.15.70:3300/0 conn(0x7fbfe8160260 0x7fbfe80704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.022+0000 7f7ddf800640 1 -- 172.21.15.70:0/143354297 shutdown_connections 2024-09-13T16:01:25.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.022+0000 7f7ddf800640 1 -- 172.21.15.70:0/143354297 wait complete. 2024-09-13T16:01:25.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.022+0000 7f5827e00640 1 -- 172.21.15.70:0/2614621645 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5820039050 con 0x7f58300b16a0 2024-09-13T16:01:25.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.021+0000 7f94b4c00640 1 -- 172.21.15.70:0/3636951565 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f94ac01a400 con 0x7f94b815c720 2024-09-13T16:01:25.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.022+0000 7f94b4c00640 1 --2- 172.21.15.70:0/3636951565 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f949806acd0 0x7f949806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.022+0000 7f94b4c00640 1 -- 172.21.15.70:0/3636951565 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94ac0892d0 con 0x7f94b815c720 2024-09-13T16:01:25.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.021+0000 7fb71ea00640 1 -- 172.21.15.70:0/2404496172 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb720005990 con 0x7fb7280cde70 2024-09-13T16:01:25.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.021+0000 7f7e5e800640 1 -- 172.21.15.70:0/4036011316 >> v1:172.21.15.107:6789/0 conn(0x7f7e580e2d80 legacy=0x7f7e580060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.021+0000 7f7e5e800640 1 -- 172.21.15.70:0/4036011316 >> v1:172.21.15.70:6789/0 conn(0x7f7e58005ce0 legacy=0x7f7e580539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:25.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.021+0000 7f7e5e800640 1 -- 172.21.15.70:0/4036011316 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e58057960 con 0x7f7e5803cb20 2024-09-13T16:01:25.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.023+0000 7f94bd200640 1 --2- 172.21.15.70:0/3636951565 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f949806acd0 0x7f949806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.023+0000 7fbfe7400640 1 -- 172.21.15.70:0/1598185883 >> v1:172.21.15.107:6789/0 conn(0x7fbfe80b2e30 legacy=0x7fbfe815d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.023+0000 7fbfe7400640 1 -- 172.21.15.70:0/1598185883 >> v1:172.21.15.70:6789/0 conn(0x7fbfe80b39d0 legacy=0x7fbfe80b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.023+0000 7fbfe7400640 1 -- 172.21.15.70:0/1598185883 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe8160de0 con 0x7fbfe8160260 2024-09-13T16:01:25.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.023+0000 7f7e5e800640 1 --2- 172.21.15.70:0/4036011316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e5803cb20 0x7f7e580ed6a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7e500097a0 tx=0x7f7e5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f686a0b4a72ae255 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.023+0000 7fb71ea00640 1 --2- 172.21.15.70:0/2404496172 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb70406acd0 0x7fb70406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.023+0000 7fb71ea00640 1 -- 172.21.15.70:0/2404496172 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb720089490 con 0x7fb7280cde70 2024-09-13T16:01:25.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.023+0000 7f5827e00640 1 --2- 172.21.15.70:0/2614621645 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f580c06ac00 0x7f580c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.023+0000 7f5827e00640 1 -- 172.21.15.70:0/2614621645 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58200a9cd0 con 0x7f58300b16a0 2024-09-13T16:01:25.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.024+0000 7f94bd200640 1 --2- 172.21.15.70:0/3636951565 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f949806acd0 0x7f949806d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f94a402a390 tx=0x7f94a402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.024+0000 7f5826a00640 1 --2- 172.21.15.70:0/2614621645 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f580c06ac00 0x7f580c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.024+0000 7fb726000640 1 --2- 172.21.15.70:0/2404496172 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb70406acd0 0x7fb70406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.024+0000 7f5826a00640 1 --2- 172.21.15.70:0/2614621645 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f580c06ac00 0x7f580c06d0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5830164390 tx=0x7f5818008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.025+0000 7fb726000640 1 --2- 172.21.15.70:0/2404496172 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb70406acd0 0x7fb70406d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb7280c6490 tx=0x7fb718009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.025+0000 7fb71ea00640 1 -- 172.21.15.70:0/2404496172 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb720054790 con 0x7fb7280cde70 2024-09-13T16:01:25.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.025+0000 7f7ddf800640 1 Processor -- start 2024-09-13T16:01:25.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.026+0000 7fbfe7400640 1 --2- 172.21.15.70:0/1598185883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfe8160260 0x7fbfe80704c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009d90 tx=0x7fbfe002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c385fd78193198 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.026+0000 7f7ddf800640 1 -- start start 2024-09-13T16:01:25.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.026+0000 7f7e5ca00640 1 -- 172.21.15.70:0/4036011316 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50032440 con 0x7f7e5803cb20 2024-09-13T16:01:25.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.026+0000 7f1313400640 1 -- 172.21.15.70:0/2819606280 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f130c0757a0 con 0x7f131c069ed0 2024-09-13T16:01:25.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.027+0000 7f7e5ca00640 1 -- 172.21.15.70:0/4036011316 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e500325a0 con 0x7f7e5803cb20 2024-09-13T16:01:25.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.027+0000 7fa93fe00640 1 -- 172.21.15.70:0/2560084171 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa938011790 con 0x7fa94806fec0 2024-09-13T16:01:25.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.027+0000 7fa94d400640 1 -- 172.21.15.70:0/2560084171 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9481625e0 con 0x7fa94806fec0 2024-09-13T16:01:25.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.027+0000 7fa94d400640 1 -- 172.21.15.70:0/2560084171 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa948162ba0 con 0x7fa94806fec0 2024-09-13T16:01:25.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.028+0000 7f7e5ca00640 1 -- 172.21.15.70:0/4036011316 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50032930 con 0x7f7e5803cb20 2024-09-13T16:01:25.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.027+0000 7f7ddf800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7dd80adcb0 0x7f7dd814d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.027+0000 7f7ddf800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7dd80b2a30 0x7f7dd80ac410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.027+0000 7f7ddf800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dd8160d10 0x7f7dd8163400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.027+0000 7f7ddf800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd814e340 con 0x7f7dd8160d10 2024-09-13T16:01:25.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.027+0000 7f7ddf800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd814da10 con 0x7f7dd80adcb0 2024-09-13T16:01:25.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.027+0000 7f7ddf800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd814dcf0 con 0x7f7dd80b2a30 2024-09-13T16:01:25.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.028+0000 7f7dd7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7dd80b2a30 0x7f7dd80ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.028+0000 7f7dd7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7dd80b2a30 0x7f7dd80ac410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:51254/0 (socket says 172.21.15.70:51254) 2024-09-13T16:01:25.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.028+0000 7f7dd7e00640 1 -- 172.21.15.70:0/561603145 learned_addr learned my addr 172.21.15.70:0/561603145 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:25.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.027+0000 7fbfe6000640 1 -- 172.21.15.70:0/1598185883 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0007740 con 0x7fbfe8160260 2024-09-13T16:01:25.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.027+0000 7fbfe6000640 1 -- 172.21.15.70:0/1598185883 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe002d050 con 0x7fbfe8160260 2024-09-13T16:01:25.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.027+0000 7fbfe6000640 1 -- 172.21.15.70:0/1598185883 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0007ac0 con 0x7fbfe8160260 2024-09-13T16:01:25.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.028+0000 7f7e5f200640 1 -- 172.21.15.70:0/4036011316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e5803cb20 msgr2=0x7f7e580ed6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.028+0000 7f7e5f200640 1 --2- 172.21.15.70:0/4036011316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e5803cb20 0x7f7e580ed6a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7e500097a0 tx=0x7f7e5002a270 comp rx=0 tx=0).stop 2024-09-13T16:01:25.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.028+0000 7fbfe7e00640 1 -- 172.21.15.70:0/1598185883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfe8160260 msgr2=0x7fbfe80704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.028+0000 7fbfe7e00640 1 --2- 172.21.15.70:0/1598185883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfe8160260 0x7fbfe80704c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009d90 tx=0x7fbfe002a660 comp rx=0 tx=0).stop 2024-09-13T16:01:25.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.028+0000 7f7e5f200640 1 -- 172.21.15.70:0/4036011316 shutdown_connections 2024-09-13T16:01:25.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.028+0000 7f7dd7e00640 1 -- 172.21.15.70:0/561603145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7dd80adcb0 msgr2=0x7f7dd814d240 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T16:01:25.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.028+0000 7f7dd7e00640 1 --2- 172.21.15.70:0/561603145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7dd80adcb0 0x7f7dd814d240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.028+0000 7f7dd7e00640 1 -- 172.21.15.70:0/561603145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dd8160d10 msgr2=0x7f7dd8163400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.028+0000 7f7dd7e00640 1 --2- 172.21.15.70:0/561603145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dd8160d10 0x7f7dd8163400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.028+0000 7f7dd7e00640 1 -- 172.21.15.70:0/561603145 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc80094d0 con 0x7f7dd80b2a30 2024-09-13T16:01:25.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.028+0000 7f7e5f200640 1 --2- 172.21.15.70:0/4036011316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e5803cb20 0x7f7e580ed6a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.028+0000 7fa94d400640 1 -- 172.21.15.70:0/2560084171 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa948163bc0 con 0x7fa94806fec0 2024-09-13T16:01:25.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.029+0000 7f7e5f200640 1 -- 172.21.15.70:0/4036011316 >> 172.21.15.70:0/4036011316 conn(0x7f7e5803a4f0 msgr2=0x7f7e5803a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.029+0000 7f94b4c00640 1 -- 172.21.15.70:0/3636951565 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f94ac054520 con 0x7f94b815c720 2024-09-13T16:01:25.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.029+0000 7fbfe7e00640 1 -- 172.21.15.70:0/1598185883 shutdown_connections 2024-09-13T16:01:25.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.029+0000 7f7e5f200640 1 -- 172.21.15.70:0/4036011316 shutdown_connections 2024-09-13T16:01:25.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.029+0000 7f7dd7e00640 1 --2- 172.21.15.70:0/561603145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7dd80b2a30 0x7f7dd80ac410 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009870 tx=0x7f7dc80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.029+0000 7fbfe7e00640 1 --2- 172.21.15.70:0/1598185883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfe8160260 0x7fbfe80704c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.029+0000 7fbfe7e00640 1 -- 172.21.15.70:0/1598185883 >> 172.21.15.70:0/1598185883 conn(0x7fbfe80b03a0 msgr2=0x7fbfe80b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.029+0000 7fbfe7e00640 1 -- 172.21.15.70:0/1598185883 shutdown_connections 2024-09-13T16:01:25.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.029+0000 7fbfe7e00640 1 -- 172.21.15.70:0/1598185883 wait complete. 2024-09-13T16:01:25.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.029+0000 7f7e5f200640 1 -- 172.21.15.70:0/4036011316 wait complete. 2024-09-13T16:01:25.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.031+0000 7fa93fe00640 1 -- 172.21.15.70:0/2560084171 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa938003800 con 0x7fa94806fec0 2024-09-13T16:01:25.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.031+0000 7f7e5f200640 1 Processor -- start 2024-09-13T16:01:25.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.031+0000 7fbfe7e00640 1 Processor -- start 2024-09-13T16:01:25.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.032+0000 7f5827e00640 1 -- 172.21.15.70:0/2614621645 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5820074f50 con 0x7f58300b16a0 2024-09-13T16:01:25.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.032+0000 7f7dd4c00640 1 -- 172.21.15.70:0/561603145 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8032440 con 0x7f7dd80b2a30 2024-09-13T16:01:25.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.032+0000 7f7dd4c00640 1 -- 172.21.15.70:0/561603145 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc8032e90 con 0x7f7dd80b2a30 2024-09-13T16:01:25.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.032+0000 7f7dd4c00640 1 -- 172.21.15.70:0/561603145 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8030da0 con 0x7f7dd80b2a30 2024-09-13T16:01:25.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.032+0000 7fbfe7e00640 1 -- start start 2024-09-13T16:01:25.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.032+0000 7f7e5f200640 1 -- start start 2024-09-13T16:01:25.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.032+0000 7fa93fe00640 1 -- 172.21.15.70:0/2560084171 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa938011b10 con 0x7fa94806fec0 2024-09-13T16:01:25.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.032+0000 7f7ddf800640 1 -- 172.21.15.70:0/561603145 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd814dfd0 con 0x7f7dd80b2a30 2024-09-13T16:01:25.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.032+0000 7f7ddf800640 1 -- 172.21.15.70:0/561603145 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd80ace40 con 0x7f7dd80b2a30 2024-09-13T16:01:25.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.034+0000 7fbfe7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfe80b2e30 0x7fbfe8145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.034+0000 7fbfe7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfe8160260 0x7fbfe8141b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.034+0000 7fbfe7e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfe80c9820 0x7fbfe80cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.034+0000 7f7e5f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e58005ce0 0x7f7e5817b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.034+0000 7f7e5f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e5803cb20 0x7f7e58052560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.034+0000 7f7e5f200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e580e2d80 0x7f7e580dbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.035+0000 7f7e5de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e58005ce0 0x7f7e5817b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.035+0000 7f7e5de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e58005ce0 0x7f7e5817b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.70:59632/0 (socket says 172.21.15.70:59632) 2024-09-13T16:01:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.034+0000 7fbfe7400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfe80c9820 0x7fbfe80cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.035+0000 7fbfe7e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe8142410 con 0x7fbfe80c9820 2024-09-13T16:01:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.035+0000 7fbfe7e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe80ca0c0 con 0x7fbfe8160260 2024-09-13T16:01:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.035+0000 7fbfe7e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe80ca3a0 con 0x7fbfe80b2e30 2024-09-13T16:01:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.035+0000 7fbfe6a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfe80b2e30 0x7fbfe8145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.035+0000 7fbfe6a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfe80b2e30 0x7fbfe8145000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:51260/0 (socket says 172.21.15.70:51260) 2024-09-13T16:01:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.035+0000 7fbfe6a00640 1 -- 172.21.15.70:0/2206899460 learned_addr learned my addr 172.21.15.70:0/2206899460 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:25.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.035+0000 7fa93fe00640 1 -- 172.21.15.70:0/2560084171 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa938011d30 con 0x7fa94806fec0 2024-09-13T16:01:25.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.035+0000 7f7e5e800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e580e2d80 0x7f7e580dbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.035+0000 7f7e5e800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e580e2d80 0x7f7e580dbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36078/0 (socket says 172.21.15.70:36078) 2024-09-13T16:01:25.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.035+0000 7f7e5d400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e5803cb20 0x7f7e58052560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.035+0000 7f7e5d400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e5803cb20 0x7f7e58052560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:51268/0 (socket says 172.21.15.70:51268) 2024-09-13T16:01:25.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.035+0000 7f7e5de00640 1 -- 172.21.15.70:0/3263622845 learned_addr learned my addr 172.21.15.70:0/3263622845 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:25.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.036+0000 7fbfe6a00640 1 -- 172.21.15.70:0/2206899460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfe8160260 msgr2=0x7fbfe8141b50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T16:01:25.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.036+0000 7fbfe6a00640 1 --2- 172.21.15.70:0/2206899460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfe8160260 0x7fbfe8141b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.036+0000 7fbfe6a00640 1 -- 172.21.15.70:0/2206899460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfe80c9820 msgr2=0x7fbfe80cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.036+0000 7fbfe6a00640 1 --2- 172.21.15.70:0/2206899460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfe80c9820 0x7fbfe80cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.036+0000 7fbfe6a00640 1 -- 172.21.15.70:0/2206899460 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe0009a70 con 0x7fbfe80b2e30 2024-09-13T16:01:25.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.036+0000 7fbfe7400640 1 --2- 172.21.15.70:0/2206899460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfe80c9820 0x7fbfe80cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:25.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.035+0000 7f7e5f200640 1 -- 172.21.15.70:0/3263622845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5817c5f0 con 0x7f7e580e2d80 2024-09-13T16:01:25.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.035+0000 7f7e5f200640 1 -- 172.21.15.70:0/3263622845 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e58052aa0 con 0x7f7e58005ce0 2024-09-13T16:01:25.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.035+0000 7f7e5f200640 1 -- 172.21.15.70:0/3263622845 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5817bd50 con 0x7f7e5803cb20 2024-09-13T16:01:25.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.036+0000 7f7e5e800640 1 -- 172.21.15.70:0/3263622845 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e5803cb20 msgr2=0x7f7e58052560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.036+0000 7f7e5e800640 1 --2- 172.21.15.70:0/3263622845 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e5803cb20 0x7f7e58052560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.036+0000 7fa93fe00640 1 --2- 172.21.15.70:0/2560084171 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa92806ac00 0x7fa92806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.037+0000 7f7e5e800640 1 -- 172.21.15.70:0/3263622845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e58005ce0 msgr2=0x7f7e5817b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.037+0000 7f7e5e800640 1 --2- 172.21.15.70:0/3263622845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e58005ce0 0x7f7e5817b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.037+0000 7f7e5e800640 1 -- 172.21.15.70:0/3263622845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e50009400 con 0x7f7e580e2d80 2024-09-13T16:01:25.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.037+0000 7f7e5de00640 1 --2- 172.21.15.70:0/3263622845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e58005ce0 0x7f7e5817b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:25.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.037+0000 7fa93fe00640 1 -- 172.21.15.70:0/2560084171 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa938089d60 con 0x7fa94806fec0 2024-09-13T16:01:25.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.037+0000 7f7e5e800640 1 --2- 172.21.15.70:0/3263622845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e580e2d80 0x7f7e580dbf40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e58010900 tx=0x7f7e500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.038+0000 7f7e56000640 1 -- 172.21.15.70:0/3263622845 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50032440 con 0x7f7e580e2d80 2024-09-13T16:01:25.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.038+0000 7f7e5f200640 1 -- 172.21.15.70:0/3263622845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5817c030 con 0x7f7e580e2d80 2024-09-13T16:01:25.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.038+0000 7f7e5f200640 1 -- 172.21.15.70:0/3263622845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e580dda70 con 0x7f7e580e2d80 2024-09-13T16:01:25.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.038+0000 7f7e56000640 1 -- 172.21.15.70:0/3263622845 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e50032e90 con 0x7f7e580e2d80 2024-09-13T16:01:25.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.038+0000 7f7e56000640 1 -- 172.21.15.70:0/3263622845 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50030ea0 con 0x7f7e580e2d80 2024-09-13T16:01:25.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.038+0000 7fa947400640 1 --2- 172.21.15.70:0/2560084171 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa92806ac00 0x7fa92806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.039+0000 7f7dd4c00640 1 -- 172.21.15.70:0/561603145 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7dc8039040 con 0x7f7dd80b2a30 2024-09-13T16:01:25.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.040+0000 7f7e5f200640 1 -- 172.21.15.70:0/3263622845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e38005250 con 0x7f7e580e2d80 2024-09-13T16:01:25.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.040+0000 7fbfe6a00640 1 --2- 172.21.15.70:0/2206899460 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfe80b2e30 0x7fbfe8145000 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbfd800c400 tx=0x7fbfd800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.040+0000 7fa93fe00640 1 -- 172.21.15.70:0/2560084171 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa938054ee0 con 0x7fa94806fec0 2024-09-13T16:01:25.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.041+0000 7f7e56000640 1 -- 172.21.15.70:0/3263622845 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7e50039050 con 0x7f7e580e2d80 2024-09-13T16:01:25.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.041+0000 7fa947400640 1 --2- 172.21.15.70:0/2560084171 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa92806ac00 0x7fa92806d0c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa934034000 tx=0x7fa93402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.043+0000 7f7e56000640 1 --2- 172.21.15.70:0/3263622845 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7e4006ac00 0x7f7e4006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.041+0000 7f7dd4c00640 1 --2- 172.21.15.70:0/561603145 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7db406acd0 0x7f7db406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.041+0000 7f7dd4c00640 1 -- 172.21.15.70:0/561603145 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dc80a9e60 con 0x7f7dd80b2a30 2024-09-13T16:01:25.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.042+0000 7f7ddce00640 1 --2- 172.21.15.70:0/561603145 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7db406acd0 0x7f7db406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.043+0000 7f7e56000640 1 -- 172.21.15.70:0/3263622845 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e500a9d90 con 0x7f7e580e2d80 2024-09-13T16:01:25.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.044+0000 7f7e5de00640 1 --2- 172.21.15.70:0/3263622845 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7e4006ac00 0x7f7e4006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.044+0000 7fbfdfe00640 1 -- 172.21.15.70:0/2206899460 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80052d0 con 0x7fbfe80b2e30 2024-09-13T16:01:25.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.044+0000 7fbfdfe00640 1 -- 172.21.15.70:0/2206899460 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd8005430 con 0x7fbfe80b2e30 2024-09-13T16:01:25.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.044+0000 7fbfdfe00640 1 -- 172.21.15.70:0/2206899460 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8007260 con 0x7fbfe80b2e30 2024-09-13T16:01:25.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.044+0000 7f7ddf800640 1 -- 172.21.15.70:0/561603145 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd814e160 con 0x7f7dd80b2a30 2024-09-13T16:01:25.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.044+0000 7fbfe7e00640 1 -- 172.21.15.70:0/2206899460 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe80b1f30 con 0x7fbfe80b2e30 2024-09-13T16:01:25.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.044+0000 7fbfe7e00640 1 -- 172.21.15.70:0/2206899460 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe80ca960 con 0x7fbfe80b2e30 2024-09-13T16:01:25.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.045+0000 7f7e5de00640 1 --2- 172.21.15.70:0/3263622845 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7e4006ac00 0x7f7e4006d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7e60079910 tx=0x7f7e6008af90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.045+0000 7fbfe7e00640 1 -- 172.21.15.70:0/2206899460 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe80b16a0 con 0x7fbfe80b2e30 2024-09-13T16:01:25.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.047+0000 7fbfdfe00640 1 -- 172.21.15.70:0/2206899460 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbfd80073c0 con 0x7fbfe80b2e30 2024-09-13T16:01:25.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.048+0000 7fbfdfe00640 1 --2- 172.21.15.70:0/2206899460 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fbfc406acd0 0x7fbfc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.049+0000 7f7ddce00640 1 --2- 172.21.15.70:0/561603145 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7db406acd0 0x7f7db406d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000abb0 tx=0x7f7dd0009250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.049+0000 7fbfdfe00640 1 -- 172.21.15.70:0/2206899460 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfd8088740 con 0x7fbfe80b2e30 2024-09-13T16:01:25.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.049+0000 7fbfde000640 1 --2- 172.21.15.70:0/2206899460 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fbfc406acd0 0x7fbfc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.050+0000 7f7e56000640 1 -- 172.21.15.70:0/3263622845 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7e50075010 con 0x7f7e580e2d80 2024-09-13T16:01:25.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.051+0000 7fbfde000640 1 --2- 172.21.15.70:0/2206899460 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fbfc406acd0 0x7fbfc406d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbfe81f5480 tx=0x7fbfd0007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.054+0000 7fbfdfe00640 1 -- 172.21.15.70:0/2206899460 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbfd8053990 con 0x7fbfe80b2e30 2024-09-13T16:01:25.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.057+0000 7f7dd4c00640 1 -- 172.21.15.70:0/561603145 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7dc8075020 con 0x7f7dd80b2a30 2024-09-13T16:01:25.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.414+0000 7fb72d600640 1 -- 172.21.15.70:0/2404496172 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb7280b0bf0 con 0x7fb7280cde70 2024-09-13T16:01:25.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.415+0000 7fb71ea00640 1 -- 172.21.15.70:0/2404496172 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb720021020 con 0x7fb7280cde70 2024-09-13T16:01:25.417 INFO:teuthology.orchestra.run.smithi070.stdout:55834574852 2024-09-13T16:01:25.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.419+0000 7fb72d600640 1 -- 172.21.15.70:0/2404496172 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb70406acd0 msgr2=0x7fb70406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.419+0000 7fb72d600640 1 --2- 172.21.15.70:0/2404496172 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb70406acd0 0x7fb70406d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb7280c6490 tx=0x7fb718009040 comp rx=0 tx=0).stop 2024-09-13T16:01:25.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.419+0000 7fb72d600640 1 -- 172.21.15.70:0/2404496172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7280cde70 msgr2=0x7fb72814ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.419+0000 7fb72d600640 1 --2- 172.21.15.70:0/2404496172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7280cde70 0x7fb72814ef00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb72000e850 tx=0x7fb72000ed10 comp rx=0 tx=0).stop 2024-09-13T16:01:25.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.420+0000 7fb72d600640 1 -- 172.21.15.70:0/2404496172 shutdown_connections 2024-09-13T16:01:25.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.420+0000 7fb72d600640 1 --2- 172.21.15.70:0/2404496172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb72815cb00 0x7fb7280cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.420+0000 7fb72d600640 1 --2- 172.21.15.70:0/2404496172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb72815c720 0x7fb7280c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.420+0000 7fb72d600640 1 --2- 172.21.15.70:0/2404496172 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb70406acd0 0x7fb70406d190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.420+0000 7fb72d600640 1 --2- 172.21.15.70:0/2404496172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7280cde70 0x7fb72814ef00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.420+0000 7fb72d600640 1 -- 172.21.15.70:0/2404496172 >> 172.21.15.70:0/2404496172 conn(0x7fb72808bf90 msgr2=0x7fb7280b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.421+0000 7fb72d600640 1 -- 172.21.15.70:0/2404496172 shutdown_connections 2024-09-13T16:01:25.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.421+0000 7fb72d600640 1 -- 172.21.15.70:0/2404496172 wait complete. 2024-09-13T16:01:25.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.424+0000 7f1322800640 1 -- 172.21.15.70:0/2819606280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f131c065c90 con 0x7f131c069ed0 2024-09-13T16:01:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.425+0000 7f1313400640 1 -- 172.21.15.70:0/2819606280 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f130c078dc0 con 0x7f131c069ed0 2024-09-13T16:01:25.426 INFO:teuthology.orchestra.run.smithi070.stdout:55834574853 2024-09-13T16:01:25.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.429+0000 7f1322800640 1 -- 172.21.15.70:0/2819606280 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f12fc06acd0 msgr2=0x7f12fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.429+0000 7f1322800640 1 --2- 172.21.15.70:0/2819606280 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f12fc06acd0 0x7f12fc06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f131c1f1080 tx=0x7f1308009040 comp rx=0 tx=0).stop 2024-09-13T16:01:25.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.429+0000 7f1322800640 1 -- 172.21.15.70:0/2819606280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f131c069ed0 msgr2=0x7f131c143550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.429+0000 7f1322800640 1 --2- 172.21.15.70:0/2819606280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f131c069ed0 0x7f131c143550 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f130c0090b0 tx=0x7f130c0046c0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.430+0000 7f94bfc00640 1 -- 172.21.15.70:0/3636951565 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9494005500 con 0x7f94b815c720 2024-09-13T16:01:25.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.430+0000 7f1322800640 1 -- 172.21.15.70:0/2819606280 shutdown_connections 2024-09-13T16:01:25.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.430+0000 7f1322800640 1 --2- 172.21.15.70:0/2819606280 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f12fc06acd0 0x7f12fc06d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.430+0000 7f1322800640 1 --2- 172.21.15.70:0/2819606280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f131c158c70 0x7f131c1490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.430+0000 7f1322800640 1 --2- 172.21.15.70:0/2819606280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f131c06a330 0x7f131c0cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.430+0000 7f1322800640 1 --2- 172.21.15.70:0/2819606280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f131c069ed0 0x7f131c143550 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.430+0000 7f1322800640 1 -- 172.21.15.70:0/2819606280 >> 172.21.15.70:0/2819606280 conn(0x7f131c0ae480 msgr2=0x7f131c06c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.430+0000 7f1322800640 1 -- 172.21.15.70:0/2819606280 shutdown_connections 2024-09-13T16:01:25.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.430+0000 7f1322800640 1 -- 172.21.15.70:0/2819606280 wait complete. 2024-09-13T16:01:25.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.431+0000 7f94b4c00640 1 -- 172.21.15.70:0/3636951565 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94ac057b40 con 0x7f94b815c720 2024-09-13T16:01:25.433 INFO:teuthology.orchestra.run.smithi070.stdout:55834574852 2024-09-13T16:01:25.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.432+0000 7f5834e00640 1 -- 172.21.15.70:0/2614621645 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f58300b00d0 con 0x7f58300b16a0 2024-09-13T16:01:25.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.432+0000 7f5827e00640 1 -- 172.21.15.70:0/2614621645 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f582004c090 con 0x7f58300b16a0 2024-09-13T16:01:25.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.435+0000 7f94bfc00640 1 -- 172.21.15.70:0/3636951565 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f949806acd0 msgr2=0x7f949806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.435+0000 7f94bfc00640 1 --2- 172.21.15.70:0/3636951565 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f949806acd0 0x7f949806d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f94a402a390 tx=0x7f94a402e000 comp rx=0 tx=0).stop 2024-09-13T16:01:25.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.435+0000 7f94bfc00640 1 -- 172.21.15.70:0/3636951565 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94b815c720 msgr2=0x7f94b80afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.435+0000 7f94bfc00640 1 --2- 172.21.15.70:0/3636951565 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94b815c720 0x7f94b80afc40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00b410 tx=0x7f94ac00b8d0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.437 INFO:teuthology.orchestra.run.smithi070.stdout:55834574855 2024-09-13T16:01:25.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.436+0000 7f94bfc00640 1 -- 172.21.15.70:0/3636951565 shutdown_connections 2024-09-13T16:01:25.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.436+0000 7f94bfc00640 1 --2- 172.21.15.70:0/3636951565 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f949806acd0 0x7f949806d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.436+0000 7f94bfc00640 1 --2- 172.21.15.70:0/3636951565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94b815cb00 0x7f94b80b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.436+0000 7f94bfc00640 1 --2- 172.21.15.70:0/3636951565 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94b815c720 0x7f94b80afc40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.436+0000 7f94bfc00640 1 --2- 172.21.15.70:0/3636951565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94b80cde70 0x7f94b80b8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.436+0000 7f94bfc00640 1 -- 172.21.15.70:0/3636951565 >> 172.21.15.70:0/3636951565 conn(0x7f94b808bf90 msgr2=0x7f94b80cd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.436+0000 7f94bfc00640 1 -- 172.21.15.70:0/3636951565 shutdown_connections 2024-09-13T16:01:25.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.436+0000 7f94bfc00640 1 -- 172.21.15.70:0/3636951565 wait complete. 2024-09-13T16:01:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.439+0000 7f5834e00640 1 -- 172.21.15.70:0/2614621645 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f580c06ac00 msgr2=0x7f580c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.439+0000 7f5834e00640 1 --2- 172.21.15.70:0/2614621645 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f580c06ac00 0x7f580c06d0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5830164390 tx=0x7f5818008040 comp rx=0 tx=0).stop 2024-09-13T16:01:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.439+0000 7f5834e00640 1 -- 172.21.15.70:0/2614621645 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58300b16a0 msgr2=0x7f583015a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.439+0000 7f5834e00640 1 --2- 172.21.15.70:0/2614621645 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58300b16a0 0x7f583015a960 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f58200098c0 tx=0x7f58200046c0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.439+0000 7f5834e00640 1 -- 172.21.15.70:0/2614621645 shutdown_connections 2024-09-13T16:01:25.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.439+0000 7f5834e00640 1 --2- 172.21.15.70:0/2614621645 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f580c06ac00 0x7f580c06d0c0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5830164390 tx=0x7f5818008040 comp rx=0 tx=0).stop 2024-09-13T16:01:25.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.439+0000 7f5834e00640 1 --2- 172.21.15.70:0/2614621645 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58300ce010 0x7f5830163830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.439+0000 7f5834e00640 1 --2- 172.21.15.70:0/2614621645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58300b2c70 0x7f5830161820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.439+0000 7f5834e00640 1 --2- 172.21.15.70:0/2614621645 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58300b16a0 0x7f583015a960 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.439+0000 7f5834e00640 1 -- 172.21.15.70:0/2614621645 >> 172.21.15.70:0/2614621645 conn(0x7f58300ae310 msgr2=0x7f58300aedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.440+0000 7f5834e00640 1 -- 172.21.15.70:0/2614621645 shutdown_connections 2024-09-13T16:01:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.440+0000 7f5834e00640 1 -- 172.21.15.70:0/2614621645 wait complete. 2024-09-13T16:01:25.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.446+0000 7fa94d400640 1 -- 172.21.15.70:0/2560084171 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa948067360 con 0x7fa94806fec0 2024-09-13T16:01:25.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.446+0000 7f7e5f200640 1 -- 172.21.15.70:0/3263622845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7e38005500 con 0x7f7e580e2d80 2024-09-13T16:01:25.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.446+0000 7fa93fe00640 1 -- 172.21.15.70:0/2560084171 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa938058500 con 0x7fa94806fec0 2024-09-13T16:01:25.448 INFO:teuthology.orchestra.run.smithi070.stdout:55834574852 2024-09-13T16:01:25.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-09-13T16:01:25.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.450+0000 7f7e56000640 1 -- 172.21.15.70:0/3263622845 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7e50037090 con 0x7f7e580e2d80 2024-09-13T16:01:25.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.450+0000 7fa94d400640 1 -- 172.21.15.70:0/2560084171 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa92806ac00 msgr2=0x7fa92806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.450+0000 7fa94d400640 1 --2- 172.21.15.70:0/2560084171 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa92806ac00 0x7fa92806d0c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa934034000 tx=0x7fa93402e000 comp rx=0 tx=0).stop 2024-09-13T16:01:25.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.450+0000 7fa94d400640 1 -- 172.21.15.70:0/2560084171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa94806fec0 msgr2=0x7fa948163680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.450+0000 7fa94d400640 1 --2- 172.21.15.70:0/2560084171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa94806fec0 0x7fa948163680 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa93800c430 tx=0x7fa93800c8f0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.450+0000 7fa94d400640 1 -- 172.21.15.70:0/2560084171 shutdown_connections 2024-09-13T16:01:25.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.450+0000 7fa94d400640 1 --2- 172.21.15.70:0/2560084171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9480cb3d0 0x7fa948157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.451+0000 7fa94d400640 1 --2- 172.21.15.70:0/2560084171 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa92806ac00 0x7fa92806d0c0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa934034000 tx=0x7fa93402e000 comp rx=0 tx=0).stop 2024-09-13T16:01:25.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.451+0000 7fa94d400640 1 --2- 172.21.15.70:0/2560084171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9480b2c70 0x7fa94815b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.451+0000 7fa94d400640 1 --2- 172.21.15.70:0/2560084171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa94806fec0 0x7fa948163680 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.451+0000 7fa94d400640 1 -- 172.21.15.70:0/2560084171 >> 172.21.15.70:0/2560084171 conn(0x7fa9480ae310 msgr2=0x7fa94806b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.453 INFO:teuthology.orchestra.run.smithi070.stdout:55834574853 2024-09-13T16:01:25.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.451+0000 7fa94d400640 1 -- 172.21.15.70:0/2560084171 shutdown_connections 2024-09-13T16:01:25.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.451+0000 7fa94d400640 1 -- 172.21.15.70:0/2560084171 wait complete. 2024-09-13T16:01:25.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.453+0000 7fbfe7e00640 1 -- 172.21.15.70:0/2206899460 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbfe8070710 con 0x7fbfe80b2e30 2024-09-13T16:01:25.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.453+0000 7f7e5f200640 1 -- 172.21.15.70:0/3263622845 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7e4006ac00 msgr2=0x7f7e4006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.453+0000 7f7e5f200640 1 --2- 172.21.15.70:0/3263622845 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7e4006ac00 0x7f7e4006d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7e60079910 tx=0x7f7e6008af90 comp rx=0 tx=0).stop 2024-09-13T16:01:25.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.453+0000 7f7e5f200640 1 -- 172.21.15.70:0/3263622845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e580e2d80 msgr2=0x7f7e580dbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.453+0000 7f7e5f200640 1 --2- 172.21.15.70:0/3263622845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e580e2d80 0x7f7e580dbf40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e58010900 tx=0x7f7e500046c0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.454+0000 7f7e5f200640 1 -- 172.21.15.70:0/3263622845 shutdown_connections 2024-09-13T16:01:25.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.454+0000 7f7e5f200640 1 --2- 172.21.15.70:0/3263622845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e580e2d80 0x7f7e580dbf40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.454+0000 7f7e5f200640 1 --2- 172.21.15.70:0/3263622845 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e5803cb20 0x7f7e58052560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.454+0000 7f7e5f200640 1 --2- 172.21.15.70:0/3263622845 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7e4006ac00 0x7f7e4006d0c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.454+0000 7f7e5f200640 1 --2- 172.21.15.70:0/3263622845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e58005ce0 0x7f7e5817b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.454+0000 7fbfdfe00640 1 -- 172.21.15.70:0/2206899460 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbfd8056fb0 con 0x7fbfe80b2e30 2024-09-13T16:01:25.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.454+0000 7f7e5f200640 1 -- 172.21.15.70:0/3263622845 >> 172.21.15.70:0/3263622845 conn(0x7f7e5803a4f0 msgr2=0x7f7e58007020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.457 INFO:teuthology.orchestra.run.smithi070.stdout:55834574852 2024-09-13T16:01:25.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.454+0000 7f7e5f200640 1 -- 172.21.15.70:0/3263622845 shutdown_connections 2024-09-13T16:01:25.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.454+0000 7f7e5f200640 1 -- 172.21.15.70:0/3263622845 wait complete. 2024-09-13T16:01:25.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.456+0000 7f7ddf800640 1 -- 172.21.15.70:0/561603145 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7dd806bb60 con 0x7f7dd80b2a30 2024-09-13T16:01:25.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.457+0000 7fbfe7e00640 1 -- 172.21.15.70:0/2206899460 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fbfc406acd0 msgr2=0x7fbfc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.457+0000 7f7dd4c00640 1 -- 172.21.15.70:0/561603145 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7dc804b020 con 0x7f7dd80b2a30 2024-09-13T16:01:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.457+0000 7fbfe7e00640 1 --2- 172.21.15.70:0/2206899460 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fbfc406acd0 0x7fbfc406d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbfe81f5480 tx=0x7fbfd0007a40 comp rx=0 tx=0).stop 2024-09-13T16:01:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.457+0000 7fbfe7e00640 1 -- 172.21.15.70:0/2206899460 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfe80b2e30 msgr2=0x7fbfe8145000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.457+0000 7fbfe7e00640 1 --2- 172.21.15.70:0/2206899460 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfe80b2e30 0x7fbfe8145000 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbfd800c400 tx=0x7fbfd800c8c0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.458+0000 7fbfe7e00640 1 -- 172.21.15.70:0/2206899460 shutdown_connections 2024-09-13T16:01:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.458+0000 7fbfe7e00640 1 --2- 172.21.15.70:0/2206899460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfe80c9820 0x7fbfe80cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.458+0000 7fbfe7e00640 1 --2- 172.21.15.70:0/2206899460 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fbfc406acd0 0x7fbfc406d190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.458+0000 7fbfe7e00640 1 --2- 172.21.15.70:0/2206899460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfe8160260 0x7fbfe8141b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.458+0000 7fbfe7e00640 1 --2- 172.21.15.70:0/2206899460 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbfe80b2e30 0x7fbfe8145000 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.458+0000 7fbfe7e00640 1 -- 172.21.15.70:0/2206899460 >> 172.21.15.70:0/2206899460 conn(0x7fbfe80b03a0 msgr2=0x7fbfe80aecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.458+0000 7fbfe7e00640 1 -- 172.21.15.70:0/2206899460 shutdown_connections 2024-09-13T16:01:25.461 INFO:teuthology.orchestra.run.smithi070.stdout:55834574852 2024-09-13T16:01:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.459+0000 7fbfe7e00640 1 -- 172.21.15.70:0/2206899460 wait complete. 2024-09-13T16:01:25.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-09-13T16:01:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.461+0000 7f7ddf800640 1 -- 172.21.15.70:0/561603145 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7db406acd0 msgr2=0x7f7db406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.461+0000 7f7ddf800640 1 --2- 172.21.15.70:0/561603145 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7db406acd0 0x7f7db406d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000abb0 tx=0x7f7dd0009250 comp rx=0 tx=0).stop 2024-09-13T16:01:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.461+0000 7f7ddf800640 1 -- 172.21.15.70:0/561603145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7dd80b2a30 msgr2=0x7f7dd80ac410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.461+0000 7f7ddf800640 1 --2- 172.21.15.70:0/561603145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7dd80b2a30 0x7f7dd80ac410 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009870 tx=0x7f7dc80046c0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-09-13T16:01:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.462+0000 7f7ddf800640 1 -- 172.21.15.70:0/561603145 shutdown_connections 2024-09-13T16:01:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.462+0000 7f7ddf800640 1 --2- 172.21.15.70:0/561603145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dd8160d10 0x7f7dd8163400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.462+0000 7f7ddf800640 1 --2- 172.21.15.70:0/561603145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7dd80b2a30 0x7f7dd80ac410 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.462+0000 7f7ddf800640 1 --2- 172.21.15.70:0/561603145 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7db406acd0 0x7f7db406d190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.462+0000 7f7ddf800640 1 --2- 172.21.15.70:0/561603145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7dd80adcb0 0x7f7dd814d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.462+0000 7f7ddf800640 1 -- 172.21.15.70:0/561603145 >> 172.21.15.70:0/561603145 conn(0x7f7dd80b0510 msgr2=0x7f7dd80b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.462+0000 7f7ddf800640 1 -- 172.21.15.70:0/561603145 shutdown_connections 2024-09-13T16:01:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:25.462+0000 7f7ddf800640 1 -- 172.21.15.70:0/561603145 wait complete. 2024-09-13T16:01:25.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2024-09-13T16:01:25.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-09-13T16:01:25.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-09-13T16:01:25.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-09-13T16:01:25.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-09-13T16:01:26.451 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T16:01:26.463 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T16:01:26.464 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T16:01:26.471 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T16:01:26.477 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T16:01:26.479 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T16:01:26.481 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T16:01:26.483 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T16:01:26.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.703+0000 7f7274800640 1 Processor -- start 2024-09-13T16:01:26.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.703+0000 7f7274800640 1 -- start start 2024-09-13T16:01:26.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.705+0000 7f7274800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f72680eb6f0 0x7f72680edae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.705+0000 7f7274800640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726803cfa0 con 0x7f7268005cf0 2024-09-13T16:01:26.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.705+0000 7f7274800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72680540d0 con 0x7f726803cb60 2024-09-13T16:01:26.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.705+0000 7f7274800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7268057900 con 0x7f72680eb6f0 2024-09-13T16:01:26.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.706+0000 7f7271e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f7268005cf0 0x7f72680539c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39166/0 (socket says 172.21.15.70:39166) 2024-09-13T16:01:26.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.706+0000 7f7272800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f72680eb6f0 0x7f72680edae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.706+0000 7f7272800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f72680eb6f0 0x7f72680edae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36084/0 (socket says 172.21.15.70:36084) 2024-09-13T16:01:26.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.706+0000 7f7272800640 1 -- 172.21.15.70:0/1990085003 learned_addr learned my addr 172.21.15.70:0/1990085003 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:26.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.708+0000 7f7272800640 1 -- 172.21.15.70:0/1990085003 >> v1:172.21.15.107:6789/0 conn(0x7f726803cb60 legacy=0x7f72680060d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.708+0000 7f7272800640 1 -- 172.21.15.70:0/1990085003 >> v1:172.21.15.70:6789/0 conn(0x7f7268005cf0 legacy=0x7f72680539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.708+0000 7f7272800640 1 -- 172.21.15.70:0/1990085003 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7268057be0 con 0x7f72680eb6f0 2024-09-13T16:01:26.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.710+0000 7f7272800640 1 --2- 172.21.15.70:0/1990085003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72680eb6f0 0x7f72680edae0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7260009870 tx=0x7f726002a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbe264a7a91a06f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.710+0000 7f7270a00640 1 -- 172.21.15.70:0/1990085003 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260032440 con 0x7f72680eb6f0 2024-09-13T16:01:26.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.710+0000 7f7270a00640 1 -- 172.21.15.70:0/1990085003 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72600325a0 con 0x7f72680eb6f0 2024-09-13T16:01:26.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.710+0000 7f7270a00640 1 -- 172.21.15.70:0/1990085003 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260032930 con 0x7f72680eb6f0 2024-09-13T16:01:26.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.712+0000 7f7274800640 1 -- 172.21.15.70:0/1990085003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72680eb6f0 msgr2=0x7f72680edae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.712+0000 7f7274800640 1 --2- 172.21.15.70:0/1990085003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72680eb6f0 0x7f72680edae0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7260009870 tx=0x7f726002a290 comp rx=0 tx=0).stop 2024-09-13T16:01:26.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.713+0000 7f7274800640 1 -- 172.21.15.70:0/1990085003 shutdown_connections 2024-09-13T16:01:26.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.713+0000 7f7274800640 1 --2- 172.21.15.70:0/1990085003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72680eb6f0 0x7f72680edae0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.713+0000 7f7274800640 1 -- 172.21.15.70:0/1990085003 >> 172.21.15.70:0/1990085003 conn(0x7f726803a4e0 msgr2=0x7f726803a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:26.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.714+0000 7f7274800640 1 -- 172.21.15.70:0/1990085003 shutdown_connections 2024-09-13T16:01:26.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.714+0000 7f7274800640 1 -- 172.21.15.70:0/1990085003 wait complete. 2024-09-13T16:01:26.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.718+0000 7f7274800640 1 Processor -- start 2024-09-13T16:01:26.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.718+0000 7f7274800640 1 -- start start 2024-09-13T16:01:26.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.720+0000 7f7274800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7268005cf0 0x7f72680d3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.720+0000 7f7274800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f726803cb60 0x7f726804c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.721+0000 7f7274800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72680eb6f0 0x7f726804c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.721+0000 7f7274800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7268051ff0 con 0x7f726803cb60 2024-09-13T16:01:26.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.722+0000 7f7271e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7268005cf0 0x7f72680d3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.722+0000 7f7271e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7268005cf0 0x7f72680d3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.70:59654/0 (socket says 172.21.15.70:59654) 2024-09-13T16:01:26.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.722+0000 7f7271e00640 1 -- 172.21.15.70:0/3480003055 learned_addr learned my addr 172.21.15.70:0/3480003055 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:26.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.722+0000 7f7274800640 1 -- 172.21.15.70:0/3480003055 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7268051d10 con 0x7f7268005cf0 2024-09-13T16:01:26.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.722+0000 7f7274800640 1 -- 172.21.15.70:0/3480003055 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72680e3740 con 0x7f72680eb6f0 2024-09-13T16:01:26.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.722+0000 7f7271400640 1 --2- 172.21.15.70:0/3480003055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f726803cb60 0x7f726804c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.723+0000 7f7272800640 1 --2- 172.21.15.70:0/3480003055 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72680eb6f0 0x7f726804c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.724+0000 7f7271400640 1 -- 172.21.15.70:0/3480003055 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72680eb6f0 msgr2=0x7f726804c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.724+0000 7f7271400640 1 --2- 172.21.15.70:0/3480003055 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72680eb6f0 0x7f726804c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.724+0000 7f7271400640 1 -- 172.21.15.70:0/3480003055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7268005cf0 msgr2=0x7f72680d3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.724+0000 7f7271400640 1 --2- 172.21.15.70:0/3480003055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7268005cf0 0x7f72680d3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.724+0000 7f7271400640 1 -- 172.21.15.70:0/3480003055 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72600094d0 con 0x7f726803cb60 2024-09-13T16:01:26.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.725+0000 7f7271e00640 1 --2- 172.21.15.70:0/3480003055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7268005cf0 0x7f72680d3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:26.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.725+0000 7f7272800640 1 --2- 172.21.15.70:0/3480003055 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72680eb6f0 0x7f726804c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:26.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.726+0000 7f7271400640 1 --2- 172.21.15.70:0/3480003055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f726803cb60 0x7f726804c490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f726c0674f0 tx=0x7f726c067920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.726+0000 7f7266000640 1 -- 172.21.15.70:0/3480003055 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c0925b0 con 0x7f726803cb60 2024-09-13T16:01:26.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.726+0000 7f7266000640 1 -- 172.21.15.70:0/3480003055 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c092750 con 0x7f726803cb60 2024-09-13T16:01:26.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.726+0000 7f7266000640 1 -- 172.21.15.70:0/3480003055 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c092b80 con 0x7f726803cb60 2024-09-13T16:01:26.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.727+0000 7f7274800640 1 -- 172.21.15.70:0/3480003055 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72680e3a20 con 0x7f726803cb60 2024-09-13T16:01:26.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.727+0000 7f7274800640 1 -- 172.21.15.70:0/3480003055 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72680528c0 con 0x7f726803cb60 2024-09-13T16:01:26.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.732+0000 7f7266000640 1 -- 172.21.15.70:0/3480003055 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f726c092ce0 con 0x7f726803cb60 2024-09-13T16:01:26.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.733+0000 7f725f400640 1 -- 172.21.15.70:0/3480003055 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7240005250 con 0x7f726803cb60 2024-09-13T16:01:26.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.733+0000 7f7266000640 1 --2- 172.21.15.70:0/3480003055 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f724c06acd0 0x7f724c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.734+0000 7f7266000640 1 -- 172.21.15.70:0/3480003055 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f726c102d00 con 0x7f726803cb60 2024-09-13T16:01:26.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.735+0000 7f7271e00640 1 --2- 172.21.15.70:0/3480003055 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f724c06acd0 0x7f724c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.738+0000 7f7271e00640 1 --2- 172.21.15.70:0/3480003055 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f724c06acd0 0x7f724c06d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7258000f60 tx=0x7f7258007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.747+0000 7f7266000640 1 -- 172.21.15.70:0/3480003055 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f726c098080 con 0x7f726803cb60 2024-09-13T16:01:26.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.772+0000 7f8696200640 1 Processor -- start 2024-09-13T16:01:26.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.773+0000 7f8696200640 1 -- start start 2024-09-13T16:01:26.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.775+0000 7f8696200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f86900b2d20 0x7f86900cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.775+0000 7f8696200640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869006b830 con 0x7f86900b0d20 2024-09-13T16:01:26.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.775+0000 7f8696200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869006bb10 con 0x7f8690070e60 2024-09-13T16:01:26.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.775+0000 7f8696200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f869006bdf0 con 0x7f86900b2d20 2024-09-13T16:01:26.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.776+0000 7f868ea00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f8690070e60 0x7f86900b2610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:48632/0 (socket says 172.21.15.70:48632) 2024-09-13T16:01:26.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.776+0000 7f868ea00640 1 -- 172.21.15.70:0/1228803691 learned_addr learned my addr 172.21.15.70:0/1228803691 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:26.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.776+0000 7f868fe00640 1 --2- 172.21.15.70:0/1228803691 >> v2:172.21.15.70:3300/0 conn(0x7f86900b2d20 0x7f86900cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.777+0000 7f868e000640 1 -- 172.21.15.70:0/1228803691 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386583705 0 0) 0x7f869006bb10 con 0x7f8690070e60 2024-09-13T16:01:26.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.777+0000 7f868e000640 1 -- 172.21.15.70:0/1228803691 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8674003520 con 0x7f8690070e60 2024-09-13T16:01:26.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.778+0000 7f868e000640 1 -- 172.21.15.70:0/1228803691 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 80461048 0 0) 0x7f8674003520 con 0x7f8690070e60 2024-09-13T16:01:26.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.778+0000 7f868fe00640 1 -- 172.21.15.70:0/1228803691 >> v1:172.21.15.107:6789/0 conn(0x7f8690070e60 legacy=0x7f86900b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.778+0000 7f868fe00640 1 -- 172.21.15.70:0/1228803691 >> v1:172.21.15.70:6789/0 conn(0x7f86900b0d20 legacy=0x7f869006fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.778+0000 7f868fe00640 1 -- 172.21.15.70:0/1228803691 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869006c0d0 con 0x7f86900b2d20 2024-09-13T16:01:26.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.780+0000 7f868fe00640 1 --2- 172.21.15.70:0/1228803691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86900b2d20 0x7f86900cb8d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8688009d90 tx=0x7f868802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80c3619533927ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.780+0000 7f868e000640 1 -- 172.21.15.70:0/1228803691 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c001670 con 0x7f86900b2d20 2024-09-13T16:01:26.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.780+0000 7f868e000640 1 -- 172.21.15.70:0/1228803691 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868802d050 con 0x7f86900b2d20 2024-09-13T16:01:26.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.780+0000 7f868e000640 1 -- 172.21.15.70:0/1228803691 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688007760 con 0x7f86900b2d20 2024-09-13T16:01:26.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.781+0000 7efd6f800640 1 Processor -- start 2024-09-13T16:01:26.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.781+0000 7efd6f800640 1 -- start start 2024-09-13T16:01:26.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.781+0000 7f8696200640 1 -- 172.21.15.70:0/1228803691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86900b2d20 msgr2=0x7f86900cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.781+0000 7f8696200640 1 --2- 172.21.15.70:0/1228803691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86900b2d20 0x7f86900cb8d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8688009d90 tx=0x7f868802a630 comp rx=0 tx=0).stop 2024-09-13T16:01:26.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.782+0000 7f1078400640 1 Processor -- start 2024-09-13T16:01:26.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.782+0000 7f8696200640 1 -- 172.21.15.70:0/1228803691 shutdown_connections 2024-09-13T16:01:26.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.782+0000 7f8696200640 1 --2- 172.21.15.70:0/1228803691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86900b2d20 0x7f86900cb8d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.782+0000 7f8696200640 1 -- 172.21.15.70:0/1228803691 >> 172.21.15.70:0/1228803691 conn(0x7f86900b0200 msgr2=0x7f86900b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:26.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.782+0000 7f1078400640 1 -- start start 2024-09-13T16:01:26.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.782+0000 7f8696200640 1 -- 172.21.15.70:0/1228803691 shutdown_connections 2024-09-13T16:01:26.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.783+0000 7efd6f800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efd6815cb90 0x7efd680b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.783+0000 7efd6f800640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd680d18f0 con 0x7efd680d2d80 2024-09-13T16:01:26.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.783+0000 7efd6f800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6815cf70 con 0x7efd680d2910 2024-09-13T16:01:26.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.783+0000 7efd6f800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd680d34f0 con 0x7efd6815cb90 2024-09-13T16:01:26.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.783+0000 7f8696200640 1 -- 172.21.15.70:0/1228803691 wait complete. 2024-09-13T16:01:26.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.783+0000 7f859b200640 1 Processor -- start 2024-09-13T16:01:26.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.783+0000 7f859b200640 1 -- start start 2024-09-13T16:01:26.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.784+0000 7f7b87e00640 1 Processor -- start 2024-09-13T16:01:26.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.784+0000 7f6879c00640 1 Processor -- start 2024-09-13T16:01:26.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.784+0000 7efd67e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7efd680d2910 0x7efd680d0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:48646/0 (socket says 172.21.15.70:48646) 2024-09-13T16:01:26.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.784+0000 7efd67e00640 1 -- 172.21.15.70:0/3333834442 learned_addr learned my addr 172.21.15.70:0/3333834442 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:26.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.784+0000 7efd6ce00640 1 --2- 172.21.15.70:0/3333834442 >> v2:172.21.15.70:3300/0 conn(0x7efd6815cb90 0x7efd680b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.785+0000 7efd6ce00640 1 -- 172.21.15.70:0/3333834442 >> v1:172.21.15.107:6789/0 conn(0x7efd680d2910 legacy=0x7efd680d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:26.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.785+0000 7efd6ce00640 1 -- 172.21.15.70:0/3333834442 >> v1:172.21.15.70:6789/0 conn(0x7efd680d2d80 legacy=0x7efd680d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.785+0000 7efd6ce00640 1 -- 172.21.15.70:0/3333834442 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd680d3210 con 0x7efd6815cb90 2024-09-13T16:01:26.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.784+0000 7f6879c00640 1 -- start start 2024-09-13T16:01:26.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.785+0000 7f1078400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1070070d80 0x7f10700ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.785+0000 7f1078400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f10701588c0 0x7f10700b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.785+0000 7f1078400640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107015c4a0 con 0x7f107006a9c0 2024-09-13T16:01:26.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.786+0000 7f1078400640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107015cd40 con 0x7f1070070d80 2024-09-13T16:01:26.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.786+0000 7f1078400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10700b32d0 con 0x7f10701588c0 2024-09-13T16:01:26.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.784+0000 7f7b87e00640 1 -- start start 2024-09-13T16:01:26.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.786+0000 7f8696200640 1 Processor -- start 2024-09-13T16:01:26.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.786+0000 7f8696200640 1 -- start start 2024-09-13T16:01:26.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.786+0000 7f1076400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f10701588c0 0x7f10700b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.786+0000 7f1076400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f10701588c0 0x7f10700b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.70:59660/0 (socket says 172.21.15.70:59660) 2024-09-13T16:01:26.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.786+0000 7f1076400640 1 -- 172.21.15.70:0/2692100607 learned_addr learned my addr 172.21.15.70:0/2692100607 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:26.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.786+0000 7efd6ce00640 1 --2- 172.21.15.70:0/3333834442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd6815cb90 0x7efd680b3590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efd60009d90 tx=0x7efd6002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70670a2337fa92a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.786+0000 7f1076400640 1 -- 172.21.15.70:0/2692100607 >> v2:172.21.15.70:3300/0 conn(0x7f1070070d80 msgr2=0x7f10700ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:26.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.787+0000 7f1076400640 1 --2- 172.21.15.70:0/2692100607 >> v2:172.21.15.70:3300/0 conn(0x7f1070070d80 0x7f10700ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.787+0000 7efd67400640 1 -- 172.21.15.70:0/3333834442 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60007740 con 0x7efd6815cb90 2024-09-13T16:01:26.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.787+0000 7efd67400640 1 -- 172.21.15.70:0/3333834442 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6002d050 con 0x7efd6815cb90 2024-09-13T16:01:26.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.787+0000 7efd67400640 1 -- 172.21.15.70:0/3333834442 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60007ac0 con 0x7efd6815cb90 2024-09-13T16:01:26.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.787+0000 7f6879c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68740b2c70 0x7f687406fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.787+0000 7f1076400640 1 -- 172.21.15.70:0/2692100607 >> v1:172.21.15.70:6789/0 conn(0x7f107006a9c0 legacy=0x7f1070070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:26.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7efd6f800640 1 -- 172.21.15.70:0/3333834442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd6815cb90 msgr2=0x7efd680b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7efd6f800640 1 --2- 172.21.15.70:0/3333834442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd6815cb90 0x7efd680b3590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efd60009d90 tx=0x7efd6002a6a0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7f8696200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8690070e60 0x7f86901448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.787+0000 7f1076400640 1 -- 172.21.15.70:0/2692100607 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107015c6f0 con 0x7f10701588c0 2024-09-13T16:01:26.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.787+0000 7f7b87e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7b880b2c70 0x7f7b8806fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.787+0000 7f7b87e00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b880710b0 con 0x7f7b880ce010 2024-09-13T16:01:26.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.787+0000 7f7b87e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b880704a0 con 0x7f7b880cb3d0 2024-09-13T16:01:26.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.787+0000 7f7b87e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b880ce480 con 0x7f7b880b2c70 2024-09-13T16:01:26.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7f7b86000640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f7b880ce010 0x7f7b880b3050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39218/0 (socket says 172.21.15.70:39218) 2024-09-13T16:01:26.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7f7b86000640 1 -- 172.21.15.70:0/3202157179 learned_addr learned my addr 172.21.15.70:0/3202157179 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:26.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7f8696200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86900b0d20 0x7f8690145e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7f8696200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86900b2d20 0x7f86901440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7f8696200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8690145b40 con 0x7f86900b2d20 2024-09-13T16:01:26.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7f8696200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8690144ec0 con 0x7f86900b0d20 2024-09-13T16:01:26.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7efd6f800640 1 -- 172.21.15.70:0/3333834442 shutdown_connections 2024-09-13T16:01:26.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7efd6f800640 1 --2- 172.21.15.70:0/3333834442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd6815cb90 0x7efd680b3590 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7efd6f800640 1 -- 172.21.15.70:0/3333834442 >> 172.21.15.70:0/3333834442 conn(0x7efd6808bf90 msgr2=0x7efd6808c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:26.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7f8696200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86901451a0 con 0x7f8690070e60 2024-09-13T16:01:26.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7f868ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86900b0d20 0x7f8690145e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7f868ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86900b0d20 0x7f8690145e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.70:59674/0 (socket says 172.21.15.70:59674) 2024-09-13T16:01:26.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7f868ea00640 1 -- 172.21.15.70:0/962662058 learned_addr learned my addr 172.21.15.70:0/962662058 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:26.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7f868f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8690070e60 0x7f86901448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7f7b86a00640 1 --2- 172.21.15.70:0/3202157179 >> v2:172.21.15.107:3300/0 conn(0x7f7b880b2c70 0x7f7b8806fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7efd6f800640 1 -- 172.21.15.70:0/3333834442 shutdown_connections 2024-09-13T16:01:26.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.788+0000 7f859b200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8594070b60 0x7f85941596d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7f859b200640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85940ce400 con 0x7f85940b3600 2024-09-13T16:01:26.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7f859b200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85940b1df0 con 0x7f85940ce020 2024-09-13T16:01:26.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7f859b200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8594159c10 con 0x7f8594070b60 2024-09-13T16:01:26.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7f868fe00640 1 --2- 172.21.15.70:0/962662058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86900b2d20 0x7f86901440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7f868ea00640 1 -- 172.21.15.70:0/962662058 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8690070e60 msgr2=0x7f86901448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7f868ea00640 1 --2- 172.21.15.70:0/962662058 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8690070e60 0x7f86901448e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7f868ea00640 1 -- 172.21.15.70:0/962662058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86900b2d20 msgr2=0x7f86901440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7f868ea00640 1 --2- 172.21.15.70:0/962662058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86900b2d20 0x7f86901440b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7f868ea00640 1 -- 172.21.15.70:0/962662058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8688009a70 con 0x7f86900b0d20 2024-09-13T16:01:26.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7efd6f800640 1 -- 172.21.15.70:0/3333834442 wait complete. 2024-09-13T16:01:26.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.787+0000 7f6879c00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f68740cb3d0 0x7f68740cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7f6879200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f68740cb3d0 0x7f68740cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7f6879200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f68740cb3d0 0x7f68740cb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36130/0 (socket says 172.21.15.70:36130) 2024-09-13T16:01:26.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7f6879200640 1 -- 172.21.15.70:0/3699412632 learned_addr learned my addr 172.21.15.70:0/3699412632 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:26.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7f8599e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f85940ce020 0x7f85940b2ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:48660/0 (socket says 172.21.15.70:48660) 2024-09-13T16:01:26.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7f8599e00640 1 -- 172.21.15.70:0/2353784429 learned_addr learned my addr 172.21.15.70:0/2353784429 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:26.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.790+0000 7f6879c00640 1 -- 172.21.15.70:0/3699412632 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68740ce450 con 0x7f68740ce010 2024-09-13T16:01:26.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.790+0000 7f6879c00640 1 -- 172.21.15.70:0/3699412632 --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68740710b0 con 0x7f68740cb3d0 2024-09-13T16:01:26.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7f7b86a00640 1 -- 172.21.15.70:0/3202157179 >> v1:172.21.15.107:6789/0 conn(0x7f7b880cb3d0 legacy=0x7f7b880cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7f7b86a00640 1 -- 172.21.15.70:0/3202157179 >> v1:172.21.15.70:6789/0 conn(0x7f7b880ce010 legacy=0x7f7b880b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7f7b85600640 1 -- 172.21.15.70:0/3202157179 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3499640484 0 0) 0x7f7b880710b0 con 0x7f7b880ce010 2024-09-13T16:01:26.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.789+0000 7f7b86a00640 1 -- 172.21.15.70:0/3202157179 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b88070780 con 0x7f7b880b2c70 2024-09-13T16:01:26.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.790+0000 7f6879c00640 1 -- 172.21.15.70:0/3699412632 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68740704a0 con 0x7f68740b2c70 2024-09-13T16:01:26.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.790+0000 7f6873e00640 1 --2- 172.21.15.70:0/3699412632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68740b2c70 0x7f687406fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.790+0000 7f1076400640 1 --2- 172.21.15.70:0/2692100607 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10701588c0 0x7f10700b1810 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f10700b2a80 tx=0x7f106802a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18e1560b002adb5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.790+0000 7f6873e00640 1 -- 172.21.15.70:0/3699412632 >> v2:172.21.15.70:3300/0 conn(0x7f68740cb3d0 msgr2=0x7f68740cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:26.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.790+0000 7f106fe00640 1 -- 172.21.15.70:0/2692100607 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1068031600 con 0x7f10701588c0 2024-09-13T16:01:26.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.790+0000 7f6873e00640 1 --2- 172.21.15.70:0/3699412632 >> v2:172.21.15.70:3300/0 conn(0x7f68740cb3d0 0x7f68740cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.790+0000 7f8598a00640 1 -- 172.21.15.70:0/2353784429 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172794188 0 0) 0x7f85940b1df0 con 0x7f85940ce020 2024-09-13T16:01:26.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.790+0000 7f8598a00640 1 -- 172.21.15.70:0/2353784429 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f857c003520 con 0x7f85940ce020 2024-09-13T16:01:26.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.790+0000 7f6873e00640 1 -- 172.21.15.70:0/3699412632 >> v1:172.21.15.70:6789/0 conn(0x7f68740ce010 legacy=0x7f68740b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:26.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.790+0000 7f106fe00640 1 -- 172.21.15.70:0/2692100607 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106802d050 con 0x7f10701588c0 2024-09-13T16:01:26.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.791+0000 7f106fe00640 1 -- 172.21.15.70:0/2692100607 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1068031980 con 0x7f10701588c0 2024-09-13T16:01:26.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.791+0000 7f859a800640 1 --2- 172.21.15.70:0/2353784429 >> v2:172.21.15.70:3300/0 conn(0x7f8594070b60 0x7f85941596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.791+0000 7f8598a00640 1 -- 172.21.15.70:0/2353784429 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 586334075 0 0) 0x7f857c003520 con 0x7f85940ce020 2024-09-13T16:01:26.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.791+0000 7f8598a00640 1 -- 172.21.15.70:0/2353784429 >> v2:172.21.15.70:3300/0 conn(0x7f8594070b60 msgr2=0x7f85941596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:26.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.791+0000 7f8598a00640 1 --2- 172.21.15.70:0/2353784429 >> v2:172.21.15.70:3300/0 conn(0x7f8594070b60 0x7f85941596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.791+0000 7f8598a00640 1 -- 172.21.15.70:0/2353784429 >> v1:172.21.15.70:6789/0 conn(0x7f85940b3600 legacy=0x7f85940ad4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.791+0000 7f8598a00640 1 -- 172.21.15.70:0/2353784429 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85940b20d0 con 0x7f85940ce020 2024-09-13T16:01:26.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.792+0000 7f1078400640 1 -- 172.21.15.70:0/2692100607 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10701588c0 msgr2=0x7f10700b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.792+0000 7f1078400640 1 --2- 172.21.15.70:0/2692100607 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10701588c0 0x7f10700b1810 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f10700b2a80 tx=0x7f106802a730 comp rx=0 tx=0).stop 2024-09-13T16:01:26.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.792+0000 7f8598a00640 1 -- 172.21.15.70:0/2353784429 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f8588001670 con 0x7f85940ce020 2024-09-13T16:01:26.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.792+0000 7f8598a00640 1 -- 172.21.15.70:0/2353784429 >> v1:172.21.15.107:6789/0 conn(0x7f85940ce020 legacy=0x7f85940b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.792+0000 7f8598a00640 1 --2- 172.21.15.70:0/2353784429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f857c004b70 0x7f857c003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.792+0000 7f8598a00640 1 --2- 172.21.15.70:0/2353784429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f857c003e60 0x7f857c00d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.792+0000 7f8598a00640 1 --2- 172.21.15.70:0/2353784429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c00d950 0x7f857c00fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.792+0000 7f8598a00640 1 -- 172.21.15.70:0/2353784429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c010500 con 0x7f857c003e60 2024-09-13T16:01:26.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.792+0000 7f8598a00640 1 -- 172.21.15.70:0/2353784429 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c010670 con 0x7f857c00d950 2024-09-13T16:01:26.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.792+0000 7f8598a00640 1 -- 172.21.15.70:0/2353784429 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c010830 con 0x7f857c004b70 2024-09-13T16:01:26.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.791+0000 7f6873e00640 1 -- 172.21.15.70:0/3699412632 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6874070780 con 0x7f68740b2c70 2024-09-13T16:01:26.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.792+0000 7f1078400640 1 -- 172.21.15.70:0/2692100607 shutdown_connections 2024-09-13T16:01:26.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.792+0000 7f1078400640 1 --2- 172.21.15.70:0/2692100607 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10701588c0 0x7f10700b1810 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.792+0000 7f1078400640 1 --2- 172.21.15.70:0/2692100607 >> v2:172.21.15.70:3300/0 conn(0x7f1070070d80 0x7f10700ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.792+0000 7f1078400640 1 -- 172.21.15.70:0/2692100607 >> 172.21.15.70:0/2692100607 conn(0x7f1070069ed0 msgr2=0x7f107006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:26.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.792+0000 7f859a800640 1 --2- 172.21.15.70:0/2353784429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c00d950 0x7f857c00fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.793+0000 7f8599e00640 1 --2- 172.21.15.70:0/2353784429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f857c004b70 0x7f857c003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.790+0000 7f868ea00640 1 --2- 172.21.15.70:0/962662058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86900b0d20 0x7f8690145e20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f867c0011e0 tx=0x7f867c00cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.790+0000 7f8687400640 1 -- 172.21.15.70:0/962662058 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c005ad0 con 0x7f86900b0d20 2024-09-13T16:01:26.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.790+0000 7f8687400640 1 -- 172.21.15.70:0/962662058 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c005c30 con 0x7f86900b0d20 2024-09-13T16:01:26.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.790+0000 7f8687400640 1 -- 172.21.15.70:0/962662058 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c007070 con 0x7f86900b0d20 2024-09-13T16:01:26.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.790+0000 7f8696200640 1 -- 172.21.15.70:0/962662058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8690145480 con 0x7f86900b0d20 2024-09-13T16:01:26.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.791+0000 7f8696200640 1 -- 172.21.15.70:0/962662058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86901445f0 con 0x7f86900b0d20 2024-09-13T16:01:26.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.793+0000 7f8696200640 1 -- 172.21.15.70:0/962662058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8668005250 con 0x7f86900b0d20 2024-09-13T16:01:26.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.793+0000 7f7b86a00640 1 --2- 172.21.15.70:0/3202157179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b880b2c70 0x7f7b8806fec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009720 tx=0x7f7b7802a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1a4e4461a7d87d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.792+0000 7efd6f800640 1 Processor -- start 2024-09-13T16:01:26.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.793+0000 7f859a800640 1 -- 172.21.15.70:0/2353784429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f857c004b70 msgr2=0x7f857c003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:26.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.793+0000 7f859a800640 1 --2- 172.21.15.70:0/2353784429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f857c004b70 0x7f857c003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.793+0000 7f859a800640 1 -- 172.21.15.70:0/2353784429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f857c003e60 msgr2=0x7f857c00d410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:01:26.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.792+0000 7efd6f800640 1 -- start start 2024-09-13T16:01:26.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.793+0000 7f1078400640 1 -- 172.21.15.70:0/2692100607 shutdown_connections 2024-09-13T16:01:26.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.793+0000 7efd6f800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680d2910 0x7efd680c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.793+0000 7efd6f800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd6815cb90 0x7efd68155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.793+0000 7efd6f800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd680b5860 0x7efd680cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.794+0000 7efd6f800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd680b3170 con 0x7efd680d2910 2024-09-13T16:01:26.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.794+0000 7efd6f800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd680ca3f0 con 0x7efd680b5860 2024-09-13T16:01:26.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.794+0000 7efd6f800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd680b68a0 con 0x7efd6815cb90 2024-09-13T16:01:26.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.794+0000 7efd67e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd6815cb90 0x7efd68155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.793+0000 7f6873e00640 1 --2- 172.21.15.70:0/3699412632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68740b2c70 0x7f687406fec0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f68640097a0 tx=0x7f686402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3616417b062c113 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.794+0000 7f6872a00640 1 -- 172.21.15.70:0/3699412632 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6864032440 con 0x7f68740b2c70 2024-09-13T16:01:26.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.794+0000 7f6872a00640 1 -- 172.21.15.70:0/3699412632 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68640325a0 con 0x7f68740b2c70 2024-09-13T16:01:26.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.794+0000 7f6872a00640 1 -- 172.21.15.70:0/3699412632 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6864032970 con 0x7f68740b2c70 2024-09-13T16:01:26.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.793+0000 7f1078400640 1 -- 172.21.15.70:0/2692100607 wait complete. 2024-09-13T16:01:26.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.794+0000 7efd6ce00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680d2910 0x7efd680c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.794+0000 7efd6d800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd680b5860 0x7efd680cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.794+0000 7efd6d800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd680b5860 0x7efd680cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.70:59696/0 (socket says 172.21.15.70:59696) 2024-09-13T16:01:26.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.794+0000 7efd6d800640 1 -- 172.21.15.70:0/201458978 learned_addr learned my addr 172.21.15.70:0/201458978 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:26.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.795+0000 7efd6d800640 1 -- 172.21.15.70:0/201458978 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd6815cb90 msgr2=0x7efd68155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.795+0000 7efd6d800640 1 --2- 172.21.15.70:0/201458978 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd6815cb90 0x7efd68155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.795+0000 7efd6d800640 1 -- 172.21.15.70:0/201458978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680d2910 msgr2=0x7efd680c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.795+0000 7efd6d800640 1 --2- 172.21.15.70:0/201458978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680d2910 0x7efd680c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.795+0000 7efd6d800640 1 -- 172.21.15.70:0/201458978 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd60009a70 con 0x7efd680b5860 2024-09-13T16:01:26.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.794+0000 7f8599400640 1 --2- 172.21.15.70:0/2353784429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f857c003e60 0x7f857c00d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.795+0000 7f859a800640 1 --2- 172.21.15.70:0/2353784429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f857c003e60 0x7f857c00d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.795+0000 7f859a800640 1 -- 172.21.15.70:0/2353784429 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85940b1df0 con 0x7f857c00d950 2024-09-13T16:01:26.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.795+0000 7f8599400640 1 --2- 172.21.15.70:0/2353784429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f857c003e60 0x7f857c00d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:26.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.795+0000 7f6879c00640 1 -- 172.21.15.70:0/3699412632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68740b2c70 msgr2=0x7f687406fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.795+0000 7f6879c00640 1 --2- 172.21.15.70:0/3699412632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68740b2c70 0x7f687406fec0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f68640097a0 tx=0x7f686402a1a0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.795+0000 7efd6d800640 1 --2- 172.21.15.70:0/201458978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd680b5860 0x7efd680cbec0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efd5400c3c0 tx=0x7efd5400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.796+0000 7f1078400640 1 Processor -- start 2024-09-13T16:01:26.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.795+0000 7f6879c00640 1 -- 172.21.15.70:0/3699412632 shutdown_connections 2024-09-13T16:01:26.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.795+0000 7f6879c00640 1 --2- 172.21.15.70:0/3699412632 >> v2:172.21.15.70:3300/0 conn(0x7f68740cb3d0 0x7f68740cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.795+0000 7f6879c00640 1 --2- 172.21.15.70:0/3699412632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68740b2c70 0x7f687406fec0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.795+0000 7f6879c00640 1 -- 172.21.15.70:0/3699412632 >> 172.21.15.70:0/3699412632 conn(0x7f68740ae310 msgr2=0x7f68740ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:26.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.796+0000 7f8687400640 1 -- 172.21.15.70:0/962662058 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f867c0071d0 con 0x7f86900b0d20 2024-09-13T16:01:26.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.796+0000 7f1078400640 1 -- start start 2024-09-13T16:01:26.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.796+0000 7f6879c00640 1 -- 172.21.15.70:0/3699412632 shutdown_connections 2024-09-13T16:01:26.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.796+0000 7f6879c00640 1 -- 172.21.15.70:0/3699412632 wait complete. 2024-09-13T16:01:26.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.797+0000 7f8687400640 1 --2- 172.21.15.70:0/962662058 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f867006ad00 0x7f867006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.797+0000 7f859a800640 1 -- 172.21.15.70:0/2353784429 reap_dead start 2024-09-13T16:01:26.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.797+0000 7f1078400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f107006a9c0 0x7f107016a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.797+0000 7f1078400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1070070d80 0x7f107014ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.797+0000 7f1078400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10701588c0 0x7f107015a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.797+0000 7f1078400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1070159bc0 con 0x7f10701588c0 2024-09-13T16:01:26.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.797+0000 7f1078400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1070158ff0 con 0x7f107006a9c0 2024-09-13T16:01:26.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.797+0000 7f1078400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1070159290 con 0x7f1070070d80 2024-09-13T16:01:26.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.797+0000 7f8687400640 1 -- 172.21.15.70:0/962662058 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f867c0899b0 con 0x7f86900b0d20 2024-09-13T16:01:26.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.797+0000 7f859a800640 1 --2- 172.21.15.70:0/2353784429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c00d950 0x7f857c00fd40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f858400ba10 tx=0x7f857c0047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f563b9dcf70d01f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.797+0000 7f868f400640 1 --2- 172.21.15.70:0/962662058 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f867006ad00 0x7f867006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.797+0000 7f1075000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1070070d80 0x7f107014ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.797+0000 7f1075a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f107006a9c0 0x7f107016a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.797+0000 7f1075000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1070070d80 0x7f107014ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:51334/0 (socket says 172.21.15.70:51334) 2024-09-13T16:01:26.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.797+0000 7f1075000640 1 -- 172.21.15.70:0/4105338371 learned_addr learned my addr 172.21.15.70:0/4105338371 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:26.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.798+0000 7f1076400640 1 --2- 172.21.15.70:0/4105338371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10701588c0 0x7f107015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.798+0000 7f1075000640 1 -- 172.21.15.70:0/4105338371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f107006a9c0 msgr2=0x7f107016a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.798+0000 7f1075000640 1 --2- 172.21.15.70:0/4105338371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f107006a9c0 0x7f107016a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.798+0000 7f1075000640 1 -- 172.21.15.70:0/4105338371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10701588c0 msgr2=0x7f107015a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.798+0000 7f1075000640 1 --2- 172.21.15.70:0/4105338371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10701588c0 0x7f107015a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.798+0000 7f1075000640 1 -- 172.21.15.70:0/4105338371 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1068009b30 con 0x7f1070070d80 2024-09-13T16:01:26.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.798+0000 7f1075a00640 1 --2- 172.21.15.70:0/4105338371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f107006a9c0 0x7f107016a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:26.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.798+0000 7f8598a00640 1 -- 172.21.15.70:0/2353784429 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858402ae00 con 0x7f857c00d950 2024-09-13T16:01:26.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.799+0000 7f868f400640 1 --2- 172.21.15.70:0/962662058 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f867006ad00 0x7f867006d1c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8680001920 tx=0x7f8680009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.799+0000 7f1075000640 1 --2- 172.21.15.70:0/4105338371 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1070070d80 0x7f107014ba40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f105c00b4a0 tx=0x7f105c00b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.799+0000 7efd64c00640 1 -- 172.21.15.70:0/201458978 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd540052d0 con 0x7efd680b5860 2024-09-13T16:01:26.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.799+0000 7efd64c00640 1 -- 172.21.15.70:0/201458978 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd54005430 con 0x7efd680b5860 2024-09-13T16:01:26.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.799+0000 7efd64c00640 1 -- 172.21.15.70:0/201458978 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54007260 con 0x7efd680b5860 2024-09-13T16:01:26.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.799+0000 7f6879c00640 1 Processor -- start 2024-09-13T16:01:26.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.799+0000 7f7b85600640 1 -- 172.21.15.70:0/3202157179 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7802ade0 con 0x7f7b880b2c70 2024-09-13T16:01:26.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.799+0000 7f7b85600640 1 -- 172.21.15.70:0/3202157179 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b78032440 con 0x7f7b880b2c70 2024-09-13T16:01:26.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.799+0000 7f7b85600640 1 -- 172.21.15.70:0/3202157179 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b780327d0 con 0x7f7b880b2c70 2024-09-13T16:01:26.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.798+0000 7f8598a00640 1 -- 172.21.15.70:0/2353784429 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858402e070 con 0x7f857c00d950 2024-09-13T16:01:26.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.798+0000 7f8598a00640 1 -- 172.21.15.70:0/2353784429 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8584034640 con 0x7f857c00d950 2024-09-13T16:01:26.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.799+0000 7f859b200640 1 -- 172.21.15.70:0/2353784429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c00d950 msgr2=0x7f857c00fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.799+0000 7f859b200640 1 --2- 172.21.15.70:0/2353784429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c00d950 0x7f857c00fd40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f858400ba10 tx=0x7f857c0047e0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.800+0000 7f8687400640 1 -- 172.21.15.70:0/962662058 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f867c054c00 con 0x7f86900b0d20 2024-09-13T16:01:26.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.800+0000 7f859b200640 1 -- 172.21.15.70:0/2353784429 shutdown_connections 2024-09-13T16:01:26.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.800+0000 7f859b200640 1 --2- 172.21.15.70:0/2353784429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c00d950 0x7f857c00fd40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.800+0000 7f859b200640 1 -- 172.21.15.70:0/2353784429 >> 172.21.15.70:0/2353784429 conn(0x7f85940ae310 msgr2=0x7f85940ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:26.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.800+0000 7f7b87e00640 1 -- 172.21.15.70:0/3202157179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b880b2c70 msgr2=0x7f7b8806fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.800+0000 7f106d600640 1 -- 172.21.15.70:0/4105338371 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c010610 con 0x7f1070070d80 2024-09-13T16:01:26.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.800+0000 7f859b200640 1 -- 172.21.15.70:0/2353784429 shutdown_connections 2024-09-13T16:01:26.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.799+0000 7efd6f800640 1 -- 172.21.15.70:0/201458978 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd680b6570 con 0x7efd680b5860 2024-09-13T16:01:26.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.799+0000 7efd6f800640 1 -- 172.21.15.70:0/201458978 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd68155b60 con 0x7efd680b5860 2024-09-13T16:01:26.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.800+0000 7f106d600640 1 -- 172.21.15.70:0/4105338371 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c010770 con 0x7f1070070d80 2024-09-13T16:01:26.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.800+0000 7f106d600640 1 -- 172.21.15.70:0/4105338371 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c010b20 con 0x7f1070070d80 2024-09-13T16:01:26.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.800+0000 7f859b200640 1 -- 172.21.15.70:0/2353784429 wait complete. 2024-09-13T16:01:26.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.800+0000 7f7b87e00640 1 --2- 172.21.15.70:0/3202157179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b880b2c70 0x7f7b8806fec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009720 tx=0x7f7b7802a0d0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.799+0000 7f6879c00640 1 -- start start 2024-09-13T16:01:26.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.800+0000 7f6879c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68740b2c70 0x7f68741627c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.800+0000 7f6879c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68740cb3d0 0x7f6874156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.800+0000 7f6879c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68740ce010 0x7f68741e9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.800+0000 7f6879c00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6874154a70 con 0x7f68740b2c70 2024-09-13T16:01:26.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.800+0000 7f6879c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68741e9290 con 0x7f68740cb3d0 2024-09-13T16:01:26.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.800+0000 7f6879c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68741e9b30 con 0x7f68740ce010 2024-09-13T16:01:26.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.801+0000 7f6879200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68740ce010 0x7f68741e9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.801+0000 7f6873400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68740cb3d0 0x7f6874156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.801+0000 7f6873400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68740cb3d0 0x7f6874156e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.70:59710/0 (socket says 172.21.15.70:59710) 2024-09-13T16:01:26.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.801+0000 7f6873400640 1 -- 172.21.15.70:0/859036614 learned_addr learned my addr 172.21.15.70:0/859036614 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:26.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.801+0000 7f7b87e00640 1 -- 172.21.15.70:0/3202157179 shutdown_connections 2024-09-13T16:01:26.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.802+0000 7f1078400640 1 -- 172.21.15.70:0/4105338371 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1070159570 con 0x7f1070070d80 2024-09-13T16:01:26.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.802+0000 7f7b87e00640 1 --2- 172.21.15.70:0/3202157179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b880b2c70 0x7f7b8806fec0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.802+0000 7f7b87e00640 1 -- 172.21.15.70:0/3202157179 >> 172.21.15.70:0/3202157179 conn(0x7f7b880ae310 msgr2=0x7f7b880ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:26.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.802+0000 7f6873400640 1 -- 172.21.15.70:0/859036614 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68740ce010 msgr2=0x7f68741e9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.802+0000 7f6873400640 1 --2- 172.21.15.70:0/859036614 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68740ce010 0x7f68741e9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.802+0000 7f6873400640 1 -- 172.21.15.70:0/859036614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68740b2c70 msgr2=0x7f68741627c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.802+0000 7f6873400640 1 --2- 172.21.15.70:0/859036614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68740b2c70 0x7f68741627c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.802+0000 7f6873400640 1 -- 172.21.15.70:0/859036614 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6864009400 con 0x7f68740cb3d0 2024-09-13T16:01:26.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.802+0000 7f7b87e00640 1 -- 172.21.15.70:0/3202157179 shutdown_connections 2024-09-13T16:01:26.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.802+0000 7f7b87e00640 1 -- 172.21.15.70:0/3202157179 wait complete. 2024-09-13T16:01:26.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.802+0000 7f1078400640 1 -- 172.21.15.70:0/4105338371 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107014bf80 con 0x7f1070070d80 2024-09-13T16:01:26.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.803+0000 7f859b200640 1 Processor -- start 2024-09-13T16:01:26.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.803+0000 7f6873400640 1 --2- 172.21.15.70:0/859036614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68740cb3d0 0x7f6874156e30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f686000c3f0 tx=0x7f686000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.804+0000 7f859b200640 1 -- start start 2024-09-13T16:01:26.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.804+0000 7f686be00640 1 -- 172.21.15.70:0/859036614 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68600052d0 con 0x7f68740cb3d0 2024-09-13T16:01:26.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.804+0000 7f686be00640 1 -- 172.21.15.70:0/859036614 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6860005430 con 0x7f68740cb3d0 2024-09-13T16:01:26.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.804+0000 7f686be00640 1 -- 172.21.15.70:0/859036614 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860003830 con 0x7f68740cb3d0 2024-09-13T16:01:26.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.804+0000 7f7b87e00640 1 Processor -- start 2024-09-13T16:01:26.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.805+0000 7f6879c00640 1 -- 172.21.15.70:0/859036614 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68741577f0 con 0x7f68740cb3d0 2024-09-13T16:01:26.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.805+0000 7f6879c00640 1 -- 172.21.15.70:0/859036614 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68741e97c0 con 0x7f68740cb3d0 2024-09-13T16:01:26.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.805+0000 7f7b87e00640 1 -- start start 2024-09-13T16:01:26.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.803+0000 7efd64c00640 1 -- 172.21.15.70:0/201458978 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efd540073c0 con 0x7efd680b5860 2024-09-13T16:01:26.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.804+0000 7efd6f800640 1 -- 172.21.15.70:0/201458978 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd680b69e0 con 0x7efd680b5860 2024-09-13T16:01:26.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.805+0000 7efd64c00640 1 --2- 172.21.15.70:0/201458978 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efd4806ad00 0x7efd4806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.805+0000 7efd64c00640 1 -- 172.21.15.70:0/201458978 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd54088390 con 0x7efd680b5860 2024-09-13T16:01:26.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.805+0000 7f859b200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c00d950 0x7f85940ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.805+0000 7f859b200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85940a9ec0 0x7f85940cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.805+0000 7f859b200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8594146020 0x7f85941464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.805+0000 7f859b200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8594146a10 con 0x7f8594146020 2024-09-13T16:01:26.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.805+0000 7f859b200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85940c3e90 con 0x7f857c00d950 2024-09-13T16:01:26.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.805+0000 7f859b200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85940c3610 con 0x7f85940a9ec0 2024-09-13T16:01:26.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.806+0000 7f8599e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c00d950 0x7f85940ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.806+0000 7f8599e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c00d950 0x7f85940ab150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.70:59716/0 (socket says 172.21.15.70:59716) 2024-09-13T16:01:26.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.806+0000 7f8599e00640 1 -- 172.21.15.70:0/1208947525 learned_addr learned my addr 172.21.15.70:0/1208947525 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:26.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.806+0000 7f859a800640 1 --2- 172.21.15.70:0/1208947525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8594146020 0x7f85941464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.806+0000 7efd6ce00640 1 --2- 172.21.15.70:0/201458978 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efd4806ad00 0x7efd4806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.806+0000 7f7b87e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b880b2c70 0x7f7b880a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.807+0000 7f1078400640 1 -- 172.21.15.70:0/4105338371 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10700ade50 con 0x7f1070070d80 2024-09-13T16:01:26.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.806+0000 7f8599400640 1 --2- 172.21.15.70:0/1208947525 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85940a9ec0 0x7f85940cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.806+0000 7f859a800640 1 -- 172.21.15.70:0/1208947525 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85940a9ec0 msgr2=0x7f85940cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.806+0000 7f859a800640 1 --2- 172.21.15.70:0/1208947525 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85940a9ec0 0x7f85940cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.806+0000 7f859a800640 1 -- 172.21.15.70:0/1208947525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c00d950 msgr2=0x7f85940ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.806+0000 7f859a800640 1 --2- 172.21.15.70:0/1208947525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c00d950 0x7f85940ab150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.806+0000 7f859a800640 1 -- 172.21.15.70:0/1208947525 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85940c38d0 con 0x7f8594146020 2024-09-13T16:01:26.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.807+0000 7f8599e00640 1 --2- 172.21.15.70:0/1208947525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c00d950 0x7f85940ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:26.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.807+0000 7f859a800640 1 --2- 172.21.15.70:0/1208947525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8594146020 0x7f85941464d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f859415c160 tx=0x7f8584004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.807+0000 7f6879c00640 1 -- 172.21.15.70:0/859036614 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6874067360 con 0x7f68740cb3d0 2024-09-13T16:01:26.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.808+0000 7f858e000640 1 -- 172.21.15.70:0/1208947525 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858403d890 con 0x7f8594146020 2024-09-13T16:01:26.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.808+0000 7f106d600640 1 -- 172.21.15.70:0/4105338371 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f105c010c80 con 0x7f1070070d80 2024-09-13T16:01:26.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.806+0000 7f7b87e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b880cb3d0 0x7f7b88163320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.806+0000 7f7b87e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b880ce010 0x7f7b881f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.806+0000 7f7b87e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b881f75b0 con 0x7f7b880b2c70 2024-09-13T16:01:26.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.806+0000 7f7b87e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8815e7d0 con 0x7f7b880cb3d0 2024-09-13T16:01:26.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.806+0000 7f7b87e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880a8a40 con 0x7f7b880ce010 2024-09-13T16:01:26.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.807+0000 7f7b87400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b880ce010 0x7f7b881f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.807+0000 7f7b87400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b880ce010 0x7f7b881f7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:51356/0 (socket says 172.21.15.70:51356) 2024-09-13T16:01:26.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.807+0000 7f7b87400640 1 -- 172.21.15.70:0/813808646 learned_addr learned my addr 172.21.15.70:0/813808646 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:26.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.807+0000 7f7b86000640 1 --2- 172.21.15.70:0/813808646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b880cb3d0 0x7f7b88163320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.808+0000 7efd6ce00640 1 --2- 172.21.15.70:0/201458978 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efd4806ad00 0x7efd4806d1c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efd60034000 tx=0x7efd6002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.808+0000 7f7b86000640 1 -- 172.21.15.70:0/813808646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b880ce010 msgr2=0x7f7b881f7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.808+0000 7f7b86000640 1 --2- 172.21.15.70:0/813808646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b880ce010 0x7f7b881f7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.808+0000 7f7b86000640 1 -- 172.21.15.70:0/813808646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b880b2c70 msgr2=0x7f7b880a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.808+0000 7f7b86000640 1 --2- 172.21.15.70:0/813808646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b880b2c70 0x7f7b880a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.808+0000 7f7b86000640 1 -- 172.21.15.70:0/813808646 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b78009400 con 0x7f7b880cb3d0 2024-09-13T16:01:26.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.808+0000 7f858e000640 1 -- 172.21.15.70:0/1208947525 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858403d9f0 con 0x7f8594146020 2024-09-13T16:01:26.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.808+0000 7f858e000640 1 -- 172.21.15.70:0/1208947525 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858403dda0 con 0x7f8594146020 2024-09-13T16:01:26.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.808+0000 7f859b200640 1 -- 172.21.15.70:0/1208947525 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85940c3bb0 con 0x7f8594146020 2024-09-13T16:01:26.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.808+0000 7f859b200640 1 -- 172.21.15.70:0/1208947525 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85940aa320 con 0x7f8594146020 2024-09-13T16:01:26.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.809+0000 7f106d600640 1 --2- 172.21.15.70:0/4105338371 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f105006acd0 0x7f105006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.809+0000 7f106d600640 1 -- 172.21.15.70:0/4105338371 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f105c088ec0 con 0x7f1070070d80 2024-09-13T16:01:26.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.810+0000 7f7b86000640 1 --2- 172.21.15.70:0/813808646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b880cb3d0 0x7f7b88163320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000c410 tx=0x7f7b7000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.810+0000 7f1075a00640 1 --2- 172.21.15.70:0/4105338371 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f105006acd0 0x7f105006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.810+0000 7f859b200640 1 -- 172.21.15.70:0/1208947525 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8594067360 con 0x7f8594146020 2024-09-13T16:01:26.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.811+0000 7f858e000640 1 -- 172.21.15.70:0/1208947525 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8584047410 con 0x7f8594146020 2024-09-13T16:01:26.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.811+0000 7efd64c00640 1 -- 172.21.15.70:0/201458978 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efd54053690 con 0x7efd680b5860 2024-09-13T16:01:26.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.812+0000 7f858e000640 1 --2- 172.21.15.70:0/1208947525 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f857806ac30 0x7f857806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.812+0000 7f858e000640 1 -- 172.21.15.70:0/1208947525 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85840a92b0 con 0x7f8594146020 2024-09-13T16:01:26.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.811+0000 7f1075a00640 1 --2- 172.21.15.70:0/4105338371 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f105006acd0 0x7f105006d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1064007fd0 tx=0x7f1064009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.812+0000 7f8599e00640 1 --2- 172.21.15.70:0/1208947525 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f857806ac30 0x7f857806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.813+0000 7f8599e00640 1 --2- 172.21.15.70:0/1208947525 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f857806ac30 0x7f857806d0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8588001e40 tx=0x7f8588009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.813+0000 7f106d600640 1 -- 172.21.15.70:0/4105338371 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f105c0541c0 con 0x7f1070070d80 2024-09-13T16:01:26.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.813+0000 7f686be00640 1 -- 172.21.15.70:0/859036614 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6860003990 con 0x7f68740cb3d0 2024-09-13T16:01:26.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.814+0000 7f7b7f400640 1 -- 172.21.15.70:0/813808646 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b700074e0 con 0x7f7b880cb3d0 2024-09-13T16:01:26.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.815+0000 7f7b7f400640 1 -- 172.21.15.70:0/813808646 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b70007640 con 0x7f7b880cb3d0 2024-09-13T16:01:26.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.815+0000 7f7b7f400640 1 -- 172.21.15.70:0/813808646 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b70004a20 con 0x7f7b880cb3d0 2024-09-13T16:01:26.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.815+0000 7f7b87e00640 1 -- 172.21.15.70:0/813808646 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8815ea90 con 0x7f7b880cb3d0 2024-09-13T16:01:26.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.815+0000 7f686be00640 1 --2- 172.21.15.70:0/859036614 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f685406ac50 0x7f685406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.815+0000 7f686be00640 1 -- 172.21.15.70:0/859036614 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6860088750 con 0x7f68740cb3d0 2024-09-13T16:01:26.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.815+0000 7f686be00640 1 -- 172.21.15.70:0/859036614 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6860088c40 con 0x7f68740cb3d0 2024-09-13T16:01:26.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.815+0000 7f7b87e00640 1 -- 172.21.15.70:0/813808646 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8815f050 con 0x7f7b880cb3d0 2024-09-13T16:01:26.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.816+0000 7f7b87e00640 1 -- 172.21.15.70:0/813808646 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b88067360 con 0x7f7b880cb3d0 2024-09-13T16:01:26.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.817+0000 7f6873e00640 1 --2- 172.21.15.70:0/859036614 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f685406ac50 0x7f685406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.820+0000 7f6873e00640 1 --2- 172.21.15.70:0/859036614 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f685406ac50 0x7f685406d110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6864034000 tx=0x7f686402c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.819+0000 7f7b7f400640 1 -- 172.21.15.70:0/813808646 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7b70004b80 con 0x7f7b880cb3d0 2024-09-13T16:01:26.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.820+0000 7fa8d5c00640 1 Processor -- start 2024-09-13T16:01:26.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.821+0000 7fa8d5c00640 1 -- start start 2024-09-13T16:01:26.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.821+0000 7f7b7f400640 1 --2- 172.21.15.70:0/813808646 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7b6406acd0 0x7f7b6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.821+0000 7f7b7f400640 1 -- 172.21.15.70:0/813808646 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b700896c0 con 0x7f7b880cb3d0 2024-09-13T16:01:26.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.821+0000 7f858e000640 1 -- 172.21.15.70:0/1208947525 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8584074480 con 0x7f8594146020 2024-09-13T16:01:26.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.822+0000 7fa8d5c00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa8d00b2850 0x7fa8d00b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.823+0000 7fa8d5c00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d00d0a10 con 0x7fa8d00d26d0 2024-09-13T16:01:26.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.823+0000 7fa8d5c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d00b3980 con 0x7fa8d015ca90 2024-09-13T16:01:26.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.823+0000 7fa8d5c00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d00b31d0 con 0x7fa8d00b2850 2024-09-13T16:01:26.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.822+0000 7f7b86a00640 1 --2- 172.21.15.70:0/813808646 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7b6406acd0 0x7f7b6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.823+0000 7fa8ce000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa8d00b2850 0x7fa8d00b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.823+0000 7fa8ce000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa8d00b2850 0x7fa8d00b2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36218/0 (socket says 172.21.15.70:36218) 2024-09-13T16:01:26.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.823+0000 7fa8ce000640 1 -- 172.21.15.70:0/2595428249 learned_addr learned my addr 172.21.15.70:0/2595428249 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:26.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.824+0000 7fa8ce000640 1 -- 172.21.15.70:0/2595428249 >> v1:172.21.15.107:6789/0 conn(0x7fa8d015ca90 legacy=0x7fa8d00cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:26.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.824+0000 7fa8ce000640 1 -- 172.21.15.70:0/2595428249 >> v1:172.21.15.70:6789/0 conn(0x7fa8d00d26d0 legacy=0x7fa8d00d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:26.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.824+0000 7f7b86a00640 1 --2- 172.21.15.70:0/813808646 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7b6406acd0 0x7f7b6406d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7b78034000 tx=0x7f7b7802c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.824+0000 7fa8ce000640 1 -- 172.21.15.70:0/2595428249 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d00cdc50 con 0x7fa8d00b2850 2024-09-13T16:01:26.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.824+0000 7f7b7f400640 1 -- 172.21.15.70:0/813808646 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7b70054940 con 0x7f7b880cb3d0 2024-09-13T16:01:26.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.826+0000 7fa8ce000640 1 --2- 172.21.15.70:0/2595428249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8d00b2850 0x7fa8d00b2c90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009870 tx=0x7fa8c002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993ef74104bc2486 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.827+0000 7fa8cd600640 1 -- 172.21.15.70:0/2595428249 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0032440 con 0x7fa8d00b2850 2024-09-13T16:01:26.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.827+0000 7fa8cd600640 1 -- 172.21.15.70:0/2595428249 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c00325a0 con 0x7fa8d00b2850 2024-09-13T16:01:26.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.827+0000 7fa8cd600640 1 -- 172.21.15.70:0/2595428249 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0032930 con 0x7fa8d00b2850 2024-09-13T16:01:26.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.828+0000 7fa8d5c00640 1 -- 172.21.15.70:0/2595428249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8d00b2850 msgr2=0x7fa8d00b2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.828+0000 7fa8d5c00640 1 --2- 172.21.15.70:0/2595428249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8d00b2850 0x7fa8d00b2c90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009870 tx=0x7fa8c002a210 comp rx=0 tx=0).stop 2024-09-13T16:01:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.828+0000 7fa8d5c00640 1 -- 172.21.15.70:0/2595428249 shutdown_connections 2024-09-13T16:01:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.828+0000 7fa8d5c00640 1 --2- 172.21.15.70:0/2595428249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8d00b2850 0x7fa8d00b2c90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.828+0000 7fa8d5c00640 1 -- 172.21.15.70:0/2595428249 >> 172.21.15.70:0/2595428249 conn(0x7fa8d008bf90 msgr2=0x7fa8d008c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.831+0000 7fa8d5c00640 1 -- 172.21.15.70:0/2595428249 shutdown_connections 2024-09-13T16:01:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.831+0000 7fa8d5c00640 1 -- 172.21.15.70:0/2595428249 wait complete. 2024-09-13T16:01:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.833+0000 7fa8d5c00640 1 Processor -- start 2024-09-13T16:01:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.834+0000 7fa8d5c00640 1 -- start start 2024-09-13T16:01:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.835+0000 7fa8d5c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8d00b2850 0x7fa8d015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.835+0000 7fa8d5c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8d00d26d0 0x7fa8d00b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.835+0000 7fa8d5c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8d015ca90 0x7fa8d00c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.835+0000 7fa8d5c00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00b5f30 con 0x7fa8d00d26d0 2024-09-13T16:01:26.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.835+0000 7fa8d5c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d015c3b0 con 0x7fa8d00b2850 2024-09-13T16:01:26.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.835+0000 7fa8d5c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d015ee80 con 0x7fa8d015ca90 2024-09-13T16:01:26.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.836+0000 7fa8cf400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8d015ca90 0x7fa8d00c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.836+0000 7fa8ce000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8d00d26d0 0x7fa8d00b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.836+0000 7fa8cf400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8d015ca90 0x7fa8d00c64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:51370/0 (socket says 172.21.15.70:51370) 2024-09-13T16:01:26.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.836+0000 7fa8cf400640 1 -- 172.21.15.70:0/113644747 learned_addr learned my addr 172.21.15.70:0/113644747 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:26.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.836+0000 7fa8cea00640 1 --2- 172.21.15.70:0/113644747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8d00b2850 0x7fa8d015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.836+0000 7fa8cf400640 1 -- 172.21.15.70:0/113644747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8d00b2850 msgr2=0x7fa8d015b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.836+0000 7fa8cf400640 1 --2- 172.21.15.70:0/113644747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8d00b2850 0x7fa8d015b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.836+0000 7fa8cf400640 1 -- 172.21.15.70:0/113644747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8d00d26d0 msgr2=0x7fa8d00b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.836+0000 7fa8cf400640 1 --2- 172.21.15.70:0/113644747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8d00d26d0 0x7fa8d00b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.836+0000 7fa8cf400640 1 -- 172.21.15.70:0/113644747 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c00094d0 con 0x7fa8d015ca90 2024-09-13T16:01:26.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.837+0000 7fa8cf400640 1 --2- 172.21.15.70:0/113644747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8d015ca90 0x7fa8d00c64d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800c3a0 tx=0x7fa8b800c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.837+0000 7fa8c6a00640 1 -- 172.21.15.70:0/113644747 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b80052d0 con 0x7fa8d015ca90 2024-09-13T16:01:26.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.837+0000 7fa8c6a00640 1 -- 172.21.15.70:0/113644747 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b8005430 con 0x7fa8d015ca90 2024-09-13T16:01:26.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.838+0000 7fa8c6a00640 1 -- 172.21.15.70:0/113644747 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b80052d0 con 0x7fa8d015ca90 2024-09-13T16:01:26.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.838+0000 7fa8d5c00640 1 -- 172.21.15.70:0/113644747 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d015f160 con 0x7fa8d015ca90 2024-09-13T16:01:26.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.838+0000 7fa8d5c00640 1 -- 172.21.15.70:0/113644747 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d00b5b50 con 0x7fa8d015ca90 2024-09-13T16:01:26.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.839+0000 7fa8d5c00640 1 -- 172.21.15.70:0/113644747 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d00b6070 con 0x7fa8d015ca90 2024-09-13T16:01:26.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.841+0000 7fa8c6a00640 1 -- 172.21.15.70:0/113644747 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa8b80035f0 con 0x7fa8d015ca90 2024-09-13T16:01:26.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.842+0000 7fa8c6a00640 1 --2- 172.21.15.70:0/113644747 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa8ac06ac60 0x7fa8ac06d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.842+0000 7fa8c6a00640 1 -- 172.21.15.70:0/113644747 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8b80683d0 con 0x7fa8d015ca90 2024-09-13T16:01:26.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.843+0000 7fa8cea00640 1 --2- 172.21.15.70:0/113644747 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa8ac06ac60 0x7fa8ac06d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.844+0000 7fa8cea00640 1 --2- 172.21.15.70:0/113644747 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa8ac06ac60 0x7fa8ac06d120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8014fd0 tx=0x7fa8c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:26.848+0000 7fa8c6a00640 1 -- 172.21.15.70:0/113644747 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa8b8064ea0 con 0x7fa8d015ca90 2024-09-13T16:01:27.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.140+0000 7f725f400640 1 -- 172.21.15.70:0/3480003055 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7240005500 con 0x7f726803cb60 2024-09-13T16:01:27.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.140+0000 7f7266000640 1 -- 172.21.15.70:0/3480003055 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f726c0ce000 con 0x7f726803cb60 2024-09-13T16:01:27.142 INFO:teuthology.orchestra.run.smithi070.stdout:55834574854 2024-09-13T16:01:27.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.144+0000 7f725f400640 1 -- 172.21.15.70:0/3480003055 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f724c06acd0 msgr2=0x7f724c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.144+0000 7f725f400640 1 --2- 172.21.15.70:0/3480003055 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f724c06acd0 0x7f724c06d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7258000f60 tx=0x7f7258007ec0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.145+0000 7f725f400640 1 -- 172.21.15.70:0/3480003055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f726803cb60 msgr2=0x7f726804c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.145+0000 7f725f400640 1 --2- 172.21.15.70:0/3480003055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f726803cb60 0x7f726804c490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f726c0674f0 tx=0x7f726c067920 comp rx=0 tx=0).stop 2024-09-13T16:01:27.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.145+0000 7f725f400640 1 -- 172.21.15.70:0/3480003055 shutdown_connections 2024-09-13T16:01:27.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.145+0000 7f725f400640 1 --2- 172.21.15.70:0/3480003055 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72680eb6f0 0x7f726804c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.145+0000 7f725f400640 1 --2- 172.21.15.70:0/3480003055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f726803cb60 0x7f726804c490 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.145+0000 7f725f400640 1 --2- 172.21.15.70:0/3480003055 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f724c06acd0 0x7f724c06d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.146+0000 7f725f400640 1 --2- 172.21.15.70:0/3480003055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7268005cf0 0x7f72680d3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.146+0000 7f725f400640 1 -- 172.21.15.70:0/3480003055 >> 172.21.15.70:0/3480003055 conn(0x7f726803a4e0 msgr2=0x7f72680e1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:27.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.146+0000 7f725f400640 1 -- 172.21.15.70:0/3480003055 shutdown_connections 2024-09-13T16:01:27.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.146+0000 7f725f400640 1 -- 172.21.15.70:0/3480003055 wait complete. 2024-09-13T16:01:27.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.5 2024-09-13T16:01:27.173 DEBUG:teuthology.parallel:result is None 2024-09-13T16:01:27.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.194+0000 7efd6f800640 1 -- 172.21.15.70:0/201458978 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efd680d18f0 con 0x7efd680b5860 2024-09-13T16:01:27.197 INFO:teuthology.orchestra.run.smithi070.stdout:55834574854 2024-09-13T16:01:27.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.195+0000 7efd64c00640 1 -- 172.21.15.70:0/201458978 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd680d18f0 con 0x7efd680b5860 2024-09-13T16:01:27.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.197+0000 7f7b87e00640 1 -- 172.21.15.70:0/813808646 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7b8815f270 con 0x7f7b880cb3d0 2024-09-13T16:01:27.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.197+0000 7f7b7f400640 1 -- 172.21.15.70:0/813808646 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7b70057f60 con 0x7f7b880cb3d0 2024-09-13T16:01:27.199 INFO:teuthology.orchestra.run.smithi070.stdout:55834574854 2024-09-13T16:01:27.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.198+0000 7efd6f800640 1 -- 172.21.15.70:0/201458978 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efd4806ad00 msgr2=0x7efd4806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.198+0000 7efd6f800640 1 --2- 172.21.15.70:0/201458978 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efd4806ad00 0x7efd4806d1c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efd60034000 tx=0x7efd6002f000 comp rx=0 tx=0).stop 2024-09-13T16:01:27.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.198+0000 7efd6f800640 1 -- 172.21.15.70:0/201458978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd680b5860 msgr2=0x7efd680cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.198+0000 7efd6f800640 1 --2- 172.21.15.70:0/201458978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd680b5860 0x7efd680cbec0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efd5400c3c0 tx=0x7efd5400c880 comp rx=0 tx=0).stop 2024-09-13T16:01:27.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.199+0000 7efd6f800640 1 -- 172.21.15.70:0/201458978 shutdown_connections 2024-09-13T16:01:27.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.199+0000 7efd6f800640 1 --2- 172.21.15.70:0/201458978 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efd4806ad00 0x7efd4806d1c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.199+0000 7efd6f800640 1 --2- 172.21.15.70:0/201458978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd680b5860 0x7efd680cbec0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.199+0000 7efd6f800640 1 --2- 172.21.15.70:0/201458978 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd6815cb90 0x7efd68155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.199+0000 7efd6f800640 1 --2- 172.21.15.70:0/201458978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680d2910 0x7efd680c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.199+0000 7efd6f800640 1 -- 172.21.15.70:0/201458978 >> 172.21.15.70:0/201458978 conn(0x7efd6808bf90 msgr2=0x7efd6806be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:27.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.199+0000 7efd6f800640 1 -- 172.21.15.70:0/201458978 shutdown_connections 2024-09-13T16:01:27.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.199+0000 7efd6f800640 1 -- 172.21.15.70:0/201458978 wait complete. 2024-09-13T16:01:27.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.200+0000 7f7b87e00640 1 -- 172.21.15.70:0/813808646 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7b6406acd0 msgr2=0x7f7b6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.200+0000 7f7b87e00640 1 --2- 172.21.15.70:0/813808646 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7b6406acd0 0x7f7b6406d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7b78034000 tx=0x7f7b7802c000 comp rx=0 tx=0).stop 2024-09-13T16:01:27.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.200+0000 7f7b87e00640 1 -- 172.21.15.70:0/813808646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b880cb3d0 msgr2=0x7f7b88163320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.200+0000 7f7b87e00640 1 --2- 172.21.15.70:0/813808646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b880cb3d0 0x7f7b88163320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000c410 tx=0x7f7b7000c8d0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.200+0000 7f7b87e00640 1 -- 172.21.15.70:0/813808646 shutdown_connections 2024-09-13T16:01:27.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.200+0000 7f7b87e00640 1 --2- 172.21.15.70:0/813808646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b880ce010 0x7f7b881f7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.200+0000 7f7b87e00640 1 --2- 172.21.15.70:0/813808646 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7b6406acd0 0x7f7b6406d190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.200+0000 7f7b87e00640 1 --2- 172.21.15.70:0/813808646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b880cb3d0 0x7f7b88163320 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000c410 tx=0x7f7b7000c8d0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.200+0000 7f7b87e00640 1 --2- 172.21.15.70:0/813808646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b880b2c70 0x7f7b880a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.200+0000 7f7b87e00640 1 -- 172.21.15.70:0/813808646 >> 172.21.15.70:0/813808646 conn(0x7f7b880ae310 msgr2=0x7f7b880b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:27.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.201+0000 7f7b87e00640 1 -- 172.21.15.70:0/813808646 shutdown_connections 2024-09-13T16:01:27.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.201+0000 7f7b87e00640 1 -- 172.21.15.70:0/813808646 wait complete. 2024-09-13T16:01:27.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.203+0000 7f8696200640 1 -- 172.21.15.70:0/962662058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f86680057d0 con 0x7f86900b0d20 2024-09-13T16:01:27.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.204+0000 7f8687400640 1 -- 172.21.15.70:0/962662058 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f867c058220 con 0x7f86900b0d20 2024-09-13T16:01:27.205 INFO:teuthology.orchestra.run.smithi070.stdout:55834574855 2024-09-13T16:01:27.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.208+0000 7f8696200640 1 -- 172.21.15.70:0/962662058 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f867006ad00 msgr2=0x7f867006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.208+0000 7f8696200640 1 --2- 172.21.15.70:0/962662058 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f867006ad00 0x7f867006d1c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8680001920 tx=0x7f8680009040 comp rx=0 tx=0).stop 2024-09-13T16:01:27.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.209+0000 7f8696200640 1 -- 172.21.15.70:0/962662058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86900b0d20 msgr2=0x7f8690145e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.209+0000 7f8696200640 1 --2- 172.21.15.70:0/962662058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86900b0d20 0x7f8690145e20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f867c0011e0 tx=0x7f867c00cbe0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.209+0000 7f8696200640 1 -- 172.21.15.70:0/962662058 shutdown_connections 2024-09-13T16:01:27.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.209+0000 7f8696200640 1 --2- 172.21.15.70:0/962662058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86900b2d20 0x7f86901440b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.209+0000 7f8696200640 1 --2- 172.21.15.70:0/962662058 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f867006ad00 0x7f867006d1c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.209+0000 7f8696200640 1 --2- 172.21.15.70:0/962662058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86900b0d20 0x7f8690145e20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.209+0000 7f8696200640 1 --2- 172.21.15.70:0/962662058 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8690070e60 0x7f86901448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.209+0000 7f8696200640 1 -- 172.21.15.70:0/962662058 >> 172.21.15.70:0/962662058 conn(0x7f86900b0200 msgr2=0x7f86900cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:27.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.209+0000 7f8696200640 1 -- 172.21.15.70:0/962662058 shutdown_connections 2024-09-13T16:01:27.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.210+0000 7f8696200640 1 -- 172.21.15.70:0/962662058 wait complete. 2024-09-13T16:01:27.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.215+0000 7f6879c00640 1 -- 172.21.15.70:0/859036614 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f68740ce450 con 0x7f68740cb3d0 2024-09-13T16:01:27.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.216+0000 7f686be00640 1 -- 172.21.15.70:0/859036614 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f68740ce450 con 0x7f68740cb3d0 2024-09-13T16:01:27.217 INFO:teuthology.orchestra.run.smithi070.stdout:55834574854 2024-09-13T16:01:27.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.218+0000 7f6879c00640 1 -- 172.21.15.70:0/859036614 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f685406ac50 msgr2=0x7f685406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.218+0000 7f6879c00640 1 --2- 172.21.15.70:0/859036614 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f685406ac50 0x7f685406d110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6864034000 tx=0x7f686402c000 comp rx=0 tx=0).stop 2024-09-13T16:01:27.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.218+0000 7f6879c00640 1 -- 172.21.15.70:0/859036614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68740cb3d0 msgr2=0x7f6874156e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.218+0000 7f6879c00640 1 --2- 172.21.15.70:0/859036614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68740cb3d0 0x7f6874156e30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f686000c3f0 tx=0x7f686000c8b0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.218+0000 7f6879c00640 1 -- 172.21.15.70:0/859036614 shutdown_connections 2024-09-13T16:01:27.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.218+0000 7f6879c00640 1 --2- 172.21.15.70:0/859036614 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68740ce010 0x7f68741e9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.218+0000 7f6879c00640 1 --2- 172.21.15.70:0/859036614 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f685406ac50 0x7f685406d110 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.218+0000 7f6879c00640 1 --2- 172.21.15.70:0/859036614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68740cb3d0 0x7f6874156e30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.218+0000 7f6879c00640 1 --2- 172.21.15.70:0/859036614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68740b2c70 0x7f68741627c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.218+0000 7f6879c00640 1 -- 172.21.15.70:0/859036614 >> 172.21.15.70:0/859036614 conn(0x7f68740ae310 msgr2=0x7f68740cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:27.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.219+0000 7f6879c00640 1 -- 172.21.15.70:0/859036614 shutdown_connections 2024-09-13T16:01:27.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.219+0000 7f6879c00640 1 -- 172.21.15.70:0/859036614 wait complete. 2024-09-13T16:01:27.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.225+0000 7f1078400640 1 -- 172.21.15.70:0/4105338371 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f10701593d0 con 0x7f1070070d80 2024-09-13T16:01:27.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.226+0000 7f106d600640 1 -- 172.21.15.70:0/4105338371 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f10701593d0 con 0x7f1070070d80 2024-09-13T16:01:27.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.1 2024-09-13T16:01:27.228 INFO:teuthology.orchestra.run.smithi070.stdout:55834574857 2024-09-13T16:01:27.229 DEBUG:teuthology.parallel:result is None 2024-09-13T16:01:27.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2024-09-13T16:01:27.229 DEBUG:teuthology.parallel:result is None 2024-09-13T16:01:27.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.230+0000 7f859b200640 1 -- 172.21.15.70:0/1208947525 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8594147030 con 0x7f8594146020 2024-09-13T16:01:27.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.230+0000 7f1078400640 1 -- 172.21.15.70:0/4105338371 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f105006acd0 msgr2=0x7f105006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.230+0000 7f1078400640 1 --2- 172.21.15.70:0/4105338371 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f105006acd0 0x7f105006d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1064007fd0 tx=0x7f1064009040 comp rx=0 tx=0).stop 2024-09-13T16:01:27.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.230+0000 7f1078400640 1 -- 172.21.15.70:0/4105338371 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1070070d80 msgr2=0x7f107014ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.230+0000 7f1078400640 1 --2- 172.21.15.70:0/4105338371 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1070070d80 0x7f107014ba40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f105c00b4a0 tx=0x7f105c00b960 comp rx=0 tx=0).stop 2024-09-13T16:01:27.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.230+0000 7f1078400640 1 -- 172.21.15.70:0/4105338371 shutdown_connections 2024-09-13T16:01:27.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.230+0000 7f1078400640 1 --2- 172.21.15.70:0/4105338371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10701588c0 0x7f107015a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.230+0000 7f1078400640 1 --2- 172.21.15.70:0/4105338371 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1070070d80 0x7f107014ba40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.230+0000 7f1078400640 1 --2- 172.21.15.70:0/4105338371 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f105006acd0 0x7f105006d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.230+0000 7f1078400640 1 --2- 172.21.15.70:0/4105338371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f107006a9c0 0x7f107016a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.230+0000 7f1078400640 1 -- 172.21.15.70:0/4105338371 >> 172.21.15.70:0/4105338371 conn(0x7f1070069ed0 msgr2=0x7f10700aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:27.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.230+0000 7f858e000640 1 -- 172.21.15.70:0/1208947525 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8594147030 con 0x7f8594146020 2024-09-13T16:01:27.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.230+0000 7f1078400640 1 -- 172.21.15.70:0/4105338371 shutdown_connections 2024-09-13T16:01:27.233 INFO:teuthology.orchestra.run.smithi070.stdout:55834574855 2024-09-13T16:01:27.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.230+0000 7f1078400640 1 -- 172.21.15.70:0/4105338371 wait complete. 2024-09-13T16:01:27.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.233+0000 7f859b200640 1 -- 172.21.15.70:0/1208947525 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f857806ac30 msgr2=0x7f857806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.233+0000 7f859b200640 1 --2- 172.21.15.70:0/1208947525 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f857806ac30 0x7f857806d0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8588001e40 tx=0x7f8588009040 comp rx=0 tx=0).stop 2024-09-13T16:01:27.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.233+0000 7f859b200640 1 -- 172.21.15.70:0/1208947525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8594146020 msgr2=0x7f85941464d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.233+0000 7f859b200640 1 --2- 172.21.15.70:0/1208947525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8594146020 0x7f85941464d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f859415c160 tx=0x7f8584004730 comp rx=0 tx=0).stop 2024-09-13T16:01:27.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.233+0000 7f859b200640 1 -- 172.21.15.70:0/1208947525 shutdown_connections 2024-09-13T16:01:27.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.233+0000 7f859b200640 1 --2- 172.21.15.70:0/1208947525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8594146020 0x7f85941464d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.233+0000 7f859b200640 1 --2- 172.21.15.70:0/1208947525 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85940a9ec0 0x7f85940cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.233+0000 7f859b200640 1 --2- 172.21.15.70:0/1208947525 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f857806ac30 0x7f857806d0f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.233+0000 7f859b200640 1 --2- 172.21.15.70:0/1208947525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c00d950 0x7f85940ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.233+0000 7f859b200640 1 -- 172.21.15.70:0/1208947525 >> 172.21.15.70:0/1208947525 conn(0x7f85940ae310 msgr2=0x7f85940af020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:27.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.233+0000 7f859b200640 1 -- 172.21.15.70:0/1208947525 shutdown_connections 2024-09-13T16:01:27.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.233+0000 7f859b200640 1 -- 172.21.15.70:0/1208947525 wait complete. 2024-09-13T16:01:27.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.0 2024-09-13T16:01:27.236 DEBUG:teuthology.parallel:result is None 2024-09-13T16:01:27.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.239+0000 7fa8d5c00640 1 -- 172.21.15.70:0/113644747 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa8d00b6070 con 0x7fa8d015ca90 2024-09-13T16:01:27.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2024-09-13T16:01:27.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.239+0000 7fa8c6a00640 1 -- 172.21.15.70:0/113644747 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa8b8028020 con 0x7fa8d015ca90 2024-09-13T16:01:27.241 DEBUG:teuthology.parallel:result is None 2024-09-13T16:01:27.241 INFO:teuthology.orchestra.run.smithi070.stdout:55834574854 2024-09-13T16:01:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.243+0000 7fa8d5c00640 1 -- 172.21.15.70:0/113644747 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa8ac06ac60 msgr2=0x7fa8ac06d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.243+0000 7fa8d5c00640 1 --2- 172.21.15.70:0/113644747 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa8ac06ac60 0x7fa8ac06d120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8014fd0 tx=0x7fa8c8009040 comp rx=0 tx=0).stop 2024-09-13T16:01:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.243+0000 7fa8d5c00640 1 -- 172.21.15.70:0/113644747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8d015ca90 msgr2=0x7fa8d00c64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.243+0000 7fa8d5c00640 1 --2- 172.21.15.70:0/113644747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8d015ca90 0x7fa8d00c64d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800c3a0 tx=0x7fa8b800c860 comp rx=0 tx=0).stop 2024-09-13T16:01:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.243+0000 7fa8d5c00640 1 -- 172.21.15.70:0/113644747 shutdown_connections 2024-09-13T16:01:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.243+0000 7fa8d5c00640 1 --2- 172.21.15.70:0/113644747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8d015ca90 0x7fa8d00c64d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.243+0000 7fa8d5c00640 1 --2- 172.21.15.70:0/113644747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8d00d26d0 0x7fa8d00b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.244+0000 7fa8d5c00640 1 --2- 172.21.15.70:0/113644747 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa8ac06ac60 0x7fa8ac06d120 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.244+0000 7fa8d5c00640 1 --2- 172.21.15.70:0/113644747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8d00b2850 0x7fa8d015b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.244+0000 7fa8d5c00640 1 -- 172.21.15.70:0/113644747 >> 172.21.15.70:0/113644747 conn(0x7fa8d008bf90 msgr2=0x7fa8d00d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.244+0000 7fa8d5c00640 1 -- 172.21.15.70:0/113644747 shutdown_connections 2024-09-13T16:01:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.244+0000 7fa8d5c00640 1 -- 172.21.15.70:0/113644747 wait complete. 2024-09-13T16:01:27.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.6 2024-09-13T16:01:27.253 DEBUG:teuthology.parallel:result is None 2024-09-13T16:01:27.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.3 2024-09-13T16:01:27.254 DEBUG:teuthology.parallel:result is None 2024-09-13T16:01:27.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.4 2024-09-13T16:01:27.261 DEBUG:teuthology.parallel:result is None 2024-09-13T16:01:27.262 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T16:01:27.262 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T16:01:27.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.451+0000 7f8ae1800640 1 Processor -- start 2024-09-13T16:01:27.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.452+0000 7f8ae1800640 1 -- start start 2024-09-13T16:01:27.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.453+0000 7f8ae1800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8adc15a5c0 0x7f8adc0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:27.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.453+0000 7f8ae1800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8adc15b9b0 0x7f8adc0b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:27.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.453+0000 7f8ae1800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8adc0cbfc0 con 0x7f8adc0cbac0 2024-09-13T16:01:27.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.453+0000 7f8ae1800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8adc0cce20 con 0x7f8adc15b9b0 2024-09-13T16:01:27.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.453+0000 7f8ae1800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc0707a0 con 0x7f8adc15a5c0 2024-09-13T16:01:27.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.453+0000 7f8adbe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8adc15a5c0 0x7f8adc0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:27.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.453+0000 7f8adbe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8adc15a5c0 0x7f8adc0b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:51386/0 (socket says 172.21.15.70:51386) 2024-09-13T16:01:27.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.453+0000 7f8adbe00640 1 -- 172.21.15.70:0/835434601 learned_addr learned my addr 172.21.15.70:0/835434601 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:27.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.453+0000 7f8ad3400640 1 --1- 172.21.15.70:0/835434601 >> v1:172.21.15.107:6789/0 conn(0x7f8adc0cbac0 0x7f8adc06f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:48676/0 (socket says 172.21.15.70:48676) 2024-09-13T16:01:27.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.453+0000 7f8ae0e00640 1 --2- 172.21.15.70:0/835434601 >> v2:172.21.15.107:3300/0 conn(0x7f8adc15b9b0 0x7f8adc0b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:27.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.454+0000 7f8adb400640 1 -- 172.21.15.70:0/835434601 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271928030 0 0) 0x7f8adc0cbfc0 con 0x7f8adc0cbac0 2024-09-13T16:01:27.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.454+0000 7f8adbe00640 1 -- 172.21.15.70:0/835434601 >> v2:172.21.15.107:3300/0 conn(0x7f8adc15b9b0 msgr2=0x7f8adc0b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:27.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.454+0000 7f8adbe00640 1 --2- 172.21.15.70:0/835434601 >> v2:172.21.15.107:3300/0 conn(0x7f8adc15b9b0 0x7f8adc0b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.454+0000 7f8adbe00640 1 -- 172.21.15.70:0/835434601 >> v1:172.21.15.107:6789/0 conn(0x7f8adc0cbac0 legacy=0x7f8adc06f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.454+0000 7f8adbe00640 1 -- 172.21.15.70:0/835434601 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc070a80 con 0x7f8adc15a5c0 2024-09-13T16:01:27.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.455+0000 7f8adbe00640 1 --2- 172.21.15.70:0/835434601 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8adc15a5c0 0x7f8adc0b39b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8acc009870 tx=0x7f8acc02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a602c358e6c5788e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:27.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.455+0000 7f8adb400640 1 -- 172.21.15.70:0/835434601 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc032440 con 0x7f8adc15a5c0 2024-09-13T16:01:27.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.455+0000 7f8adb400640 1 -- 172.21.15.70:0/835434601 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8acc0325a0 con 0x7f8adc15a5c0 2024-09-13T16:01:27.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.455+0000 7f8adb400640 1 -- 172.21.15.70:0/835434601 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc032930 con 0x7f8adc15a5c0 2024-09-13T16:01:27.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.455+0000 7f8ae1800640 1 -- 172.21.15.70:0/835434601 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8adc15a5c0 msgr2=0x7f8adc0b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.455+0000 7f8ae1800640 1 --2- 172.21.15.70:0/835434601 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8adc15a5c0 0x7f8adc0b39b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8acc009870 tx=0x7f8acc02a1c0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.456+0000 7f8ae1800640 1 -- 172.21.15.70:0/835434601 shutdown_connections 2024-09-13T16:01:27.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.456+0000 7f8ae1800640 1 --2- 172.21.15.70:0/835434601 >> v2:172.21.15.107:3300/0 conn(0x7f8adc15b9b0 0x7f8adc0b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.456+0000 7f8ae1800640 1 --2- 172.21.15.70:0/835434601 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8adc15a5c0 0x7f8adc0b39b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.456+0000 7f8ae1800640 1 -- 172.21.15.70:0/835434601 >> 172.21.15.70:0/835434601 conn(0x7f8adc0ae310 msgr2=0x7f8adc0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:27.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.456+0000 7f8ae1800640 1 -- 172.21.15.70:0/835434601 shutdown_connections 2024-09-13T16:01:27.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.456+0000 7f8ae1800640 1 -- 172.21.15.70:0/835434601 wait complete. 2024-09-13T16:01:27.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.457+0000 7f8ae1800640 1 Processor -- start 2024-09-13T16:01:27.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.457+0000 7f8ae1800640 1 -- start start 2024-09-13T16:01:27.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.458+0000 7f8ae1800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8adc0cbac0 0x7f8adc14a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:27.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.458+0000 7f8ae1800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8adc15a5c0 0x7f8adc154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:27.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.458+0000 7f8ae1800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8adc15b9b0 0x7f8adc1f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:27.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.458+0000 7f8ae1800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc0b2960 con 0x7f8adc15b9b0 2024-09-13T16:01:27.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.458+0000 7f8ae1800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc0b1d50 con 0x7f8adc0cbac0 2024-09-13T16:01:27.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.458+0000 7f8ae1800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc0b2030 con 0x7f8adc15a5c0 2024-09-13T16:01:27.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.458+0000 7f8ae0e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8adc15b9b0 0x7f8adc1f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:27.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.458+0000 7f8ae0e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8adc15b9b0 0x7f8adc1f23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36236/0 (socket says 172.21.15.70:36236) 2024-09-13T16:01:27.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.458+0000 7f8ae0e00640 1 -- 172.21.15.70:0/2049916041 learned_addr learned my addr 172.21.15.70:0/2049916041 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:27.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.458+0000 7f8adbe00640 1 --2- 172.21.15.70:0/2049916041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8adc0cbac0 0x7f8adc14a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:27.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.459+0000 7f8ad3400640 1 --2- 172.21.15.70:0/2049916041 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8adc15a5c0 0x7f8adc154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:27.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.459+0000 7f8ae0e00640 1 -- 172.21.15.70:0/2049916041 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8adc15a5c0 msgr2=0x7f8adc154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.459+0000 7f8ae0e00640 1 --2- 172.21.15.70:0/2049916041 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8adc15a5c0 0x7f8adc154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.459+0000 7f8ae0e00640 1 -- 172.21.15.70:0/2049916041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8adc0cbac0 msgr2=0x7f8adc14a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.459+0000 7f8ae0e00640 1 --2- 172.21.15.70:0/2049916041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8adc0cbac0 0x7f8adc14a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.459+0000 7f8ae0e00640 1 -- 172.21.15.70:0/2049916041 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc0094d0 con 0x7f8adc15b9b0 2024-09-13T16:01:27.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.459+0000 7f8ae0e00640 1 --2- 172.21.15.70:0/2049916041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8adc15b9b0 0x7f8adc1f23a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400ebe0 tx=0x7f8ad400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:27.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.459+0000 7f8ad8c00640 1 -- 172.21.15.70:0/2049916041 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad400cd20 con 0x7f8adc15b9b0 2024-09-13T16:01:27.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.459+0000 7f8ad8c00640 1 -- 172.21.15.70:0/2049916041 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad400f040 con 0x7f8adc15b9b0 2024-09-13T16:01:27.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.459+0000 7f8ae1800640 1 -- 172.21.15.70:0/2049916041 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8adc0b2310 con 0x7f8adc15b9b0 2024-09-13T16:01:27.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.459+0000 7f8ad8c00640 1 -- 172.21.15.70:0/2049916041 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad400cea0 con 0x7f8adc15b9b0 2024-09-13T16:01:27.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.460+0000 7f8ae1800640 1 -- 172.21.15.70:0/2049916041 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8adc0b1970 con 0x7f8adc15b9b0 2024-09-13T16:01:27.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.461+0000 7f8ae1800640 1 -- 172.21.15.70:0/2049916041 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8adc067360 con 0x7f8adc15b9b0 2024-09-13T16:01:27.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.461+0000 7f8ad8c00640 1 -- 172.21.15.70:0/2049916041 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8ad40146c0 con 0x7f8adc15b9b0 2024-09-13T16:01:27.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.463+0000 7f8ad8c00640 1 --2- 172.21.15.70:0/2049916041 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f8ab806ac30 0x7f8ab806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:27.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.463+0000 7f8ad8c00640 1 -- 172.21.15.70:0/2049916041 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ad4089e50 con 0x7f8adc15b9b0 2024-09-13T16:01:27.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.463+0000 7f8adbe00640 1 --2- 172.21.15.70:0/2049916041 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f8ab806ac30 0x7f8ab806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:27.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.463+0000 7f8adbe00640 1 --2- 172.21.15.70:0/2049916041 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f8ab806ac30 0x7f8ab806d0f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8acc034000 tx=0x7f8acc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:27.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.467+0000 7f8ad8c00640 1 -- 172.21.15.70:0/2049916041 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8ad4055170 con 0x7f8adc15b9b0 2024-09-13T16:01:27.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.631+0000 7f8ae1800640 1 -- 172.21.15.70:0/2049916041 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8adc071280 con 0x7f8ab806ac30 2024-09-13T16:01:27.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.638+0000 7f8ad8c00640 1 -- 172.21.15.70:0/2049916041 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264535 (secure 0 0 0) 0x7f8acc040070 con 0x7f8ab806ac30 2024-09-13T16:01:27.642 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:27.643 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-13T16:01:27.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.641+0000 7f8ae1800640 1 -- 172.21.15.70:0/2049916041 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f8ab806ac30 msgr2=0x7f8ab806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.641+0000 7f8ae1800640 1 --2- 172.21.15.70:0/2049916041 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f8ab806ac30 0x7f8ab806d0f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8acc034000 tx=0x7f8acc02e000 comp rx=0 tx=0).stop 2024-09-13T16:01:27.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.641+0000 7f8ae1800640 1 -- 172.21.15.70:0/2049916041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8adc15b9b0 msgr2=0x7f8adc1f23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.641+0000 7f8ae1800640 1 --2- 172.21.15.70:0/2049916041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8adc15b9b0 0x7f8adc1f23a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400ebe0 tx=0x7f8ad400c490 comp rx=0 tx=0).stop 2024-09-13T16:01:27.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.642+0000 7f8ae1800640 1 -- 172.21.15.70:0/2049916041 shutdown_connections 2024-09-13T16:01:27.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.642+0000 7f8ae1800640 1 --2- 172.21.15.70:0/2049916041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8adc15b9b0 0x7f8adc1f23a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.642+0000 7f8ae1800640 1 --2- 172.21.15.70:0/2049916041 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8adc15a5c0 0x7f8adc154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.642+0000 7f8ae1800640 1 --2- 172.21.15.70:0/2049916041 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f8ab806ac30 0x7f8ab806d0f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.642+0000 7f8ae1800640 1 --2- 172.21.15.70:0/2049916041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8adc0cbac0 0x7f8adc14a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.642+0000 7f8ae1800640 1 -- 172.21.15.70:0/2049916041 >> 172.21.15.70:0/2049916041 conn(0x7f8adc0ae310 msgr2=0x7f8adc15a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:27.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.642+0000 7f8ae1800640 1 -- 172.21.15.70:0/2049916041 shutdown_connections 2024-09-13T16:01:27.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.642+0000 7f8ae1800640 1 -- 172.21.15.70:0/2049916041 wait complete. 2024-09-13T16:01:27.660 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-13T16:01:26.019085+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235384,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739336,"statfs":{"total":773094113280,"available":772853080064,"internally_reserved":0,"allocated":2887680,"data_stored":1751625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.836158"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411450+0000","last_change":"2024-09-13T16:01:18.644594+0000","last_active":"2024-09-13T16:01:20.411450+0000","last_peered":"2024-09-13T16:01:20.411450+0000","last_clean":"2024-09-13T16:01:20.411450+0000","last_became_active":"2024-09-13T16:01:18.644356+0000","last_became_peered":"2024-09-13T16:01:18.644356+0000","last_unstale":"2024-09-13T16:01:20.411450+0000","last_undegraded":"2024-09-13T16:01:20.411450+0000","last_fullsized":"2024-09-13T16:01:20.411450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:20.422612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603423+0000","last_change":"2024-09-13T16:01:18.624268+0000","last_active":"2024-09-13T16:01:19.603423+0000","last_peered":"2024-09-13T16:01:19.603423+0000","last_clean":"2024-09-13T16:01:19.603423+0000","last_became_active":"2024-09-13T16:01:18.624050+0000","last_became_peered":"2024-09-13T16:01:18.624050+0000","last_unstale":"2024-09-13T16:01:19.603423+0000","last_undegraded":"2024-09-13T16:01:19.603423+0000","last_fullsized":"2024-09-13T16:01:19.603423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411544+0000","last_change":"2024-09-13T16:01:18.623991+0000","last_active":"2024-09-13T16:01:20.411544+0000","last_peered":"2024-09-13T16:01:20.411544+0000","last_clean":"2024-09-13T16:01:20.411544+0000","last_became_active":"2024-09-13T16:01:18.623492+0000","last_became_peered":"2024-09-13T16:01:18.623492+0000","last_unstale":"2024-09-13T16:01:20.411544+0000","last_undegraded":"2024-09-13T16:01:20.411544+0000","last_fullsized":"2024-09-13T16:01:20.411544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:33:59.929449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414175+0000","last_change":"2024-09-13T16:01:18.630873+0000","last_active":"2024-09-13T16:01:20.414175+0000","last_peered":"2024-09-13T16:01:20.414175+0000","last_clean":"2024-09-13T16:01:20.414175+0000","last_became_active":"2024-09-13T16:01:18.630446+0000","last_became_peered":"2024-09-13T16:01:18.630446+0000","last_unstale":"2024-09-13T16:01:20.414175+0000","last_undegraded":"2024-09-13T16:01:20.414175+0000","last_fullsized":"2024-09-13T16:01:20.414175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:43.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411291+0000","last_change":"2024-09-13T16:01:18.637355+0000","last_active":"2024-09-13T16:01:20.411291+0000","last_peered":"2024-09-13T16:01:20.411291+0000","last_clean":"2024-09-13T16:01:20.411291+0000","last_became_active":"2024-09-13T16:01:18.637053+0000","last_became_peered":"2024-09-13T16:01:18.637053+0000","last_unstale":"2024-09-13T16:01:20.411291+0000","last_undegraded":"2024-09-13T16:01:20.411291+0000","last_fullsized":"2024-09-13T16:01:20.411291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:11.951128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414096+0000","last_change":"2024-09-13T16:01:18.626648+0000","last_active":"2024-09-13T16:01:20.414096+0000","last_peered":"2024-09-13T16:01:20.414096+0000","last_clean":"2024-09-13T16:01:20.414096+0000","last_became_active":"2024-09-13T16:01:18.625618+0000","last_became_peered":"2024-09-13T16:01:18.625618+0000","last_unstale":"2024-09-13T16:01:20.414096+0000","last_undegraded":"2024-09-13T16:01:20.414096+0000","last_fullsized":"2024-09-13T16:01:20.414096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:50.539415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411253+0000","last_change":"2024-09-13T16:01:18.632016+0000","last_active":"2024-09-13T16:01:20.411253+0000","last_peered":"2024-09-13T16:01:20.411253+0000","last_clean":"2024-09-13T16:01:20.411253+0000","last_became_active":"2024-09-13T16:01:18.631753+0000","last_became_peered":"2024-09-13T16:01:18.631753+0000","last_unstale":"2024-09-13T16:01:20.411253+0000","last_undegraded":"2024-09-13T16:01:20.411253+0000","last_fullsized":"2024-09-13T16:01:20.411253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:26.431089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411077+0000","last_change":"2024-09-13T16:01:18.628899+0000","last_active":"2024-09-13T16:01:20.411077+0000","last_peered":"2024-09-13T16:01:20.411077+0000","last_clean":"2024-09-13T16:01:20.411077+0000","last_became_active":"2024-09-13T16:01:18.628268+0000","last_became_peered":"2024-09-13T16:01:18.628268+0000","last_unstale":"2024-09-13T16:01:20.411077+0000","last_undegraded":"2024-09-13T16:01:20.411077+0000","last_fullsized":"2024-09-13T16:01:20.411077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:18.317702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411460+0000","last_change":"2024-09-13T16:01:18.641494+0000","last_active":"2024-09-13T16:01:20.411460+0000","last_peered":"2024-09-13T16:01:20.411460+0000","last_clean":"2024-09-13T16:01:20.411460+0000","last_became_active":"2024-09-13T16:01:18.641183+0000","last_became_peered":"2024-09-13T16:01:18.641183+0000","last_unstale":"2024-09-13T16:01:20.411460+0000","last_undegraded":"2024-09-13T16:01:20.411460+0000","last_fullsized":"2024-09-13T16:01:20.411460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:10.009263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604131+0000","last_change":"2024-09-13T16:01:18.632143+0000","last_active":"2024-09-13T16:01:19.604131+0000","last_peered":"2024-09-13T16:01:19.604131+0000","last_clean":"2024-09-13T16:01:19.604131+0000","last_became_active":"2024-09-13T16:01:18.630476+0000","last_became_peered":"2024-09-13T16:01:18.630476+0000","last_unstale":"2024-09-13T16:01:19.604131+0000","last_undegraded":"2024-09-13T16:01:19.604131+0000","last_fullsized":"2024-09-13T16:01:19.604131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:52.684760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603862+0000","last_change":"2024-09-13T16:01:18.626009+0000","last_active":"2024-09-13T16:01:19.603862+0000","last_peered":"2024-09-13T16:01:19.603862+0000","last_clean":"2024-09-13T16:01:19.603862+0000","last_became_active":"2024-09-13T16:01:18.625643+0000","last_became_peered":"2024-09-13T16:01:18.625643+0000","last_unstale":"2024-09-13T16:01:19.603862+0000","last_undegraded":"2024-09-13T16:01:19.603862+0000","last_fullsized":"2024-09-13T16:01:19.603862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411399+0000","last_change":"2024-09-13T16:01:18.619953+0000","last_active":"2024-09-13T16:01:20.411399+0000","last_peered":"2024-09-13T16:01:20.411399+0000","last_clean":"2024-09-13T16:01:20.411399+0000","last_became_active":"2024-09-13T16:01:18.619529+0000","last_became_peered":"2024-09-13T16:01:18.619529+0000","last_unstale":"2024-09-13T16:01:20.411399+0000","last_undegraded":"2024-09-13T16:01:20.411399+0000","last_fullsized":"2024-09-13T16:01:20.411399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:56.513378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411221+0000","last_change":"2024-09-13T16:01:18.611600+0000","last_active":"2024-09-13T16:01:20.411221+0000","last_peered":"2024-09-13T16:01:20.411221+0000","last_clean":"2024-09-13T16:01:20.411221+0000","last_became_active":"2024-09-13T16:01:18.611355+0000","last_became_peered":"2024-09-13T16:01:18.611355+0000","last_unstale":"2024-09-13T16:01:20.411221+0000","last_undegraded":"2024-09-13T16:01:20.411221+0000","last_fullsized":"2024-09-13T16:01:20.411221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:52.684760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411442+0000","last_change":"2024-09-13T16:01:18.626872+0000","last_active":"2024-09-13T16:01:20.411442+0000","last_peered":"2024-09-13T16:01:20.411442+0000","last_clean":"2024-09-13T16:01:20.411442+0000","last_became_active":"2024-09-13T16:01:18.625476+0000","last_became_peered":"2024-09-13T16:01:18.625476+0000","last_unstale":"2024-09-13T16:01:20.411442+0000","last_undegraded":"2024-09-13T16:01:20.411442+0000","last_fullsized":"2024-09-13T16:01:20.411442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:28.990573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603123+0000","last_change":"2024-09-13T16:01:18.630422+0000","last_active":"2024-09-13T16:01:19.603123+0000","last_peered":"2024-09-13T16:01:19.603123+0000","last_clean":"2024-09-13T16:01:19.603123+0000","last_became_active":"2024-09-13T16:01:18.630174+0000","last_became_peered":"2024-09-13T16:01:18.630174+0000","last_unstale":"2024-09-13T16:01:19.603123+0000","last_undegraded":"2024-09-13T16:01:19.603123+0000","last_fullsized":"2024-09-13T16:01:19.603123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:52.684760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414053+0000","last_change":"2024-09-13T16:01:18.625202+0000","last_active":"2024-09-13T16:01:20.414053+0000","last_peered":"2024-09-13T16:01:20.414053+0000","last_clean":"2024-09-13T16:01:20.414053+0000","last_became_active":"2024-09-13T16:01:18.624886+0000","last_became_peered":"2024-09-13T16:01:18.624886+0000","last_unstale":"2024-09-13T16:01:20.414053+0000","last_undegraded":"2024-09-13T16:01:20.414053+0000","last_fullsized":"2024-09-13T16:01:20.414053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:19.302417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414267+0000","last_change":"2024-09-13T16:01:18.621201+0000","last_active":"2024-09-13T16:01:20.414267+0000","last_peered":"2024-09-13T16:01:20.414267+0000","last_clean":"2024-09-13T16:01:20.414267+0000","last_became_active":"2024-09-13T16:01:18.620822+0000","last_became_peered":"2024-09-13T16:01:18.620822+0000","last_unstale":"2024-09-13T16:01:20.414267+0000","last_undegraded":"2024-09-13T16:01:20.414267+0000","last_fullsized":"2024-09-13T16:01:20.414267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:55.299980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603906+0000","last_change":"2024-09-13T16:01:18.621201+0000","last_active":"2024-09-13T16:01:19.603906+0000","last_peered":"2024-09-13T16:01:19.603906+0000","last_clean":"2024-09-13T16:01:19.603906+0000","last_became_active":"2024-09-13T16:01:18.619264+0000","last_became_peered":"2024-09-13T16:01:18.619264+0000","last_unstale":"2024-09-13T16:01:19.603906+0000","last_undegraded":"2024-09-13T16:01:19.603906+0000","last_fullsized":"2024-09-13T16:01:19.603906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:03.072242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411418+0000","last_change":"2024-09-13T16:01:18.635920+0000","last_active":"2024-09-13T16:01:20.411418+0000","last_peered":"2024-09-13T16:01:20.411418+0000","last_clean":"2024-09-13T16:01:20.411418+0000","last_became_active":"2024-09-13T16:01:18.634437+0000","last_became_peered":"2024-09-13T16:01:18.634437+0000","last_unstale":"2024-09-13T16:01:20.411418+0000","last_undegraded":"2024-09-13T16:01:20.411418+0000","last_fullsized":"2024-09-13T16:01:20.411418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:43.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603898+0000","last_change":"2024-09-13T16:01:18.618207+0000","last_active":"2024-09-13T16:01:19.603898+0000","last_peered":"2024-09-13T16:01:19.603898+0000","last_clean":"2024-09-13T16:01:19.603898+0000","last_became_active":"2024-09-13T16:01:18.617859+0000","last_became_peered":"2024-09-13T16:01:18.617859+0000","last_unstale":"2024-09-13T16:01:19.603898+0000","last_undegraded":"2024-09-13T16:01:19.603898+0000","last_fullsized":"2024-09-13T16:01:19.603898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:49.813372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411476+0000","last_change":"2024-09-13T16:01:18.627158+0000","last_active":"2024-09-13T16:01:20.411476+0000","last_peered":"2024-09-13T16:01:20.411476+0000","last_clean":"2024-09-13T16:01:20.411476+0000","last_became_active":"2024-09-13T16:01:18.627010+0000","last_became_peered":"2024-09-13T16:01:18.627010+0000","last_unstale":"2024-09-13T16:01:20.411476+0000","last_undegraded":"2024-09-13T16:01:20.411476+0000","last_fullsized":"2024-09-13T16:01:20.411476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:08.669688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414106+0000","last_change":"2024-09-13T16:01:18.625912+0000","last_active":"2024-09-13T16:01:20.414106+0000","last_peered":"2024-09-13T16:01:20.414106+0000","last_clean":"2024-09-13T16:01:20.414106+0000","last_became_active":"2024-09-13T16:01:18.625254+0000","last_became_peered":"2024-09-13T16:01:18.625254+0000","last_unstale":"2024-09-13T16:01:20.414106+0000","last_undegraded":"2024-09-13T16:01:20.414106+0000","last_fullsized":"2024-09-13T16:01:20.414106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:10.009263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411143+0000","last_change":"2024-09-13T16:01:18.628744+0000","last_active":"2024-09-13T16:01:20.411143+0000","last_peered":"2024-09-13T16:01:20.411143+0000","last_clean":"2024-09-13T16:01:20.411143+0000","last_became_active":"2024-09-13T16:01:18.628467+0000","last_became_peered":"2024-09-13T16:01:18.628467+0000","last_unstale":"2024-09-13T16:01:20.411143+0000","last_undegraded":"2024-09-13T16:01:20.411143+0000","last_fullsized":"2024-09-13T16:01:20.411143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:20.422612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414069+0000","last_change":"2024-09-13T16:01:18.634330+0000","last_active":"2024-09-13T16:01:20.414069+0000","last_peered":"2024-09-13T16:01:20.414069+0000","last_clean":"2024-09-13T16:01:20.414069+0000","last_became_active":"2024-09-13T16:01:18.633542+0000","last_became_peered":"2024-09-13T16:01:18.633542+0000","last_unstale":"2024-09-13T16:01:20.414069+0000","last_undegraded":"2024-09-13T16:01:20.414069+0000","last_fullsized":"2024-09-13T16:01:20.414069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411358+0000","last_change":"2024-09-13T16:01:18.615790+0000","last_active":"2024-09-13T16:01:20.411358+0000","last_peered":"2024-09-13T16:01:20.411358+0000","last_clean":"2024-09-13T16:01:20.411358+0000","last_became_active":"2024-09-13T16:01:18.615102+0000","last_became_peered":"2024-09-13T16:01:18.615102+0000","last_unstale":"2024-09-13T16:01:20.411358+0000","last_undegraded":"2024-09-13T16:01:20.411358+0000","last_fullsized":"2024-09-13T16:01:20.411358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:28.548177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604211+0000","last_change":"2024-09-13T16:01:18.619972+0000","last_active":"2024-09-13T16:01:19.604211+0000","last_peered":"2024-09-13T16:01:19.604211+0000","last_clean":"2024-09-13T16:01:19.604211+0000","last_became_active":"2024-09-13T16:01:18.619393+0000","last_became_peered":"2024-09-13T16:01:18.619393+0000","last_unstale":"2024-09-13T16:01:19.604211+0000","last_undegraded":"2024-09-13T16:01:19.604211+0000","last_fullsized":"2024-09-13T16:01:19.604211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603306+0000","last_change":"2024-09-13T16:01:18.604836+0000","last_active":"2024-09-13T16:01:19.603306+0000","last_peered":"2024-09-13T16:01:19.603306+0000","last_clean":"2024-09-13T16:01:19.603306+0000","last_became_active":"2024-09-13T16:01:18.604598+0000","last_became_peered":"2024-09-13T16:01:18.604598+0000","last_unstale":"2024-09-13T16:01:19.603306+0000","last_undegraded":"2024-09-13T16:01:19.603306+0000","last_fullsized":"2024-09-13T16:01:19.603306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:19.302417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411290+0000","last_change":"2024-09-13T16:01:18.624936+0000","last_active":"2024-09-13T16:01:20.411290+0000","last_peered":"2024-09-13T16:01:20.411290+0000","last_clean":"2024-09-13T16:01:20.411290+0000","last_became_active":"2024-09-13T16:01:18.619895+0000","last_became_peered":"2024-09-13T16:01:18.619895+0000","last_unstale":"2024-09-13T16:01:20.411290+0000","last_undegraded":"2024-09-13T16:01:20.411290+0000","last_fullsized":"2024-09-13T16:01:20.411290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:11.951128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411491+0000","last_change":"2024-09-13T16:01:18.618591+0000","last_active":"2024-09-13T16:01:20.411491+0000","last_peered":"2024-09-13T16:01:20.411491+0000","last_clean":"2024-09-13T16:01:20.411491+0000","last_became_active":"2024-09-13T16:01:18.618365+0000","last_became_peered":"2024-09-13T16:01:18.618365+0000","last_unstale":"2024-09-13T16:01:20.411491+0000","last_undegraded":"2024-09-13T16:01:20.411491+0000","last_fullsized":"2024-09-13T16:01:20.411491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:52.684760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414116+0000","last_change":"2024-09-13T16:01:18.618017+0000","last_active":"2024-09-13T16:01:20.414116+0000","last_peered":"2024-09-13T16:01:20.414116+0000","last_clean":"2024-09-13T16:01:20.414116+0000","last_became_active":"2024-09-13T16:01:18.617614+0000","last_became_peered":"2024-09-13T16:01:18.617614+0000","last_unstale":"2024-09-13T16:01:20.414116+0000","last_undegraded":"2024-09-13T16:01:20.414116+0000","last_fullsized":"2024-09-13T16:01:20.414116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:49.331305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603841+0000","last_change":"2024-09-13T16:01:18.619441+0000","last_active":"2024-09-13T16:01:19.603841+0000","last_peered":"2024-09-13T16:01:19.603841+0000","last_clean":"2024-09-13T16:01:19.603841+0000","last_became_active":"2024-09-13T16:01:18.619196+0000","last_became_peered":"2024-09-13T16:01:18.619196+0000","last_unstale":"2024-09-13T16:01:19.603841+0000","last_undegraded":"2024-09-13T16:01:19.603841+0000","last_fullsized":"2024-09-13T16:01:19.603841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:56.513378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603751+0000","last_change":"2024-09-13T16:01:18.629618+0000","last_active":"2024-09-13T16:01:19.603751+0000","last_peered":"2024-09-13T16:01:19.603751+0000","last_clean":"2024-09-13T16:01:19.603751+0000","last_became_active":"2024-09-13T16:01:18.625774+0000","last_became_peered":"2024-09-13T16:01:18.625774+0000","last_unstale":"2024-09-13T16:01:19.603751+0000","last_undegraded":"2024-09-13T16:01:19.603751+0000","last_fullsized":"2024-09-13T16:01:19.603751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:54.527079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411355+0000","last_change":"2024-09-13T16:01:18.617833+0000","last_active":"2024-09-13T16:01:20.411355+0000","last_peered":"2024-09-13T16:01:20.411355+0000","last_clean":"2024-09-13T16:01:20.411355+0000","last_became_active":"2024-09-13T16:01:18.614256+0000","last_became_peered":"2024-09-13T16:01:18.614256+0000","last_unstale":"2024-09-13T16:01:20.411355+0000","last_undegraded":"2024-09-13T16:01:20.411355+0000","last_fullsized":"2024-09-13T16:01:20.411355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:28.217399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411252+0000","last_change":"2024-09-13T16:01:18.208438+0000","last_active":"2024-09-13T16:01:20.411252+0000","last_peered":"2024-09-13T16:01:20.411252+0000","last_clean":"2024-09-13T16:01:20.411252+0000","last_became_active":"2024-09-13T16:01:18.207954+0000","last_became_peered":"2024-09-13T16:01:18.207954+0000","last_unstale":"2024-09-13T16:01:20.411252+0000","last_undegraded":"2024-09-13T16:01:20.411252+0000","last_fullsized":"2024-09-13T16:01:20.411252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:41.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411507+0000","last_change":"2024-09-13T16:01:18.632108+0000","last_active":"2024-09-13T16:01:20.411507+0000","last_peered":"2024-09-13T16:01:20.411507+0000","last_clean":"2024-09-13T16:01:20.411507+0000","last_became_active":"2024-09-13T16:01:18.631731+0000","last_became_peered":"2024-09-13T16:01:18.631731+0000","last_unstale":"2024-09-13T16:01:20.411507+0000","last_undegraded":"2024-09-13T16:01:20.411507+0000","last_fullsized":"2024-09-13T16:01:20.411507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604145+0000","last_change":"2024-09-13T16:01:18.207085+0000","last_active":"2024-09-13T16:01:19.604145+0000","last_peered":"2024-09-13T16:01:19.604145+0000","last_clean":"2024-09-13T16:01:19.604145+0000","last_became_active":"2024-09-13T16:01:18.205734+0000","last_became_peered":"2024-09-13T16:01:18.205734+0000","last_unstale":"2024-09-13T16:01:19.604145+0000","last_undegraded":"2024-09-13T16:01:19.604145+0000","last_fullsized":"2024-09-13T16:01:19.604145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411188+0000","last_change":"2024-09-13T16:01:18.206489+0000","last_active":"2024-09-13T16:01:20.411188+0000","last_peered":"2024-09-13T16:01:20.411188+0000","last_clean":"2024-09-13T16:01:20.411188+0000","last_became_active":"2024-09-13T16:01:18.206251+0000","last_became_peered":"2024-09-13T16:01:18.206251+0000","last_unstale":"2024-09-13T16:01:20.411188+0000","last_undegraded":"2024-09-13T16:01:20.411188+0000","last_fullsized":"2024-09-13T16:01:20.411188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411108+0000","last_change":"2024-09-13T16:01:18.629111+0000","last_active":"2024-09-13T16:01:20.411108+0000","last_peered":"2024-09-13T16:01:20.411108+0000","last_clean":"2024-09-13T16:01:20.411108+0000","last_became_active":"2024-09-13T16:01:18.628667+0000","last_became_peered":"2024-09-13T16:01:18.628667+0000","last_unstale":"2024-09-13T16:01:20.411108+0000","last_undegraded":"2024-09-13T16:01:20.411108+0000","last_fullsized":"2024-09-13T16:01:20.411108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:49.813372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414086+0000","last_change":"2024-09-13T16:01:18.201791+0000","last_active":"2024-09-13T16:01:20.414086+0000","last_peered":"2024-09-13T16:01:20.414086+0000","last_clean":"2024-09-13T16:01:20.414086+0000","last_became_active":"2024-09-13T16:01:18.201494+0000","last_became_peered":"2024-09-13T16:01:18.201494+0000","last_unstale":"2024-09-13T16:01:20.414086+0000","last_undegraded":"2024-09-13T16:01:20.414086+0000","last_fullsized":"2024-09-13T16:01:20.414086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:29.574043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603176+0000","last_change":"2024-09-13T16:01:18.606975+0000","last_active":"2024-09-13T16:01:19.603176+0000","last_peered":"2024-09-13T16:01:19.603176+0000","last_clean":"2024-09-13T16:01:19.603176+0000","last_became_active":"2024-09-13T16:01:18.604210+0000","last_became_peered":"2024-09-13T16:01:18.604210+0000","last_unstale":"2024-09-13T16:01:19.603176+0000","last_undegraded":"2024-09-13T16:01:19.603176+0000","last_fullsized":"2024-09-13T16:01:19.603176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:18.317702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603997+0000","last_change":"2024-09-13T16:01:18.209833+0000","last_active":"2024-09-13T16:01:19.603997+0000","last_peered":"2024-09-13T16:01:19.603997+0000","last_clean":"2024-09-13T16:01:19.603997+0000","last_became_active":"2024-09-13T16:01:18.209539+0000","last_became_peered":"2024-09-13T16:01:18.209539+0000","last_unstale":"2024-09-13T16:01:19.603997+0000","last_undegraded":"2024-09-13T16:01:19.603997+0000","last_fullsized":"2024-09-13T16:01:19.603997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:29.574043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414247+0000","last_change":"2024-09-13T16:01:18.625735+0000","last_active":"2024-09-13T16:01:20.414247+0000","last_peered":"2024-09-13T16:01:20.414247+0000","last_clean":"2024-09-13T16:01:20.414247+0000","last_became_active":"2024-09-13T16:01:18.625512+0000","last_became_peered":"2024-09-13T16:01:18.625512+0000","last_unstale":"2024-09-13T16:01:20.414247+0000","last_undegraded":"2024-09-13T16:01:20.414247+0000","last_fullsized":"2024-09-13T16:01:20.414247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:26.431089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414257+0000","last_change":"2024-09-13T16:01:18.211782+0000","last_active":"2024-09-13T16:01:20.414257+0000","last_peered":"2024-09-13T16:01:20.414257+0000","last_clean":"2024-09-13T16:01:20.414257+0000","last_became_active":"2024-09-13T16:01:18.211163+0000","last_became_peered":"2024-09-13T16:01:18.211163+0000","last_unstale":"2024-09-13T16:01:20.414257+0000","last_undegraded":"2024-09-13T16:01:20.414257+0000","last_fullsized":"2024-09-13T16:01:20.414257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:33.908621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411611+0000","last_change":"2024-09-13T16:01:18.627394+0000","last_active":"2024-09-13T16:01:20.411611+0000","last_peered":"2024-09-13T16:01:20.411611+0000","last_clean":"2024-09-13T16:01:20.411611+0000","last_became_active":"2024-09-13T16:01:18.624519+0000","last_became_peered":"2024-09-13T16:01:18.624519+0000","last_unstale":"2024-09-13T16:01:20.411611+0000","last_undegraded":"2024-09-13T16:01:20.411611+0000","last_fullsized":"2024-09-13T16:01:20.411611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:49.813372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603339+0000","last_change":"2024-09-13T16:01:18.210433+0000","last_active":"2024-09-13T16:01:19.603339+0000","last_peered":"2024-09-13T16:01:19.603339+0000","last_clean":"2024-09-13T16:01:19.603339+0000","last_became_active":"2024-09-13T16:01:18.210161+0000","last_became_peered":"2024-09-13T16:01:18.210161+0000","last_unstale":"2024-09-13T16:01:19.603339+0000","last_undegraded":"2024-09-13T16:01:19.603339+0000","last_fullsized":"2024-09-13T16:01:19.603339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:55.507079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411417+0000","last_change":"2024-09-13T16:01:18.630661+0000","last_active":"2024-09-13T16:01:20.411417+0000","last_peered":"2024-09-13T16:01:20.411417+0000","last_clean":"2024-09-13T16:01:20.411417+0000","last_became_active":"2024-09-13T16:01:18.630386+0000","last_became_peered":"2024-09-13T16:01:18.630386+0000","last_unstale":"2024-09-13T16:01:20.411417+0000","last_undegraded":"2024-09-13T16:01:20.411417+0000","last_fullsized":"2024-09-13T16:01:20.411417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:34.993393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603975+0000","last_change":"2024-09-13T16:01:18.197317+0000","last_active":"2024-09-13T16:01:19.603975+0000","last_peered":"2024-09-13T16:01:19.603975+0000","last_clean":"2024-09-13T16:01:19.603975+0000","last_became_active":"2024-09-13T16:01:18.197022+0000","last_became_peered":"2024-09-13T16:01:18.197022+0000","last_unstale":"2024-09-13T16:01:19.603975+0000","last_undegraded":"2024-09-13T16:01:19.603975+0000","last_fullsized":"2024-09-13T16:01:19.603975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:11.867906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411366+0000","last_change":"2024-09-13T16:01:18.636601+0000","last_active":"2024-09-13T16:01:20.411366+0000","last_peered":"2024-09-13T16:01:20.411366+0000","last_clean":"2024-09-13T16:01:20.411366+0000","last_became_active":"2024-09-13T16:01:18.636246+0000","last_became_peered":"2024-09-13T16:01:18.636246+0000","last_unstale":"2024-09-13T16:01:20.411366+0000","last_undegraded":"2024-09-13T16:01:20.411366+0000","last_fullsized":"2024-09-13T16:01:20.411366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:55.299980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411525+0000","last_change":"2024-09-13T16:01:18.207068+0000","last_active":"2024-09-13T16:01:20.411525+0000","last_peered":"2024-09-13T16:01:20.411525+0000","last_clean":"2024-09-13T16:01:20.411525+0000","last_became_active":"2024-09-13T16:01:18.206783+0000","last_became_peered":"2024-09-13T16:01:18.206783+0000","last_unstale":"2024-09-13T16:01:20.411525+0000","last_undegraded":"2024-09-13T16:01:20.411525+0000","last_fullsized":"2024-09-13T16:01:20.411525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:47.286118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411460+0000","last_change":"2024-09-13T16:01:18.618465+0000","last_active":"2024-09-13T16:01:20.411460+0000","last_peered":"2024-09-13T16:01:20.411460+0000","last_clean":"2024-09-13T16:01:20.411460+0000","last_became_active":"2024-09-13T16:01:18.618200+0000","last_became_peered":"2024-09-13T16:01:18.618200+0000","last_unstale":"2024-09-13T16:01:20.411460+0000","last_undegraded":"2024-09-13T16:01:20.411460+0000","last_fullsized":"2024-09-13T16:01:20.411460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:54.527079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414144+0000","last_change":"2024-09-13T16:01:18.208243+0000","last_active":"2024-09-13T16:01:20.414144+0000","last_peered":"2024-09-13T16:01:20.414144+0000","last_clean":"2024-09-13T16:01:20.414144+0000","last_became_active":"2024-09-13T16:01:18.207672+0000","last_became_peered":"2024-09-13T16:01:18.207672+0000","last_unstale":"2024-09-13T16:01:20.414144+0000","last_undegraded":"2024-09-13T16:01:20.414144+0000","last_fullsized":"2024-09-13T16:01:20.414144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411301+0000","last_change":"2024-09-13T16:01:18.639262+0000","last_active":"2024-09-13T16:01:20.411301+0000","last_peered":"2024-09-13T16:01:20.411301+0000","last_clean":"2024-09-13T16:01:20.411301+0000","last_became_active":"2024-09-13T16:01:18.639026+0000","last_became_peered":"2024-09-13T16:01:18.639026+0000","last_unstale":"2024-09-13T16:01:20.411301+0000","last_undegraded":"2024-09-13T16:01:20.411301+0000","last_fullsized":"2024-09-13T16:01:20.411301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:49.331305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603731+0000","last_change":"2024-09-13T16:01:18.201169+0000","last_active":"2024-09-13T16:01:19.603731+0000","last_peered":"2024-09-13T16:01:19.603731+0000","last_clean":"2024-09-13T16:01:19.603731+0000","last_became_active":"2024-09-13T16:01:18.199492+0000","last_became_peered":"2024-09-13T16:01:18.199492+0000","last_unstale":"2024-09-13T16:01:19.603731+0000","last_undegraded":"2024-09-13T16:01:19.603731+0000","last_fullsized":"2024-09-13T16:01:19.603731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:41.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603772+0000","last_change":"2024-09-13T16:01:18.623233+0000","last_active":"2024-09-13T16:01:19.603772+0000","last_peered":"2024-09-13T16:01:19.603772+0000","last_clean":"2024-09-13T16:01:19.603772+0000","last_became_active":"2024-09-13T16:01:18.622853+0000","last_became_peered":"2024-09-13T16:01:18.622853+0000","last_unstale":"2024-09-13T16:01:19.603772+0000","last_undegraded":"2024-09-13T16:01:19.603772+0000","last_fullsized":"2024-09-13T16:01:19.603772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:08.669688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603832+0000","last_change":"2024-09-13T16:01:18.199011+0000","last_active":"2024-09-13T16:01:19.603832+0000","last_peered":"2024-09-13T16:01:19.603832+0000","last_clean":"2024-09-13T16:01:19.603832+0000","last_became_active":"2024-09-13T16:01:18.198645+0000","last_became_peered":"2024-09-13T16:01:18.198645+0000","last_unstale":"2024-09-13T16:01:19.603832+0000","last_undegraded":"2024-09-13T16:01:19.603832+0000","last_fullsized":"2024-09-13T16:01:19.603832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:37.847292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411280+0000","last_change":"2024-09-13T16:01:18.638935+0000","last_active":"2024-09-13T16:01:20.411280+0000","last_peered":"2024-09-13T16:01:20.411280+0000","last_clean":"2024-09-13T16:01:20.411280+0000","last_became_active":"2024-09-13T16:01:18.638609+0000","last_became_peered":"2024-09-13T16:01:18.638609+0000","last_unstale":"2024-09-13T16:01:20.411280+0000","last_undegraded":"2024-09-13T16:01:20.411280+0000","last_fullsized":"2024-09-13T16:01:20.411280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411436+0000","last_change":"2024-09-13T16:01:18.203508+0000","last_active":"2024-09-13T16:01:20.411436+0000","last_peered":"2024-09-13T16:01:20.411436+0000","last_clean":"2024-09-13T16:01:20.411436+0000","last_became_active":"2024-09-13T16:01:18.203203+0000","last_became_peered":"2024-09-13T16:01:18.203203+0000","last_unstale":"2024-09-13T16:01:20.411436+0000","last_undegraded":"2024-09-13T16:01:20.411436+0000","last_fullsized":"2024-09-13T16:01:20.411436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:47.286118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411440+0000","last_change":"2024-09-13T16:01:18.639508+0000","last_active":"2024-09-13T16:01:20.411440+0000","last_peered":"2024-09-13T16:01:20.411440+0000","last_clean":"2024-09-13T16:01:20.411440+0000","last_became_active":"2024-09-13T16:01:18.638478+0000","last_became_peered":"2024-09-13T16:01:18.638478+0000","last_unstale":"2024-09-13T16:01:20.411440+0000","last_undegraded":"2024-09-13T16:01:20.411440+0000","last_fullsized":"2024-09-13T16:01:20.411440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:50.539415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603994+0000","last_change":"2024-09-13T16:01:18.201769+0000","last_active":"2024-09-13T16:01:19.603994+0000","last_peered":"2024-09-13T16:01:19.603994+0000","last_clean":"2024-09-13T16:01:19.603994+0000","last_became_active":"2024-09-13T16:01:18.198080+0000","last_became_peered":"2024-09-13T16:01:18.198080+0000","last_unstale":"2024-09-13T16:01:19.603994+0000","last_undegraded":"2024-09-13T16:01:19.603994+0000","last_fullsized":"2024-09-13T16:01:19.603994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411472+0000","last_change":"2024-09-13T16:01:18.638606+0000","last_active":"2024-09-13T16:01:20.411472+0000","last_peered":"2024-09-13T16:01:20.411472+0000","last_clean":"2024-09-13T16:01:20.411472+0000","last_became_active":"2024-09-13T16:01:18.638374+0000","last_became_peered":"2024-09-13T16:01:18.638374+0000","last_unstale":"2024-09-13T16:01:20.411472+0000","last_undegraded":"2024-09-13T16:01:20.411472+0000","last_fullsized":"2024-09-13T16:01:20.411472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:28.548177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603399+0000","last_change":"2024-09-13T16:01:18.210255+0000","last_active":"2024-09-13T16:01:19.603399+0000","last_peered":"2024-09-13T16:01:19.603399+0000","last_clean":"2024-09-13T16:01:19.603399+0000","last_became_active":"2024-09-13T16:01:18.210014+0000","last_became_peered":"2024-09-13T16:01:18.210014+0000","last_unstale":"2024-09-13T16:01:19.603399+0000","last_undegraded":"2024-09-13T16:01:19.603399+0000","last_fullsized":"2024-09-13T16:01:19.603399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:02.065942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414195+0000","last_change":"2024-09-13T16:01:18.630699+0000","last_active":"2024-09-13T16:01:20.414195+0000","last_peered":"2024-09-13T16:01:20.414195+0000","last_clean":"2024-09-13T16:01:20.414195+0000","last_became_active":"2024-09-13T16:01:18.630007+0000","last_became_peered":"2024-09-13T16:01:18.630007+0000","last_unstale":"2024-09-13T16:01:20.414195+0000","last_undegraded":"2024-09-13T16:01:20.414195+0000","last_fullsized":"2024-09-13T16:01:20.414195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:28.548177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603901+0000","last_change":"2024-09-13T16:01:18.208200+0000","last_active":"2024-09-13T16:01:19.603901+0000","last_peered":"2024-09-13T16:01:19.603901+0000","last_clean":"2024-09-13T16:01:19.603901+0000","last_became_active":"2024-09-13T16:01:18.206473+0000","last_became_peered":"2024-09-13T16:01:18.206473+0000","last_unstale":"2024-09-13T16:01:19.603901+0000","last_undegraded":"2024-09-13T16:01:19.603901+0000","last_fullsized":"2024-09-13T16:01:19.603901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:41.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411376+0000","last_change":"2024-09-13T16:01:18.637343+0000","last_active":"2024-09-13T16:01:20.411376+0000","last_peered":"2024-09-13T16:01:20.411376+0000","last_clean":"2024-09-13T16:01:20.411376+0000","last_became_active":"2024-09-13T16:01:18.637052+0000","last_became_peered":"2024-09-13T16:01:18.637052+0000","last_unstale":"2024-09-13T16:01:20.411376+0000","last_undegraded":"2024-09-13T16:01:20.411376+0000","last_fullsized":"2024-09-13T16:01:20.411376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:40:45.237966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.618812+0000","last_change":"2024-09-13T16:01:07.580186+0000","last_active":"2024-09-13T16:01:18.618812+0000","last_peered":"2024-09-13T16:01:18.618812+0000","last_clean":"2024-09-13T16:01:18.618812+0000","last_became_active":"2024-09-13T16:01:07.579877+0000","last_became_peered":"2024-09-13T16:01:07.579877+0000","last_unstale":"2024-09-13T16:01:18.618812+0000","last_undegraded":"2024-09-13T16:01:18.618812+0000","last_fullsized":"2024-09-13T16:01:18.618812+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_clean_scrub_stamp":"2024-09-13T16:01:06.070807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:40.645649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414165+0000","last_change":"2024-09-13T16:01:18.204628+0000","last_active":"2024-09-13T16:01:20.414165+0000","last_peered":"2024-09-13T16:01:20.414165+0000","last_clean":"2024-09-13T16:01:20.414165+0000","last_became_active":"2024-09-13T16:01:18.204302+0000","last_became_peered":"2024-09-13T16:01:18.204302+0000","last_unstale":"2024-09-13T16:01:20.414165+0000","last_undegraded":"2024-09-13T16:01:20.414165+0000","last_fullsized":"2024-09-13T16:01:20.414165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:33.987093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411205+0000","last_change":"2024-09-13T16:01:18.622448+0000","last_active":"2024-09-13T16:01:20.411205+0000","last_peered":"2024-09-13T16:01:20.411205+0000","last_clean":"2024-09-13T16:01:20.411205+0000","last_became_active":"2024-09-13T16:01:18.621087+0000","last_became_peered":"2024-09-13T16:01:18.621087+0000","last_unstale":"2024-09-13T16:01:20.411205+0000","last_undegraded":"2024-09-13T16:01:20.411205+0000","last_fullsized":"2024-09-13T16:01:20.411205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:19.302417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411232+0000","last_change":"2024-09-13T16:01:18.210964+0000","last_active":"2024-09-13T16:01:20.411232+0000","last_peered":"2024-09-13T16:01:20.411232+0000","last_clean":"2024-09-13T16:01:20.411232+0000","last_became_active":"2024-09-13T16:01:18.210292+0000","last_became_peered":"2024-09-13T16:01:18.210292+0000","last_unstale":"2024-09-13T16:01:20.411232+0000","last_undegraded":"2024-09-13T16:01:20.411232+0000","last_fullsized":"2024-09-13T16:01:20.411232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:02.065942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411419+0000","last_change":"2024-09-13T16:01:18.630964+0000","last_active":"2024-09-13T16:01:20.411419+0000","last_peered":"2024-09-13T16:01:20.411419+0000","last_clean":"2024-09-13T16:01:20.411419+0000","last_became_active":"2024-09-13T16:01:18.630721+0000","last_became_peered":"2024-09-13T16:01:18.630721+0000","last_unstale":"2024-09-13T16:01:20.411419+0000","last_undegraded":"2024-09-13T16:01:20.411419+0000","last_fullsized":"2024-09-13T16:01:20.411419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:25.722121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604000+0000","last_change":"2024-09-13T16:01:18.194594+0000","last_active":"2024-09-13T16:01:19.604000+0000","last_peered":"2024-09-13T16:01:19.604000+0000","last_clean":"2024-09-13T16:01:19.604000+0000","last_became_active":"2024-09-13T16:01:18.194321+0000","last_became_peered":"2024-09-13T16:01:18.194321+0000","last_unstale":"2024-09-13T16:01:19.604000+0000","last_undegraded":"2024-09-13T16:01:19.604000+0000","last_fullsized":"2024-09-13T16:01:19.604000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:46.038225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603131+0000","last_change":"2024-09-13T16:01:18.620982+0000","last_active":"2024-09-13T16:01:19.603131+0000","last_peered":"2024-09-13T16:01:19.603131+0000","last_clean":"2024-09-13T16:01:19.603131+0000","last_became_active":"2024-09-13T16:01:18.620567+0000","last_became_peered":"2024-09-13T16:01:18.620567+0000","last_unstale":"2024-09-13T16:01:19.603131+0000","last_undegraded":"2024-09-13T16:01:19.603131+0000","last_fullsized":"2024-09-13T16:01:19.603131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414156+0000","last_change":"2024-09-13T16:01:18.205821+0000","last_active":"2024-09-13T16:01:20.414156+0000","last_peered":"2024-09-13T16:01:20.414156+0000","last_clean":"2024-09-13T16:01:20.414156+0000","last_became_active":"2024-09-13T16:01:18.205559+0000","last_became_peered":"2024-09-13T16:01:18.205559+0000","last_unstale":"2024-09-13T16:01:20.414156+0000","last_undegraded":"2024-09-13T16:01:20.414156+0000","last_fullsized":"2024-09-13T16:01:20.414156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:41.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411380+0000","last_change":"2024-09-13T16:01:18.621751+0000","last_active":"2024-09-13T16:01:20.411380+0000","last_peered":"2024-09-13T16:01:20.411380+0000","last_clean":"2024-09-13T16:01:20.411380+0000","last_became_active":"2024-09-13T16:01:18.621504+0000","last_became_peered":"2024-09-13T16:01:18.621504+0000","last_unstale":"2024-09-13T16:01:20.411380+0000","last_undegraded":"2024-09-13T16:01:20.411380+0000","last_fullsized":"2024-09-13T16:01:20.411380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:03.072242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603362+0000","last_change":"2024-09-13T16:01:18.199824+0000","last_active":"2024-09-13T16:01:19.603362+0000","last_peered":"2024-09-13T16:01:19.603362+0000","last_clean":"2024-09-13T16:01:19.603362+0000","last_became_active":"2024-09-13T16:01:18.199321+0000","last_became_peered":"2024-09-13T16:01:18.199321+0000","last_unstale":"2024-09-13T16:01:19.603362+0000","last_undegraded":"2024-09-13T16:01:19.603362+0000","last_fullsized":"2024-09-13T16:01:19.603362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414215+0000","last_change":"2024-09-13T16:01:18.632613+0000","last_active":"2024-09-13T16:01:20.414215+0000","last_peered":"2024-09-13T16:01:20.414215+0000","last_clean":"2024-09-13T16:01:20.414215+0000","last_became_active":"2024-09-13T16:01:18.632389+0000","last_became_peered":"2024-09-13T16:01:18.632389+0000","last_unstale":"2024-09-13T16:01:20.414215+0000","last_undegraded":"2024-09-13T16:01:20.414215+0000","last_fullsized":"2024-09-13T16:01:20.414215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411431+0000","last_change":"2024-09-13T16:01:18.212308+0000","last_active":"2024-09-13T16:01:20.411431+0000","last_peered":"2024-09-13T16:01:20.411431+0000","last_clean":"2024-09-13T16:01:20.411431+0000","last_became_active":"2024-09-13T16:01:18.210307+0000","last_became_peered":"2024-09-13T16:01:18.210307+0000","last_unstale":"2024-09-13T16:01:20.411431+0000","last_undegraded":"2024-09-13T16:01:20.411431+0000","last_fullsized":"2024-09-13T16:01:20.411431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:33.908621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603286+0000","last_change":"2024-09-13T16:01:18.616853+0000","last_active":"2024-09-13T16:01:19.603286+0000","last_peered":"2024-09-13T16:01:19.603286+0000","last_clean":"2024-09-13T16:01:19.603286+0000","last_became_active":"2024-09-13T16:01:18.616581+0000","last_became_peered":"2024-09-13T16:01:18.616581+0000","last_unstale":"2024-09-13T16:01:19.603286+0000","last_undegraded":"2024-09-13T16:01:19.603286+0000","last_fullsized":"2024-09-13T16:01:19.603286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:49.813372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.412593+0000","last_change":"2024-09-13T16:01:18.211147+0000","last_active":"2024-09-13T16:01:20.412593+0000","last_peered":"2024-09-13T16:01:20.412593+0000","last_clean":"2024-09-13T16:01:20.412593+0000","last_became_active":"2024-09-13T16:01:18.210496+0000","last_became_peered":"2024-09-13T16:01:18.210496+0000","last_unstale":"2024-09-13T16:01:20.412593+0000","last_undegraded":"2024-09-13T16:01:20.412593+0000","last_fullsized":"2024-09-13T16:01:20.412593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:33.987093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411374+0000","last_change":"2024-09-13T16:01:18.618984+0000","last_active":"2024-09-13T16:01:20.411374+0000","last_peered":"2024-09-13T16:01:20.411374+0000","last_clean":"2024-09-13T16:01:20.411374+0000","last_became_active":"2024-09-13T16:01:18.617587+0000","last_became_peered":"2024-09-13T16:01:18.617587+0000","last_unstale":"2024-09-13T16:01:20.411374+0000","last_undegraded":"2024-09-13T16:01:20.411374+0000","last_fullsized":"2024-09-13T16:01:20.411374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:43.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604083+0000","last_change":"2024-09-13T16:01:18.208715+0000","last_active":"2024-09-13T16:01:19.604083+0000","last_peered":"2024-09-13T16:01:19.604083+0000","last_clean":"2024-09-13T16:01:19.604083+0000","last_became_active":"2024-09-13T16:01:18.208008+0000","last_became_peered":"2024-09-13T16:01:18.208008+0000","last_unstale":"2024-09-13T16:01:19.604083+0000","last_undegraded":"2024-09-13T16:01:19.604083+0000","last_fullsized":"2024-09-13T16:01:19.604083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:33.908621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411559+0000","last_change":"2024-09-13T16:01:18.627736+0000","last_active":"2024-09-13T16:01:20.411559+0000","last_peered":"2024-09-13T16:01:20.411559+0000","last_clean":"2024-09-13T16:01:20.411559+0000","last_became_active":"2024-09-13T16:01:18.627485+0000","last_became_peered":"2024-09-13T16:01:18.627485+0000","last_unstale":"2024-09-13T16:01:20.411559+0000","last_undegraded":"2024-09-13T16:01:20.411559+0000","last_fullsized":"2024-09-13T16:01:20.411559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:30.675930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411214+0000","last_change":"2024-09-13T16:01:18.208002+0000","last_active":"2024-09-13T16:01:20.411214+0000","last_peered":"2024-09-13T16:01:20.411214+0000","last_clean":"2024-09-13T16:01:20.411214+0000","last_became_active":"2024-09-13T16:01:18.207573+0000","last_became_peered":"2024-09-13T16:01:18.207573+0000","last_unstale":"2024-09-13T16:01:20.411214+0000","last_undegraded":"2024-09-13T16:01:20.411214+0000","last_fullsized":"2024-09-13T16:01:20.411214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:29.574043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411330+0000","last_change":"2024-09-13T16:01:18.624658+0000","last_active":"2024-09-13T16:01:20.411330+0000","last_peered":"2024-09-13T16:01:20.411330+0000","last_clean":"2024-09-13T16:01:20.411330+0000","last_became_active":"2024-09-13T16:01:18.623850+0000","last_became_peered":"2024-09-13T16:01:18.623850+0000","last_unstale":"2024-09-13T16:01:20.411330+0000","last_undegraded":"2024-09-13T16:01:20.411330+0000","last_fullsized":"2024-09-13T16:01:20.411330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:30.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603214+0000","last_change":"2024-09-13T16:01:18.207621+0000","last_active":"2024-09-13T16:01:19.603214+0000","last_peered":"2024-09-13T16:01:19.603214+0000","last_clean":"2024-09-13T16:01:19.603214+0000","last_became_active":"2024-09-13T16:01:18.207360+0000","last_became_peered":"2024-09-13T16:01:18.207360+0000","last_unstale":"2024-09-13T16:01:19.603214+0000","last_undegraded":"2024-09-13T16:01:19.603214+0000","last_fullsized":"2024-09-13T16:01:19.603214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:27.211100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411125+0000","last_change":"2024-09-13T16:01:18.604618+0000","last_active":"2024-09-13T16:01:20.411125+0000","last_peered":"2024-09-13T16:01:20.411125+0000","last_clean":"2024-09-13T16:01:20.411125+0000","last_became_active":"2024-09-13T16:01:18.604304+0000","last_became_peered":"2024-09-13T16:01:18.604304+0000","last_unstale":"2024-09-13T16:01:20.411125+0000","last_undegraded":"2024-09-13T16:01:20.411125+0000","last_fullsized":"2024-09-13T16:01:20.411125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603327+0000","last_change":"2024-09-13T16:01:18.199347+0000","last_active":"2024-09-13T16:01:19.603327+0000","last_peered":"2024-09-13T16:01:19.603327+0000","last_clean":"2024-09-13T16:01:19.603327+0000","last_became_active":"2024-09-13T16:01:18.198961+0000","last_became_peered":"2024-09-13T16:01:18.198961+0000","last_unstale":"2024-09-13T16:01:19.603327+0000","last_undegraded":"2024-09-13T16:01:19.603327+0000","last_fullsized":"2024-09-13T16:01:19.603327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:29.574043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411236+0000","last_change":"2024-09-13T16:01:18.616823+0000","last_active":"2024-09-13T16:01:20.411236+0000","last_peered":"2024-09-13T16:01:20.411236+0000","last_clean":"2024-09-13T16:01:20.411236+0000","last_became_active":"2024-09-13T16:01:18.616569+0000","last_became_peered":"2024-09-13T16:01:18.616569+0000","last_unstale":"2024-09-13T16:01:20.411236+0000","last_undegraded":"2024-09-13T16:01:20.411236+0000","last_fullsized":"2024-09-13T16:01:20.411236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411338+0000","last_change":"2024-09-13T16:01:18.214426+0000","last_active":"2024-09-13T16:01:20.411338+0000","last_peered":"2024-09-13T16:01:20.411338+0000","last_clean":"2024-09-13T16:01:20.411338+0000","last_became_active":"2024-09-13T16:01:18.214087+0000","last_became_peered":"2024-09-13T16:01:18.214087+0000","last_unstale":"2024-09-13T16:01:20.411338+0000","last_undegraded":"2024-09-13T16:01:20.411338+0000","last_fullsized":"2024-09-13T16:01:20.411338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604128+0000","last_change":"2024-09-13T16:01:18.620356+0000","last_active":"2024-09-13T16:01:19.604128+0000","last_peered":"2024-09-13T16:01:19.604128+0000","last_clean":"2024-09-13T16:01:19.604128+0000","last_became_active":"2024-09-13T16:01:18.620060+0000","last_became_peered":"2024-09-13T16:01:18.620060+0000","last_unstale":"2024-09-13T16:01:19.604128+0000","last_undegraded":"2024-09-13T16:01:19.604128+0000","last_fullsized":"2024-09-13T16:01:19.604128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:25.722121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414206+0000","last_change":"2024-09-13T16:01:18.638326+0000","last_active":"2024-09-13T16:01:20.414206+0000","last_peered":"2024-09-13T16:01:20.414206+0000","last_clean":"2024-09-13T16:01:20.414206+0000","last_became_active":"2024-09-13T16:01:18.638047+0000","last_became_peered":"2024-09-13T16:01:18.638047+0000","last_unstale":"2024-09-13T16:01:20.414206+0000","last_undegraded":"2024-09-13T16:01:20.414206+0000","last_fullsized":"2024-09-13T16:01:20.414206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:20.422612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411352+0000","last_change":"2024-09-13T16:01:18.213077+0000","last_active":"2024-09-13T16:01:20.411352+0000","last_peered":"2024-09-13T16:01:20.411352+0000","last_clean":"2024-09-13T16:01:20.411352+0000","last_became_active":"2024-09-13T16:01:18.212732+0000","last_became_peered":"2024-09-13T16:01:18.212732+0000","last_unstale":"2024-09-13T16:01:20.411352+0000","last_undegraded":"2024-09-13T16:01:20.411352+0000","last_fullsized":"2024-09-13T16:01:20.411352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:55.507079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414185+0000","last_change":"2024-09-13T16:01:18.623915+0000","last_active":"2024-09-13T16:01:20.414185+0000","last_peered":"2024-09-13T16:01:20.414185+0000","last_clean":"2024-09-13T16:01:20.414185+0000","last_became_active":"2024-09-13T16:01:18.623420+0000","last_became_peered":"2024-09-13T16:01:18.623420+0000","last_unstale":"2024-09-13T16:01:20.414185+0000","last_undegraded":"2024-09-13T16:01:20.414185+0000","last_fullsized":"2024-09-13T16:01:20.414185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:11.951128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411389+0000","last_change":"2024-09-13T16:01:18.213257+0000","last_active":"2024-09-13T16:01:20.411389+0000","last_peered":"2024-09-13T16:01:20.411389+0000","last_clean":"2024-09-13T16:01:20.411389+0000","last_became_active":"2024-09-13T16:01:18.212675+0000","last_became_peered":"2024-09-13T16:01:18.212675+0000","last_unstale":"2024-09-13T16:01:20.411389+0000","last_undegraded":"2024-09-13T16:01:20.411389+0000","last_fullsized":"2024-09-13T16:01:20.411389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:33.987093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411595+0000","last_change":"2024-09-13T16:01:18.634167+0000","last_active":"2024-09-13T16:01:20.411595+0000","last_peered":"2024-09-13T16:01:20.411595+0000","last_clean":"2024-09-13T16:01:20.411595+0000","last_became_active":"2024-09-13T16:01:18.633922+0000","last_became_peered":"2024-09-13T16:01:18.633922+0000","last_unstale":"2024-09-13T16:01:20.411595+0000","last_undegraded":"2024-09-13T16:01:20.411595+0000","last_fullsized":"2024-09-13T16:01:20.411595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411324+0000","last_change":"2024-09-13T16:01:18.196431+0000","last_active":"2024-09-13T16:01:20.411324+0000","last_peered":"2024-09-13T16:01:20.411324+0000","last_clean":"2024-09-13T16:01:20.411324+0000","last_became_active":"2024-09-13T16:01:18.195952+0000","last_became_peered":"2024-09-13T16:01:18.195952+0000","last_unstale":"2024-09-13T16:01:20.411324+0000","last_undegraded":"2024-09-13T16:01:20.411324+0000","last_fullsized":"2024-09-13T16:01:20.411324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:11.867906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411307+0000","last_change":"2024-09-13T16:01:18.608250+0000","last_active":"2024-09-13T16:01:20.411307+0000","last_peered":"2024-09-13T16:01:20.411307+0000","last_clean":"2024-09-13T16:01:20.411307+0000","last_became_active":"2024-09-13T16:01:18.607998+0000","last_became_peered":"2024-09-13T16:01:18.607998+0000","last_unstale":"2024-09-13T16:01:20.411307+0000","last_undegraded":"2024-09-13T16:01:20.411307+0000","last_fullsized":"2024-09-13T16:01:20.411307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:25.722121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411627+0000","last_change":"2024-09-13T16:01:18.209539+0000","last_active":"2024-09-13T16:01:20.411627+0000","last_peered":"2024-09-13T16:01:20.411627+0000","last_clean":"2024-09-13T16:01:20.411627+0000","last_became_active":"2024-09-13T16:01:18.209329+0000","last_became_peered":"2024-09-13T16:01:18.209329+0000","last_unstale":"2024-09-13T16:01:20.411627+0000","last_undegraded":"2024-09-13T16:01:20.411627+0000","last_fullsized":"2024-09-13T16:01:20.411627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:46.038225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:01:27.664 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T16:01:27.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.850+0000 7f5bc9000640 1 Processor -- start 2024-09-13T16:01:27.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.850+0000 7f5bc9000640 1 -- start start 2024-09-13T16:01:27.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.851+0000 7f5bc9000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5bc4071560 0x7f5bc40ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:27.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.851+0000 7f5bc9000640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc40cd850 con 0x7f5bc406f4b0 2024-09-13T16:01:27.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.851+0000 7f5bc9000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc40cd570 con 0x7f5bc4159480 2024-09-13T16:01:27.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.851+0000 7f5bc9000640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc40b1740 con 0x7f5bc4071560 2024-09-13T16:01:27.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.851+0000 7f5bbbe00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5bc4071560 0x7f5bc40ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:27.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.851+0000 7f5bc3e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5bc406f4b0 0x7f5bc40b2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39236/0 (socket says 172.21.15.70:39236) 2024-09-13T16:01:27.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.851+0000 7f5bc3e00640 1 -- 172.21.15.70:0/831558220 learned_addr learned my addr 172.21.15.70:0/831558220 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:27.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.852+0000 7f5bbbe00640 1 -- 172.21.15.70:0/831558220 >> v1:172.21.15.107:6789/0 conn(0x7f5bc4159480 legacy=0x7f5bc4070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.852+0000 7f5bbbe00640 1 -- 172.21.15.70:0/831558220 >> v1:172.21.15.70:6789/0 conn(0x7f5bc406f4b0 legacy=0x7f5bc40b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.852+0000 7f5bbbe00640 1 -- 172.21.15.70:0/831558220 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc40b1a20 con 0x7f5bc4071560 2024-09-13T16:01:27.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.853+0000 7f5bbbe00640 1 --2- 172.21.15.70:0/831558220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc4071560 0x7f5bc40ccf90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0097a0 tx=0x7f5bac02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2b4c3dc28883ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:27.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.853+0000 7f5bc2a00640 1 -- 172.21.15.70:0/831558220 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac032440 con 0x7f5bc4071560 2024-09-13T16:01:27.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.853+0000 7f5bc2a00640 1 -- 172.21.15.70:0/831558220 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac0325a0 con 0x7f5bc4071560 2024-09-13T16:01:27.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.853+0000 7f5bc2a00640 1 -- 172.21.15.70:0/831558220 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac032930 con 0x7f5bc4071560 2024-09-13T16:01:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.853+0000 7f5bc9000640 1 -- 172.21.15.70:0/831558220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc4071560 msgr2=0x7f5bc40ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.853+0000 7f5bc9000640 1 --2- 172.21.15.70:0/831558220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc4071560 0x7f5bc40ccf90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0097a0 tx=0x7f5bac02a1a0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.854+0000 7f5bc9000640 1 -- 172.21.15.70:0/831558220 shutdown_connections 2024-09-13T16:01:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.854+0000 7f5bc9000640 1 --2- 172.21.15.70:0/831558220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc4071560 0x7f5bc40ccf90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.854+0000 7f5bc9000640 1 -- 172.21.15.70:0/831558220 >> 172.21.15.70:0/831558220 conn(0x7f5bc40ae310 msgr2=0x7f5bc40ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.854+0000 7f5bc9000640 1 -- 172.21.15.70:0/831558220 shutdown_connections 2024-09-13T16:01:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.854+0000 7f5bc9000640 1 -- 172.21.15.70:0/831558220 wait complete. 2024-09-13T16:01:27.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.855+0000 7f5bc9000640 1 Processor -- start 2024-09-13T16:01:27.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.855+0000 7f5bc9000640 1 -- start start 2024-09-13T16:01:27.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.856+0000 7f5bc9000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bc406f4b0 0x7f5bc41e2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:27.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.856+0000 7f5bc9000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5bc4071560 0x7f5bc41f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:27.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.856+0000 7f5bc9000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc4159480 0x7f5bc413ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:27.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.856+0000 7f5bc9000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc413c970 con 0x7f5bc4159480 2024-09-13T16:01:27.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.856+0000 7f5bc9000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc414e180 con 0x7f5bc406f4b0 2024-09-13T16:01:27.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.856+0000 7f5bc9000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc4152a40 con 0x7f5bc4071560 2024-09-13T16:01:27.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.857+0000 7f5bc3e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc4159480 0x7f5bc413ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:27.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.857+0000 7f5bc3e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc4159480 0x7f5bc413ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36256/0 (socket says 172.21.15.70:36256) 2024-09-13T16:01:27.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.857+0000 7f5bc3e00640 1 -- 172.21.15.70:0/410115920 learned_addr learned my addr 172.21.15.70:0/410115920 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:27.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.857+0000 7f5bbbe00640 1 --2- 172.21.15.70:0/410115920 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5bc4071560 0x7f5bc41f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:27.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.857+0000 7f5bc3400640 1 --2- 172.21.15.70:0/410115920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bc406f4b0 0x7f5bc41e2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:27.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.857+0000 7f5bc3e00640 1 -- 172.21.15.70:0/410115920 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5bc4071560 msgr2=0x7f5bc41f1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.857+0000 7f5bc3e00640 1 --2- 172.21.15.70:0/410115920 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5bc4071560 0x7f5bc41f1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.857+0000 7f5bc3e00640 1 -- 172.21.15.70:0/410115920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bc406f4b0 msgr2=0x7f5bc41e2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:27.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.857+0000 7f5bc3e00640 1 --2- 172.21.15.70:0/410115920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bc406f4b0 0x7f5bc41e2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:27.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.857+0000 7f5bc3e00640 1 -- 172.21.15.70:0/410115920 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac009400 con 0x7f5bc4159480 2024-09-13T16:01:27.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.857+0000 7f5bc3e00640 1 --2- 172.21.15.70:0/410115920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc4159480 0x7f5bc413ce00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00cbf0 tx=0x7f5bbc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:27.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.858+0000 7f5bbb400640 1 -- 172.21.15.70:0/410115920 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc00ad40 con 0x7f5bc4159480 2024-09-13T16:01:27.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.858+0000 7f5bbb400640 1 -- 172.21.15.70:0/410115920 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc012400 con 0x7f5bc4159480 2024-09-13T16:01:27.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.858+0000 7f5bbb400640 1 -- 172.21.15.70:0/410115920 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc00aea0 con 0x7f5bc4159480 2024-09-13T16:01:27.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.858+0000 7f5bc9000640 1 -- 172.21.15.70:0/410115920 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc413bd60 con 0x7f5bc4159480 2024-09-13T16:01:27.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.858+0000 7f5bc9000640 1 -- 172.21.15.70:0/410115920 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc413c320 con 0x7f5bc4159480 2024-09-13T16:01:27.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.859+0000 7f5bc9000640 1 -- 172.21.15.70:0/410115920 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc4067360 con 0x7f5bc4159480 2024-09-13T16:01:27.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.860+0000 7f5bbb400640 1 -- 172.21.15.70:0/410115920 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5bbc007070 con 0x7f5bc4159480 2024-09-13T16:01:27.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.860+0000 7f5bbb400640 1 --2- 172.21.15.70:0/410115920 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5ba006ac00 0x7f5ba006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:27.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.860+0000 7f5bbb400640 1 -- 172.21.15.70:0/410115920 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bbc0891f0 con 0x7f5bc4159480 2024-09-13T16:01:27.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.861+0000 7f5bc3400640 1 --2- 172.21.15.70:0/410115920 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5ba006ac00 0x7f5ba006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:27.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.861+0000 7f5bc3400640 1 --2- 172.21.15.70:0/410115920 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5ba006ac00 0x7f5ba006d0c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4000f60 tx=0x7f5bb4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:27.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:27.864+0000 7f5bbb400640 1 -- 172.21.15.70:0/410115920 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5bbc054470 con 0x7f5bc4159480 2024-09-13T16:01:28.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.029+0000 7f5bc9000640 1 -- 172.21.15.70:0/410115920 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5bc40ce280 con 0x7f5ba006ac00 2024-09-13T16:01:28.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.036+0000 7f5bbb400640 1 -- 172.21.15.70:0/410115920 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264535 (secure 0 0 0) 0x7f5bb4001d10 con 0x7f5ba006ac00 2024-09-13T16:01:28.040 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:28.041 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-13T16:01:28.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.040+0000 7f5bc9000640 1 -- 172.21.15.70:0/410115920 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5ba006ac00 msgr2=0x7f5ba006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:28.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.040+0000 7f5bc9000640 1 --2- 172.21.15.70:0/410115920 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5ba006ac00 0x7f5ba006d0c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4000f60 tx=0x7f5bb4009040 comp rx=0 tx=0).stop 2024-09-13T16:01:28.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.040+0000 7f5bc9000640 1 -- 172.21.15.70:0/410115920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc4159480 msgr2=0x7f5bc413ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:28.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.040+0000 7f5bc9000640 1 --2- 172.21.15.70:0/410115920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc4159480 0x7f5bc413ce00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00cbf0 tx=0x7f5bbc00a430 comp rx=0 tx=0).stop 2024-09-13T16:01:28.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.040+0000 7f5bc9000640 1 -- 172.21.15.70:0/410115920 shutdown_connections 2024-09-13T16:01:28.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.040+0000 7f5bc9000640 1 --2- 172.21.15.70:0/410115920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc4159480 0x7f5bc413ce00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.040+0000 7f5bc9000640 1 --2- 172.21.15.70:0/410115920 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5bc4071560 0x7f5bc41f1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.040+0000 7f5bc9000640 1 --2- 172.21.15.70:0/410115920 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5ba006ac00 0x7f5ba006d0c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.040+0000 7f5bc9000640 1 --2- 172.21.15.70:0/410115920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bc406f4b0 0x7f5bc41e2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.040+0000 7f5bc9000640 1 -- 172.21.15.70:0/410115920 >> 172.21.15.70:0/410115920 conn(0x7f5bc40ae310 msgr2=0x7f5bc40b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:28.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.040+0000 7f5bc9000640 1 -- 172.21.15.70:0/410115920 shutdown_connections 2024-09-13T16:01:28.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.040+0000 7f5bc9000640 1 -- 172.21.15.70:0/410115920 wait complete. 2024-09-13T16:01:28.057 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-13T16:01:28.019668+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235384,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739336,"statfs":{"total":773094113280,"available":772853080064,"internally_reserved":0,"allocated":2887680,"data_stored":1751625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.419517"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411450+0000","last_change":"2024-09-13T16:01:18.644594+0000","last_active":"2024-09-13T16:01:20.411450+0000","last_peered":"2024-09-13T16:01:20.411450+0000","last_clean":"2024-09-13T16:01:20.411450+0000","last_became_active":"2024-09-13T16:01:18.644356+0000","last_became_peered":"2024-09-13T16:01:18.644356+0000","last_unstale":"2024-09-13T16:01:20.411450+0000","last_undegraded":"2024-09-13T16:01:20.411450+0000","last_fullsized":"2024-09-13T16:01:20.411450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:20.422612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603423+0000","last_change":"2024-09-13T16:01:18.624268+0000","last_active":"2024-09-13T16:01:19.603423+0000","last_peered":"2024-09-13T16:01:19.603423+0000","last_clean":"2024-09-13T16:01:19.603423+0000","last_became_active":"2024-09-13T16:01:18.624050+0000","last_became_peered":"2024-09-13T16:01:18.624050+0000","last_unstale":"2024-09-13T16:01:19.603423+0000","last_undegraded":"2024-09-13T16:01:19.603423+0000","last_fullsized":"2024-09-13T16:01:19.603423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411544+0000","last_change":"2024-09-13T16:01:18.623991+0000","last_active":"2024-09-13T16:01:20.411544+0000","last_peered":"2024-09-13T16:01:20.411544+0000","last_clean":"2024-09-13T16:01:20.411544+0000","last_became_active":"2024-09-13T16:01:18.623492+0000","last_became_peered":"2024-09-13T16:01:18.623492+0000","last_unstale":"2024-09-13T16:01:20.411544+0000","last_undegraded":"2024-09-13T16:01:20.411544+0000","last_fullsized":"2024-09-13T16:01:20.411544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:33:59.929449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414175+0000","last_change":"2024-09-13T16:01:18.630873+0000","last_active":"2024-09-13T16:01:20.414175+0000","last_peered":"2024-09-13T16:01:20.414175+0000","last_clean":"2024-09-13T16:01:20.414175+0000","last_became_active":"2024-09-13T16:01:18.630446+0000","last_became_peered":"2024-09-13T16:01:18.630446+0000","last_unstale":"2024-09-13T16:01:20.414175+0000","last_undegraded":"2024-09-13T16:01:20.414175+0000","last_fullsized":"2024-09-13T16:01:20.414175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:43.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411291+0000","last_change":"2024-09-13T16:01:18.637355+0000","last_active":"2024-09-13T16:01:20.411291+0000","last_peered":"2024-09-13T16:01:20.411291+0000","last_clean":"2024-09-13T16:01:20.411291+0000","last_became_active":"2024-09-13T16:01:18.637053+0000","last_became_peered":"2024-09-13T16:01:18.637053+0000","last_unstale":"2024-09-13T16:01:20.411291+0000","last_undegraded":"2024-09-13T16:01:20.411291+0000","last_fullsized":"2024-09-13T16:01:20.411291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:11.951128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414096+0000","last_change":"2024-09-13T16:01:18.626648+0000","last_active":"2024-09-13T16:01:20.414096+0000","last_peered":"2024-09-13T16:01:20.414096+0000","last_clean":"2024-09-13T16:01:20.414096+0000","last_became_active":"2024-09-13T16:01:18.625618+0000","last_became_peered":"2024-09-13T16:01:18.625618+0000","last_unstale":"2024-09-13T16:01:20.414096+0000","last_undegraded":"2024-09-13T16:01:20.414096+0000","last_fullsized":"2024-09-13T16:01:20.414096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:50.539415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411253+0000","last_change":"2024-09-13T16:01:18.632016+0000","last_active":"2024-09-13T16:01:20.411253+0000","last_peered":"2024-09-13T16:01:20.411253+0000","last_clean":"2024-09-13T16:01:20.411253+0000","last_became_active":"2024-09-13T16:01:18.631753+0000","last_became_peered":"2024-09-13T16:01:18.631753+0000","last_unstale":"2024-09-13T16:01:20.411253+0000","last_undegraded":"2024-09-13T16:01:20.411253+0000","last_fullsized":"2024-09-13T16:01:20.411253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:26.431089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411077+0000","last_change":"2024-09-13T16:01:18.628899+0000","last_active":"2024-09-13T16:01:20.411077+0000","last_peered":"2024-09-13T16:01:20.411077+0000","last_clean":"2024-09-13T16:01:20.411077+0000","last_became_active":"2024-09-13T16:01:18.628268+0000","last_became_peered":"2024-09-13T16:01:18.628268+0000","last_unstale":"2024-09-13T16:01:20.411077+0000","last_undegraded":"2024-09-13T16:01:20.411077+0000","last_fullsized":"2024-09-13T16:01:20.411077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:18.317702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411460+0000","last_change":"2024-09-13T16:01:18.641494+0000","last_active":"2024-09-13T16:01:20.411460+0000","last_peered":"2024-09-13T16:01:20.411460+0000","last_clean":"2024-09-13T16:01:20.411460+0000","last_became_active":"2024-09-13T16:01:18.641183+0000","last_became_peered":"2024-09-13T16:01:18.641183+0000","last_unstale":"2024-09-13T16:01:20.411460+0000","last_undegraded":"2024-09-13T16:01:20.411460+0000","last_fullsized":"2024-09-13T16:01:20.411460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:10.009263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604131+0000","last_change":"2024-09-13T16:01:18.632143+0000","last_active":"2024-09-13T16:01:19.604131+0000","last_peered":"2024-09-13T16:01:19.604131+0000","last_clean":"2024-09-13T16:01:19.604131+0000","last_became_active":"2024-09-13T16:01:18.630476+0000","last_became_peered":"2024-09-13T16:01:18.630476+0000","last_unstale":"2024-09-13T16:01:19.604131+0000","last_undegraded":"2024-09-13T16:01:19.604131+0000","last_fullsized":"2024-09-13T16:01:19.604131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:52.684760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603862+0000","last_change":"2024-09-13T16:01:18.626009+0000","last_active":"2024-09-13T16:01:19.603862+0000","last_peered":"2024-09-13T16:01:19.603862+0000","last_clean":"2024-09-13T16:01:19.603862+0000","last_became_active":"2024-09-13T16:01:18.625643+0000","last_became_peered":"2024-09-13T16:01:18.625643+0000","last_unstale":"2024-09-13T16:01:19.603862+0000","last_undegraded":"2024-09-13T16:01:19.603862+0000","last_fullsized":"2024-09-13T16:01:19.603862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411399+0000","last_change":"2024-09-13T16:01:18.619953+0000","last_active":"2024-09-13T16:01:20.411399+0000","last_peered":"2024-09-13T16:01:20.411399+0000","last_clean":"2024-09-13T16:01:20.411399+0000","last_became_active":"2024-09-13T16:01:18.619529+0000","last_became_peered":"2024-09-13T16:01:18.619529+0000","last_unstale":"2024-09-13T16:01:20.411399+0000","last_undegraded":"2024-09-13T16:01:20.411399+0000","last_fullsized":"2024-09-13T16:01:20.411399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:56.513378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411221+0000","last_change":"2024-09-13T16:01:18.611600+0000","last_active":"2024-09-13T16:01:20.411221+0000","last_peered":"2024-09-13T16:01:20.411221+0000","last_clean":"2024-09-13T16:01:20.411221+0000","last_became_active":"2024-09-13T16:01:18.611355+0000","last_became_peered":"2024-09-13T16:01:18.611355+0000","last_unstale":"2024-09-13T16:01:20.411221+0000","last_undegraded":"2024-09-13T16:01:20.411221+0000","last_fullsized":"2024-09-13T16:01:20.411221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:52.684760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411442+0000","last_change":"2024-09-13T16:01:18.626872+0000","last_active":"2024-09-13T16:01:20.411442+0000","last_peered":"2024-09-13T16:01:20.411442+0000","last_clean":"2024-09-13T16:01:20.411442+0000","last_became_active":"2024-09-13T16:01:18.625476+0000","last_became_peered":"2024-09-13T16:01:18.625476+0000","last_unstale":"2024-09-13T16:01:20.411442+0000","last_undegraded":"2024-09-13T16:01:20.411442+0000","last_fullsized":"2024-09-13T16:01:20.411442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:28.990573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603123+0000","last_change":"2024-09-13T16:01:18.630422+0000","last_active":"2024-09-13T16:01:19.603123+0000","last_peered":"2024-09-13T16:01:19.603123+0000","last_clean":"2024-09-13T16:01:19.603123+0000","last_became_active":"2024-09-13T16:01:18.630174+0000","last_became_peered":"2024-09-13T16:01:18.630174+0000","last_unstale":"2024-09-13T16:01:19.603123+0000","last_undegraded":"2024-09-13T16:01:19.603123+0000","last_fullsized":"2024-09-13T16:01:19.603123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:52.684760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414053+0000","last_change":"2024-09-13T16:01:18.625202+0000","last_active":"2024-09-13T16:01:20.414053+0000","last_peered":"2024-09-13T16:01:20.414053+0000","last_clean":"2024-09-13T16:01:20.414053+0000","last_became_active":"2024-09-13T16:01:18.624886+0000","last_became_peered":"2024-09-13T16:01:18.624886+0000","last_unstale":"2024-09-13T16:01:20.414053+0000","last_undegraded":"2024-09-13T16:01:20.414053+0000","last_fullsized":"2024-09-13T16:01:20.414053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:19.302417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414267+0000","last_change":"2024-09-13T16:01:18.621201+0000","last_active":"2024-09-13T16:01:20.414267+0000","last_peered":"2024-09-13T16:01:20.414267+0000","last_clean":"2024-09-13T16:01:20.414267+0000","last_became_active":"2024-09-13T16:01:18.620822+0000","last_became_peered":"2024-09-13T16:01:18.620822+0000","last_unstale":"2024-09-13T16:01:20.414267+0000","last_undegraded":"2024-09-13T16:01:20.414267+0000","last_fullsized":"2024-09-13T16:01:20.414267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:55.299980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603906+0000","last_change":"2024-09-13T16:01:18.621201+0000","last_active":"2024-09-13T16:01:19.603906+0000","last_peered":"2024-09-13T16:01:19.603906+0000","last_clean":"2024-09-13T16:01:19.603906+0000","last_became_active":"2024-09-13T16:01:18.619264+0000","last_became_peered":"2024-09-13T16:01:18.619264+0000","last_unstale":"2024-09-13T16:01:19.603906+0000","last_undegraded":"2024-09-13T16:01:19.603906+0000","last_fullsized":"2024-09-13T16:01:19.603906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:03.072242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411418+0000","last_change":"2024-09-13T16:01:18.635920+0000","last_active":"2024-09-13T16:01:20.411418+0000","last_peered":"2024-09-13T16:01:20.411418+0000","last_clean":"2024-09-13T16:01:20.411418+0000","last_became_active":"2024-09-13T16:01:18.634437+0000","last_became_peered":"2024-09-13T16:01:18.634437+0000","last_unstale":"2024-09-13T16:01:20.411418+0000","last_undegraded":"2024-09-13T16:01:20.411418+0000","last_fullsized":"2024-09-13T16:01:20.411418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:43.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603898+0000","last_change":"2024-09-13T16:01:18.618207+0000","last_active":"2024-09-13T16:01:19.603898+0000","last_peered":"2024-09-13T16:01:19.603898+0000","last_clean":"2024-09-13T16:01:19.603898+0000","last_became_active":"2024-09-13T16:01:18.617859+0000","last_became_peered":"2024-09-13T16:01:18.617859+0000","last_unstale":"2024-09-13T16:01:19.603898+0000","last_undegraded":"2024-09-13T16:01:19.603898+0000","last_fullsized":"2024-09-13T16:01:19.603898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:49.813372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411476+0000","last_change":"2024-09-13T16:01:18.627158+0000","last_active":"2024-09-13T16:01:20.411476+0000","last_peered":"2024-09-13T16:01:20.411476+0000","last_clean":"2024-09-13T16:01:20.411476+0000","last_became_active":"2024-09-13T16:01:18.627010+0000","last_became_peered":"2024-09-13T16:01:18.627010+0000","last_unstale":"2024-09-13T16:01:20.411476+0000","last_undegraded":"2024-09-13T16:01:20.411476+0000","last_fullsized":"2024-09-13T16:01:20.411476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:08.669688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414106+0000","last_change":"2024-09-13T16:01:18.625912+0000","last_active":"2024-09-13T16:01:20.414106+0000","last_peered":"2024-09-13T16:01:20.414106+0000","last_clean":"2024-09-13T16:01:20.414106+0000","last_became_active":"2024-09-13T16:01:18.625254+0000","last_became_peered":"2024-09-13T16:01:18.625254+0000","last_unstale":"2024-09-13T16:01:20.414106+0000","last_undegraded":"2024-09-13T16:01:20.414106+0000","last_fullsized":"2024-09-13T16:01:20.414106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:10.009263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411143+0000","last_change":"2024-09-13T16:01:18.628744+0000","last_active":"2024-09-13T16:01:20.411143+0000","last_peered":"2024-09-13T16:01:20.411143+0000","last_clean":"2024-09-13T16:01:20.411143+0000","last_became_active":"2024-09-13T16:01:18.628467+0000","last_became_peered":"2024-09-13T16:01:18.628467+0000","last_unstale":"2024-09-13T16:01:20.411143+0000","last_undegraded":"2024-09-13T16:01:20.411143+0000","last_fullsized":"2024-09-13T16:01:20.411143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:20.422612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414069+0000","last_change":"2024-09-13T16:01:18.634330+0000","last_active":"2024-09-13T16:01:20.414069+0000","last_peered":"2024-09-13T16:01:20.414069+0000","last_clean":"2024-09-13T16:01:20.414069+0000","last_became_active":"2024-09-13T16:01:18.633542+0000","last_became_peered":"2024-09-13T16:01:18.633542+0000","last_unstale":"2024-09-13T16:01:20.414069+0000","last_undegraded":"2024-09-13T16:01:20.414069+0000","last_fullsized":"2024-09-13T16:01:20.414069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411358+0000","last_change":"2024-09-13T16:01:18.615790+0000","last_active":"2024-09-13T16:01:20.411358+0000","last_peered":"2024-09-13T16:01:20.411358+0000","last_clean":"2024-09-13T16:01:20.411358+0000","last_became_active":"2024-09-13T16:01:18.615102+0000","last_became_peered":"2024-09-13T16:01:18.615102+0000","last_unstale":"2024-09-13T16:01:20.411358+0000","last_undegraded":"2024-09-13T16:01:20.411358+0000","last_fullsized":"2024-09-13T16:01:20.411358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:28.548177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604211+0000","last_change":"2024-09-13T16:01:18.619972+0000","last_active":"2024-09-13T16:01:19.604211+0000","last_peered":"2024-09-13T16:01:19.604211+0000","last_clean":"2024-09-13T16:01:19.604211+0000","last_became_active":"2024-09-13T16:01:18.619393+0000","last_became_peered":"2024-09-13T16:01:18.619393+0000","last_unstale":"2024-09-13T16:01:19.604211+0000","last_undegraded":"2024-09-13T16:01:19.604211+0000","last_fullsized":"2024-09-13T16:01:19.604211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603306+0000","last_change":"2024-09-13T16:01:18.604836+0000","last_active":"2024-09-13T16:01:19.603306+0000","last_peered":"2024-09-13T16:01:19.603306+0000","last_clean":"2024-09-13T16:01:19.603306+0000","last_became_active":"2024-09-13T16:01:18.604598+0000","last_became_peered":"2024-09-13T16:01:18.604598+0000","last_unstale":"2024-09-13T16:01:19.603306+0000","last_undegraded":"2024-09-13T16:01:19.603306+0000","last_fullsized":"2024-09-13T16:01:19.603306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:19.302417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411290+0000","last_change":"2024-09-13T16:01:18.624936+0000","last_active":"2024-09-13T16:01:20.411290+0000","last_peered":"2024-09-13T16:01:20.411290+0000","last_clean":"2024-09-13T16:01:20.411290+0000","last_became_active":"2024-09-13T16:01:18.619895+0000","last_became_peered":"2024-09-13T16:01:18.619895+0000","last_unstale":"2024-09-13T16:01:20.411290+0000","last_undegraded":"2024-09-13T16:01:20.411290+0000","last_fullsized":"2024-09-13T16:01:20.411290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:11.951128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411491+0000","last_change":"2024-09-13T16:01:18.618591+0000","last_active":"2024-09-13T16:01:20.411491+0000","last_peered":"2024-09-13T16:01:20.411491+0000","last_clean":"2024-09-13T16:01:20.411491+0000","last_became_active":"2024-09-13T16:01:18.618365+0000","last_became_peered":"2024-09-13T16:01:18.618365+0000","last_unstale":"2024-09-13T16:01:20.411491+0000","last_undegraded":"2024-09-13T16:01:20.411491+0000","last_fullsized":"2024-09-13T16:01:20.411491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:52.684760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414116+0000","last_change":"2024-09-13T16:01:18.618017+0000","last_active":"2024-09-13T16:01:20.414116+0000","last_peered":"2024-09-13T16:01:20.414116+0000","last_clean":"2024-09-13T16:01:20.414116+0000","last_became_active":"2024-09-13T16:01:18.617614+0000","last_became_peered":"2024-09-13T16:01:18.617614+0000","last_unstale":"2024-09-13T16:01:20.414116+0000","last_undegraded":"2024-09-13T16:01:20.414116+0000","last_fullsized":"2024-09-13T16:01:20.414116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:49.331305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603841+0000","last_change":"2024-09-13T16:01:18.619441+0000","last_active":"2024-09-13T16:01:19.603841+0000","last_peered":"2024-09-13T16:01:19.603841+0000","last_clean":"2024-09-13T16:01:19.603841+0000","last_became_active":"2024-09-13T16:01:18.619196+0000","last_became_peered":"2024-09-13T16:01:18.619196+0000","last_unstale":"2024-09-13T16:01:19.603841+0000","last_undegraded":"2024-09-13T16:01:19.603841+0000","last_fullsized":"2024-09-13T16:01:19.603841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:56.513378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603751+0000","last_change":"2024-09-13T16:01:18.629618+0000","last_active":"2024-09-13T16:01:19.603751+0000","last_peered":"2024-09-13T16:01:19.603751+0000","last_clean":"2024-09-13T16:01:19.603751+0000","last_became_active":"2024-09-13T16:01:18.625774+0000","last_became_peered":"2024-09-13T16:01:18.625774+0000","last_unstale":"2024-09-13T16:01:19.603751+0000","last_undegraded":"2024-09-13T16:01:19.603751+0000","last_fullsized":"2024-09-13T16:01:19.603751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:54.527079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411355+0000","last_change":"2024-09-13T16:01:18.617833+0000","last_active":"2024-09-13T16:01:20.411355+0000","last_peered":"2024-09-13T16:01:20.411355+0000","last_clean":"2024-09-13T16:01:20.411355+0000","last_became_active":"2024-09-13T16:01:18.614256+0000","last_became_peered":"2024-09-13T16:01:18.614256+0000","last_unstale":"2024-09-13T16:01:20.411355+0000","last_undegraded":"2024-09-13T16:01:20.411355+0000","last_fullsized":"2024-09-13T16:01:20.411355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:28.217399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411252+0000","last_change":"2024-09-13T16:01:18.208438+0000","last_active":"2024-09-13T16:01:20.411252+0000","last_peered":"2024-09-13T16:01:20.411252+0000","last_clean":"2024-09-13T16:01:20.411252+0000","last_became_active":"2024-09-13T16:01:18.207954+0000","last_became_peered":"2024-09-13T16:01:18.207954+0000","last_unstale":"2024-09-13T16:01:20.411252+0000","last_undegraded":"2024-09-13T16:01:20.411252+0000","last_fullsized":"2024-09-13T16:01:20.411252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:41.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411507+0000","last_change":"2024-09-13T16:01:18.632108+0000","last_active":"2024-09-13T16:01:20.411507+0000","last_peered":"2024-09-13T16:01:20.411507+0000","last_clean":"2024-09-13T16:01:20.411507+0000","last_became_active":"2024-09-13T16:01:18.631731+0000","last_became_peered":"2024-09-13T16:01:18.631731+0000","last_unstale":"2024-09-13T16:01:20.411507+0000","last_undegraded":"2024-09-13T16:01:20.411507+0000","last_fullsized":"2024-09-13T16:01:20.411507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604145+0000","last_change":"2024-09-13T16:01:18.207085+0000","last_active":"2024-09-13T16:01:19.604145+0000","last_peered":"2024-09-13T16:01:19.604145+0000","last_clean":"2024-09-13T16:01:19.604145+0000","last_became_active":"2024-09-13T16:01:18.205734+0000","last_became_peered":"2024-09-13T16:01:18.205734+0000","last_unstale":"2024-09-13T16:01:19.604145+0000","last_undegraded":"2024-09-13T16:01:19.604145+0000","last_fullsized":"2024-09-13T16:01:19.604145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411188+0000","last_change":"2024-09-13T16:01:18.206489+0000","last_active":"2024-09-13T16:01:20.411188+0000","last_peered":"2024-09-13T16:01:20.411188+0000","last_clean":"2024-09-13T16:01:20.411188+0000","last_became_active":"2024-09-13T16:01:18.206251+0000","last_became_peered":"2024-09-13T16:01:18.206251+0000","last_unstale":"2024-09-13T16:01:20.411188+0000","last_undegraded":"2024-09-13T16:01:20.411188+0000","last_fullsized":"2024-09-13T16:01:20.411188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411108+0000","last_change":"2024-09-13T16:01:18.629111+0000","last_active":"2024-09-13T16:01:20.411108+0000","last_peered":"2024-09-13T16:01:20.411108+0000","last_clean":"2024-09-13T16:01:20.411108+0000","last_became_active":"2024-09-13T16:01:18.628667+0000","last_became_peered":"2024-09-13T16:01:18.628667+0000","last_unstale":"2024-09-13T16:01:20.411108+0000","last_undegraded":"2024-09-13T16:01:20.411108+0000","last_fullsized":"2024-09-13T16:01:20.411108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:49.813372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414086+0000","last_change":"2024-09-13T16:01:18.201791+0000","last_active":"2024-09-13T16:01:20.414086+0000","last_peered":"2024-09-13T16:01:20.414086+0000","last_clean":"2024-09-13T16:01:20.414086+0000","last_became_active":"2024-09-13T16:01:18.201494+0000","last_became_peered":"2024-09-13T16:01:18.201494+0000","last_unstale":"2024-09-13T16:01:20.414086+0000","last_undegraded":"2024-09-13T16:01:20.414086+0000","last_fullsized":"2024-09-13T16:01:20.414086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:29.574043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603176+0000","last_change":"2024-09-13T16:01:18.606975+0000","last_active":"2024-09-13T16:01:19.603176+0000","last_peered":"2024-09-13T16:01:19.603176+0000","last_clean":"2024-09-13T16:01:19.603176+0000","last_became_active":"2024-09-13T16:01:18.604210+0000","last_became_peered":"2024-09-13T16:01:18.604210+0000","last_unstale":"2024-09-13T16:01:19.603176+0000","last_undegraded":"2024-09-13T16:01:19.603176+0000","last_fullsized":"2024-09-13T16:01:19.603176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:18.317702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603997+0000","last_change":"2024-09-13T16:01:18.209833+0000","last_active":"2024-09-13T16:01:19.603997+0000","last_peered":"2024-09-13T16:01:19.603997+0000","last_clean":"2024-09-13T16:01:19.603997+0000","last_became_active":"2024-09-13T16:01:18.209539+0000","last_became_peered":"2024-09-13T16:01:18.209539+0000","last_unstale":"2024-09-13T16:01:19.603997+0000","last_undegraded":"2024-09-13T16:01:19.603997+0000","last_fullsized":"2024-09-13T16:01:19.603997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:29.574043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414247+0000","last_change":"2024-09-13T16:01:18.625735+0000","last_active":"2024-09-13T16:01:20.414247+0000","last_peered":"2024-09-13T16:01:20.414247+0000","last_clean":"2024-09-13T16:01:20.414247+0000","last_became_active":"2024-09-13T16:01:18.625512+0000","last_became_peered":"2024-09-13T16:01:18.625512+0000","last_unstale":"2024-09-13T16:01:20.414247+0000","last_undegraded":"2024-09-13T16:01:20.414247+0000","last_fullsized":"2024-09-13T16:01:20.414247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:26.431089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414257+0000","last_change":"2024-09-13T16:01:18.211782+0000","last_active":"2024-09-13T16:01:20.414257+0000","last_peered":"2024-09-13T16:01:20.414257+0000","last_clean":"2024-09-13T16:01:20.414257+0000","last_became_active":"2024-09-13T16:01:18.211163+0000","last_became_peered":"2024-09-13T16:01:18.211163+0000","last_unstale":"2024-09-13T16:01:20.414257+0000","last_undegraded":"2024-09-13T16:01:20.414257+0000","last_fullsized":"2024-09-13T16:01:20.414257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:33.908621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411611+0000","last_change":"2024-09-13T16:01:18.627394+0000","last_active":"2024-09-13T16:01:20.411611+0000","last_peered":"2024-09-13T16:01:20.411611+0000","last_clean":"2024-09-13T16:01:20.411611+0000","last_became_active":"2024-09-13T16:01:18.624519+0000","last_became_peered":"2024-09-13T16:01:18.624519+0000","last_unstale":"2024-09-13T16:01:20.411611+0000","last_undegraded":"2024-09-13T16:01:20.411611+0000","last_fullsized":"2024-09-13T16:01:20.411611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:49.813372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603339+0000","last_change":"2024-09-13T16:01:18.210433+0000","last_active":"2024-09-13T16:01:19.603339+0000","last_peered":"2024-09-13T16:01:19.603339+0000","last_clean":"2024-09-13T16:01:19.603339+0000","last_became_active":"2024-09-13T16:01:18.210161+0000","last_became_peered":"2024-09-13T16:01:18.210161+0000","last_unstale":"2024-09-13T16:01:19.603339+0000","last_undegraded":"2024-09-13T16:01:19.603339+0000","last_fullsized":"2024-09-13T16:01:19.603339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:55.507079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411417+0000","last_change":"2024-09-13T16:01:18.630661+0000","last_active":"2024-09-13T16:01:20.411417+0000","last_peered":"2024-09-13T16:01:20.411417+0000","last_clean":"2024-09-13T16:01:20.411417+0000","last_became_active":"2024-09-13T16:01:18.630386+0000","last_became_peered":"2024-09-13T16:01:18.630386+0000","last_unstale":"2024-09-13T16:01:20.411417+0000","last_undegraded":"2024-09-13T16:01:20.411417+0000","last_fullsized":"2024-09-13T16:01:20.411417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:34.993393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603975+0000","last_change":"2024-09-13T16:01:18.197317+0000","last_active":"2024-09-13T16:01:19.603975+0000","last_peered":"2024-09-13T16:01:19.603975+0000","last_clean":"2024-09-13T16:01:19.603975+0000","last_became_active":"2024-09-13T16:01:18.197022+0000","last_became_peered":"2024-09-13T16:01:18.197022+0000","last_unstale":"2024-09-13T16:01:19.603975+0000","last_undegraded":"2024-09-13T16:01:19.603975+0000","last_fullsized":"2024-09-13T16:01:19.603975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:11.867906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411366+0000","last_change":"2024-09-13T16:01:18.636601+0000","last_active":"2024-09-13T16:01:20.411366+0000","last_peered":"2024-09-13T16:01:20.411366+0000","last_clean":"2024-09-13T16:01:20.411366+0000","last_became_active":"2024-09-13T16:01:18.636246+0000","last_became_peered":"2024-09-13T16:01:18.636246+0000","last_unstale":"2024-09-13T16:01:20.411366+0000","last_undegraded":"2024-09-13T16:01:20.411366+0000","last_fullsized":"2024-09-13T16:01:20.411366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:55.299980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411525+0000","last_change":"2024-09-13T16:01:18.207068+0000","last_active":"2024-09-13T16:01:20.411525+0000","last_peered":"2024-09-13T16:01:20.411525+0000","last_clean":"2024-09-13T16:01:20.411525+0000","last_became_active":"2024-09-13T16:01:18.206783+0000","last_became_peered":"2024-09-13T16:01:18.206783+0000","last_unstale":"2024-09-13T16:01:20.411525+0000","last_undegraded":"2024-09-13T16:01:20.411525+0000","last_fullsized":"2024-09-13T16:01:20.411525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:47.286118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411460+0000","last_change":"2024-09-13T16:01:18.618465+0000","last_active":"2024-09-13T16:01:20.411460+0000","last_peered":"2024-09-13T16:01:20.411460+0000","last_clean":"2024-09-13T16:01:20.411460+0000","last_became_active":"2024-09-13T16:01:18.618200+0000","last_became_peered":"2024-09-13T16:01:18.618200+0000","last_unstale":"2024-09-13T16:01:20.411460+0000","last_undegraded":"2024-09-13T16:01:20.411460+0000","last_fullsized":"2024-09-13T16:01:20.411460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:54.527079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414144+0000","last_change":"2024-09-13T16:01:18.208243+0000","last_active":"2024-09-13T16:01:20.414144+0000","last_peered":"2024-09-13T16:01:20.414144+0000","last_clean":"2024-09-13T16:01:20.414144+0000","last_became_active":"2024-09-13T16:01:18.207672+0000","last_became_peered":"2024-09-13T16:01:18.207672+0000","last_unstale":"2024-09-13T16:01:20.414144+0000","last_undegraded":"2024-09-13T16:01:20.414144+0000","last_fullsized":"2024-09-13T16:01:20.414144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411301+0000","last_change":"2024-09-13T16:01:18.639262+0000","last_active":"2024-09-13T16:01:20.411301+0000","last_peered":"2024-09-13T16:01:20.411301+0000","last_clean":"2024-09-13T16:01:20.411301+0000","last_became_active":"2024-09-13T16:01:18.639026+0000","last_became_peered":"2024-09-13T16:01:18.639026+0000","last_unstale":"2024-09-13T16:01:20.411301+0000","last_undegraded":"2024-09-13T16:01:20.411301+0000","last_fullsized":"2024-09-13T16:01:20.411301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:49.331305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603731+0000","last_change":"2024-09-13T16:01:18.201169+0000","last_active":"2024-09-13T16:01:19.603731+0000","last_peered":"2024-09-13T16:01:19.603731+0000","last_clean":"2024-09-13T16:01:19.603731+0000","last_became_active":"2024-09-13T16:01:18.199492+0000","last_became_peered":"2024-09-13T16:01:18.199492+0000","last_unstale":"2024-09-13T16:01:19.603731+0000","last_undegraded":"2024-09-13T16:01:19.603731+0000","last_fullsized":"2024-09-13T16:01:19.603731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:41.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603772+0000","last_change":"2024-09-13T16:01:18.623233+0000","last_active":"2024-09-13T16:01:19.603772+0000","last_peered":"2024-09-13T16:01:19.603772+0000","last_clean":"2024-09-13T16:01:19.603772+0000","last_became_active":"2024-09-13T16:01:18.622853+0000","last_became_peered":"2024-09-13T16:01:18.622853+0000","last_unstale":"2024-09-13T16:01:19.603772+0000","last_undegraded":"2024-09-13T16:01:19.603772+0000","last_fullsized":"2024-09-13T16:01:19.603772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:08.669688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603832+0000","last_change":"2024-09-13T16:01:18.199011+0000","last_active":"2024-09-13T16:01:19.603832+0000","last_peered":"2024-09-13T16:01:19.603832+0000","last_clean":"2024-09-13T16:01:19.603832+0000","last_became_active":"2024-09-13T16:01:18.198645+0000","last_became_peered":"2024-09-13T16:01:18.198645+0000","last_unstale":"2024-09-13T16:01:19.603832+0000","last_undegraded":"2024-09-13T16:01:19.603832+0000","last_fullsized":"2024-09-13T16:01:19.603832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:37.847292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411280+0000","last_change":"2024-09-13T16:01:18.638935+0000","last_active":"2024-09-13T16:01:20.411280+0000","last_peered":"2024-09-13T16:01:20.411280+0000","last_clean":"2024-09-13T16:01:20.411280+0000","last_became_active":"2024-09-13T16:01:18.638609+0000","last_became_peered":"2024-09-13T16:01:18.638609+0000","last_unstale":"2024-09-13T16:01:20.411280+0000","last_undegraded":"2024-09-13T16:01:20.411280+0000","last_fullsized":"2024-09-13T16:01:20.411280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411436+0000","last_change":"2024-09-13T16:01:18.203508+0000","last_active":"2024-09-13T16:01:20.411436+0000","last_peered":"2024-09-13T16:01:20.411436+0000","last_clean":"2024-09-13T16:01:20.411436+0000","last_became_active":"2024-09-13T16:01:18.203203+0000","last_became_peered":"2024-09-13T16:01:18.203203+0000","last_unstale":"2024-09-13T16:01:20.411436+0000","last_undegraded":"2024-09-13T16:01:20.411436+0000","last_fullsized":"2024-09-13T16:01:20.411436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:47.286118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411440+0000","last_change":"2024-09-13T16:01:18.639508+0000","last_active":"2024-09-13T16:01:20.411440+0000","last_peered":"2024-09-13T16:01:20.411440+0000","last_clean":"2024-09-13T16:01:20.411440+0000","last_became_active":"2024-09-13T16:01:18.638478+0000","last_became_peered":"2024-09-13T16:01:18.638478+0000","last_unstale":"2024-09-13T16:01:20.411440+0000","last_undegraded":"2024-09-13T16:01:20.411440+0000","last_fullsized":"2024-09-13T16:01:20.411440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:50.539415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603994+0000","last_change":"2024-09-13T16:01:18.201769+0000","last_active":"2024-09-13T16:01:19.603994+0000","last_peered":"2024-09-13T16:01:19.603994+0000","last_clean":"2024-09-13T16:01:19.603994+0000","last_became_active":"2024-09-13T16:01:18.198080+0000","last_became_peered":"2024-09-13T16:01:18.198080+0000","last_unstale":"2024-09-13T16:01:19.603994+0000","last_undegraded":"2024-09-13T16:01:19.603994+0000","last_fullsized":"2024-09-13T16:01:19.603994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411472+0000","last_change":"2024-09-13T16:01:18.638606+0000","last_active":"2024-09-13T16:01:20.411472+0000","last_peered":"2024-09-13T16:01:20.411472+0000","last_clean":"2024-09-13T16:01:20.411472+0000","last_became_active":"2024-09-13T16:01:18.638374+0000","last_became_peered":"2024-09-13T16:01:18.638374+0000","last_unstale":"2024-09-13T16:01:20.411472+0000","last_undegraded":"2024-09-13T16:01:20.411472+0000","last_fullsized":"2024-09-13T16:01:20.411472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:28.548177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603399+0000","last_change":"2024-09-13T16:01:18.210255+0000","last_active":"2024-09-13T16:01:19.603399+0000","last_peered":"2024-09-13T16:01:19.603399+0000","last_clean":"2024-09-13T16:01:19.603399+0000","last_became_active":"2024-09-13T16:01:18.210014+0000","last_became_peered":"2024-09-13T16:01:18.210014+0000","last_unstale":"2024-09-13T16:01:19.603399+0000","last_undegraded":"2024-09-13T16:01:19.603399+0000","last_fullsized":"2024-09-13T16:01:19.603399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:02.065942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414195+0000","last_change":"2024-09-13T16:01:18.630699+0000","last_active":"2024-09-13T16:01:20.414195+0000","last_peered":"2024-09-13T16:01:20.414195+0000","last_clean":"2024-09-13T16:01:20.414195+0000","last_became_active":"2024-09-13T16:01:18.630007+0000","last_became_peered":"2024-09-13T16:01:18.630007+0000","last_unstale":"2024-09-13T16:01:20.414195+0000","last_undegraded":"2024-09-13T16:01:20.414195+0000","last_fullsized":"2024-09-13T16:01:20.414195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:28.548177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603901+0000","last_change":"2024-09-13T16:01:18.208200+0000","last_active":"2024-09-13T16:01:19.603901+0000","last_peered":"2024-09-13T16:01:19.603901+0000","last_clean":"2024-09-13T16:01:19.603901+0000","last_became_active":"2024-09-13T16:01:18.206473+0000","last_became_peered":"2024-09-13T16:01:18.206473+0000","last_unstale":"2024-09-13T16:01:19.603901+0000","last_undegraded":"2024-09-13T16:01:19.603901+0000","last_fullsized":"2024-09-13T16:01:19.603901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:41.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411376+0000","last_change":"2024-09-13T16:01:18.637343+0000","last_active":"2024-09-13T16:01:20.411376+0000","last_peered":"2024-09-13T16:01:20.411376+0000","last_clean":"2024-09-13T16:01:20.411376+0000","last_became_active":"2024-09-13T16:01:18.637052+0000","last_became_peered":"2024-09-13T16:01:18.637052+0000","last_unstale":"2024-09-13T16:01:20.411376+0000","last_undegraded":"2024-09-13T16:01:20.411376+0000","last_fullsized":"2024-09-13T16:01:20.411376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:40:45.237966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:18.618812+0000","last_change":"2024-09-13T16:01:07.580186+0000","last_active":"2024-09-13T16:01:18.618812+0000","last_peered":"2024-09-13T16:01:18.618812+0000","last_clean":"2024-09-13T16:01:18.618812+0000","last_became_active":"2024-09-13T16:01:07.579877+0000","last_became_peered":"2024-09-13T16:01:07.579877+0000","last_unstale":"2024-09-13T16:01:18.618812+0000","last_undegraded":"2024-09-13T16:01:18.618812+0000","last_fullsized":"2024-09-13T16:01:18.618812+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_clean_scrub_stamp":"2024-09-13T16:01:06.070807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:40.645649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414165+0000","last_change":"2024-09-13T16:01:18.204628+0000","last_active":"2024-09-13T16:01:20.414165+0000","last_peered":"2024-09-13T16:01:20.414165+0000","last_clean":"2024-09-13T16:01:20.414165+0000","last_became_active":"2024-09-13T16:01:18.204302+0000","last_became_peered":"2024-09-13T16:01:18.204302+0000","last_unstale":"2024-09-13T16:01:20.414165+0000","last_undegraded":"2024-09-13T16:01:20.414165+0000","last_fullsized":"2024-09-13T16:01:20.414165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:33.987093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411205+0000","last_change":"2024-09-13T16:01:18.622448+0000","last_active":"2024-09-13T16:01:20.411205+0000","last_peered":"2024-09-13T16:01:20.411205+0000","last_clean":"2024-09-13T16:01:20.411205+0000","last_became_active":"2024-09-13T16:01:18.621087+0000","last_became_peered":"2024-09-13T16:01:18.621087+0000","last_unstale":"2024-09-13T16:01:20.411205+0000","last_undegraded":"2024-09-13T16:01:20.411205+0000","last_fullsized":"2024-09-13T16:01:20.411205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:19.302417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411232+0000","last_change":"2024-09-13T16:01:18.210964+0000","last_active":"2024-09-13T16:01:20.411232+0000","last_peered":"2024-09-13T16:01:20.411232+0000","last_clean":"2024-09-13T16:01:20.411232+0000","last_became_active":"2024-09-13T16:01:18.210292+0000","last_became_peered":"2024-09-13T16:01:18.210292+0000","last_unstale":"2024-09-13T16:01:20.411232+0000","last_undegraded":"2024-09-13T16:01:20.411232+0000","last_fullsized":"2024-09-13T16:01:20.411232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:02.065942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411419+0000","last_change":"2024-09-13T16:01:18.630964+0000","last_active":"2024-09-13T16:01:20.411419+0000","last_peered":"2024-09-13T16:01:20.411419+0000","last_clean":"2024-09-13T16:01:20.411419+0000","last_became_active":"2024-09-13T16:01:18.630721+0000","last_became_peered":"2024-09-13T16:01:18.630721+0000","last_unstale":"2024-09-13T16:01:20.411419+0000","last_undegraded":"2024-09-13T16:01:20.411419+0000","last_fullsized":"2024-09-13T16:01:20.411419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:25.722121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604000+0000","last_change":"2024-09-13T16:01:18.194594+0000","last_active":"2024-09-13T16:01:19.604000+0000","last_peered":"2024-09-13T16:01:19.604000+0000","last_clean":"2024-09-13T16:01:19.604000+0000","last_became_active":"2024-09-13T16:01:18.194321+0000","last_became_peered":"2024-09-13T16:01:18.194321+0000","last_unstale":"2024-09-13T16:01:19.604000+0000","last_undegraded":"2024-09-13T16:01:19.604000+0000","last_fullsized":"2024-09-13T16:01:19.604000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:46.038225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603131+0000","last_change":"2024-09-13T16:01:18.620982+0000","last_active":"2024-09-13T16:01:19.603131+0000","last_peered":"2024-09-13T16:01:19.603131+0000","last_clean":"2024-09-13T16:01:19.603131+0000","last_became_active":"2024-09-13T16:01:18.620567+0000","last_became_peered":"2024-09-13T16:01:18.620567+0000","last_unstale":"2024-09-13T16:01:19.603131+0000","last_undegraded":"2024-09-13T16:01:19.603131+0000","last_fullsized":"2024-09-13T16:01:19.603131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414156+0000","last_change":"2024-09-13T16:01:18.205821+0000","last_active":"2024-09-13T16:01:20.414156+0000","last_peered":"2024-09-13T16:01:20.414156+0000","last_clean":"2024-09-13T16:01:20.414156+0000","last_became_active":"2024-09-13T16:01:18.205559+0000","last_became_peered":"2024-09-13T16:01:18.205559+0000","last_unstale":"2024-09-13T16:01:20.414156+0000","last_undegraded":"2024-09-13T16:01:20.414156+0000","last_fullsized":"2024-09-13T16:01:20.414156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:41.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411380+0000","last_change":"2024-09-13T16:01:18.621751+0000","last_active":"2024-09-13T16:01:20.411380+0000","last_peered":"2024-09-13T16:01:20.411380+0000","last_clean":"2024-09-13T16:01:20.411380+0000","last_became_active":"2024-09-13T16:01:18.621504+0000","last_became_peered":"2024-09-13T16:01:18.621504+0000","last_unstale":"2024-09-13T16:01:20.411380+0000","last_undegraded":"2024-09-13T16:01:20.411380+0000","last_fullsized":"2024-09-13T16:01:20.411380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:03.072242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603362+0000","last_change":"2024-09-13T16:01:18.199824+0000","last_active":"2024-09-13T16:01:19.603362+0000","last_peered":"2024-09-13T16:01:19.603362+0000","last_clean":"2024-09-13T16:01:19.603362+0000","last_became_active":"2024-09-13T16:01:18.199321+0000","last_became_peered":"2024-09-13T16:01:18.199321+0000","last_unstale":"2024-09-13T16:01:19.603362+0000","last_undegraded":"2024-09-13T16:01:19.603362+0000","last_fullsized":"2024-09-13T16:01:19.603362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414215+0000","last_change":"2024-09-13T16:01:18.632613+0000","last_active":"2024-09-13T16:01:20.414215+0000","last_peered":"2024-09-13T16:01:20.414215+0000","last_clean":"2024-09-13T16:01:20.414215+0000","last_became_active":"2024-09-13T16:01:18.632389+0000","last_became_peered":"2024-09-13T16:01:18.632389+0000","last_unstale":"2024-09-13T16:01:20.414215+0000","last_undegraded":"2024-09-13T16:01:20.414215+0000","last_fullsized":"2024-09-13T16:01:20.414215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411431+0000","last_change":"2024-09-13T16:01:18.212308+0000","last_active":"2024-09-13T16:01:20.411431+0000","last_peered":"2024-09-13T16:01:20.411431+0000","last_clean":"2024-09-13T16:01:20.411431+0000","last_became_active":"2024-09-13T16:01:18.210307+0000","last_became_peered":"2024-09-13T16:01:18.210307+0000","last_unstale":"2024-09-13T16:01:20.411431+0000","last_undegraded":"2024-09-13T16:01:20.411431+0000","last_fullsized":"2024-09-13T16:01:20.411431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:33.908621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603286+0000","last_change":"2024-09-13T16:01:18.616853+0000","last_active":"2024-09-13T16:01:19.603286+0000","last_peered":"2024-09-13T16:01:19.603286+0000","last_clean":"2024-09-13T16:01:19.603286+0000","last_became_active":"2024-09-13T16:01:18.616581+0000","last_became_peered":"2024-09-13T16:01:18.616581+0000","last_unstale":"2024-09-13T16:01:19.603286+0000","last_undegraded":"2024-09-13T16:01:19.603286+0000","last_fullsized":"2024-09-13T16:01:19.603286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:49.813372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.412593+0000","last_change":"2024-09-13T16:01:18.211147+0000","last_active":"2024-09-13T16:01:20.412593+0000","last_peered":"2024-09-13T16:01:20.412593+0000","last_clean":"2024-09-13T16:01:20.412593+0000","last_became_active":"2024-09-13T16:01:18.210496+0000","last_became_peered":"2024-09-13T16:01:18.210496+0000","last_unstale":"2024-09-13T16:01:20.412593+0000","last_undegraded":"2024-09-13T16:01:20.412593+0000","last_fullsized":"2024-09-13T16:01:20.412593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:33.987093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411374+0000","last_change":"2024-09-13T16:01:18.618984+0000","last_active":"2024-09-13T16:01:20.411374+0000","last_peered":"2024-09-13T16:01:20.411374+0000","last_clean":"2024-09-13T16:01:20.411374+0000","last_became_active":"2024-09-13T16:01:18.617587+0000","last_became_peered":"2024-09-13T16:01:18.617587+0000","last_unstale":"2024-09-13T16:01:20.411374+0000","last_undegraded":"2024-09-13T16:01:20.411374+0000","last_fullsized":"2024-09-13T16:01:20.411374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:43.702039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604083+0000","last_change":"2024-09-13T16:01:18.208715+0000","last_active":"2024-09-13T16:01:19.604083+0000","last_peered":"2024-09-13T16:01:19.604083+0000","last_clean":"2024-09-13T16:01:19.604083+0000","last_became_active":"2024-09-13T16:01:18.208008+0000","last_became_peered":"2024-09-13T16:01:18.208008+0000","last_unstale":"2024-09-13T16:01:19.604083+0000","last_undegraded":"2024-09-13T16:01:19.604083+0000","last_fullsized":"2024-09-13T16:01:19.604083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:33.908621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411559+0000","last_change":"2024-09-13T16:01:18.627736+0000","last_active":"2024-09-13T16:01:20.411559+0000","last_peered":"2024-09-13T16:01:20.411559+0000","last_clean":"2024-09-13T16:01:20.411559+0000","last_became_active":"2024-09-13T16:01:18.627485+0000","last_became_peered":"2024-09-13T16:01:18.627485+0000","last_unstale":"2024-09-13T16:01:20.411559+0000","last_undegraded":"2024-09-13T16:01:20.411559+0000","last_fullsized":"2024-09-13T16:01:20.411559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:30.675930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411214+0000","last_change":"2024-09-13T16:01:18.208002+0000","last_active":"2024-09-13T16:01:20.411214+0000","last_peered":"2024-09-13T16:01:20.411214+0000","last_clean":"2024-09-13T16:01:20.411214+0000","last_became_active":"2024-09-13T16:01:18.207573+0000","last_became_peered":"2024-09-13T16:01:18.207573+0000","last_unstale":"2024-09-13T16:01:20.411214+0000","last_undegraded":"2024-09-13T16:01:20.411214+0000","last_fullsized":"2024-09-13T16:01:20.411214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:29.574043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411330+0000","last_change":"2024-09-13T16:01:18.624658+0000","last_active":"2024-09-13T16:01:20.411330+0000","last_peered":"2024-09-13T16:01:20.411330+0000","last_clean":"2024-09-13T16:01:20.411330+0000","last_became_active":"2024-09-13T16:01:18.623850+0000","last_became_peered":"2024-09-13T16:01:18.623850+0000","last_unstale":"2024-09-13T16:01:20.411330+0000","last_undegraded":"2024-09-13T16:01:20.411330+0000","last_fullsized":"2024-09-13T16:01:20.411330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:30.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603214+0000","last_change":"2024-09-13T16:01:18.207621+0000","last_active":"2024-09-13T16:01:19.603214+0000","last_peered":"2024-09-13T16:01:19.603214+0000","last_clean":"2024-09-13T16:01:19.603214+0000","last_became_active":"2024-09-13T16:01:18.207360+0000","last_became_peered":"2024-09-13T16:01:18.207360+0000","last_unstale":"2024-09-13T16:01:19.603214+0000","last_undegraded":"2024-09-13T16:01:19.603214+0000","last_fullsized":"2024-09-13T16:01:19.603214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:27.211100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411125+0000","last_change":"2024-09-13T16:01:18.604618+0000","last_active":"2024-09-13T16:01:20.411125+0000","last_peered":"2024-09-13T16:01:20.411125+0000","last_clean":"2024-09-13T16:01:20.411125+0000","last_became_active":"2024-09-13T16:01:18.604304+0000","last_became_peered":"2024-09-13T16:01:18.604304+0000","last_unstale":"2024-09-13T16:01:20.411125+0000","last_undegraded":"2024-09-13T16:01:20.411125+0000","last_fullsized":"2024-09-13T16:01:20.411125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.603327+0000","last_change":"2024-09-13T16:01:18.199347+0000","last_active":"2024-09-13T16:01:19.603327+0000","last_peered":"2024-09-13T16:01:19.603327+0000","last_clean":"2024-09-13T16:01:19.603327+0000","last_became_active":"2024-09-13T16:01:18.198961+0000","last_became_peered":"2024-09-13T16:01:18.198961+0000","last_unstale":"2024-09-13T16:01:19.603327+0000","last_undegraded":"2024-09-13T16:01:19.603327+0000","last_fullsized":"2024-09-13T16:01:19.603327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:29.574043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411236+0000","last_change":"2024-09-13T16:01:18.616823+0000","last_active":"2024-09-13T16:01:20.411236+0000","last_peered":"2024-09-13T16:01:20.411236+0000","last_clean":"2024-09-13T16:01:20.411236+0000","last_became_active":"2024-09-13T16:01:18.616569+0000","last_became_peered":"2024-09-13T16:01:18.616569+0000","last_unstale":"2024-09-13T16:01:20.411236+0000","last_undegraded":"2024-09-13T16:01:20.411236+0000","last_fullsized":"2024-09-13T16:01:20.411236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:35.121278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411338+0000","last_change":"2024-09-13T16:01:18.214426+0000","last_active":"2024-09-13T16:01:20.411338+0000","last_peered":"2024-09-13T16:01:20.411338+0000","last_clean":"2024-09-13T16:01:20.411338+0000","last_became_active":"2024-09-13T16:01:18.214087+0000","last_became_peered":"2024-09-13T16:01:18.214087+0000","last_unstale":"2024-09-13T16:01:20.411338+0000","last_undegraded":"2024-09-13T16:01:20.411338+0000","last_fullsized":"2024-09-13T16:01:20.411338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:16.399080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T16:01:19.604128+0000","last_change":"2024-09-13T16:01:18.620356+0000","last_active":"2024-09-13T16:01:19.604128+0000","last_peered":"2024-09-13T16:01:19.604128+0000","last_clean":"2024-09-13T16:01:19.604128+0000","last_became_active":"2024-09-13T16:01:18.620060+0000","last_became_peered":"2024-09-13T16:01:18.620060+0000","last_unstale":"2024-09-13T16:01:19.604128+0000","last_undegraded":"2024-09-13T16:01:19.604128+0000","last_fullsized":"2024-09-13T16:01:19.604128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:25.722121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414206+0000","last_change":"2024-09-13T16:01:18.638326+0000","last_active":"2024-09-13T16:01:20.414206+0000","last_peered":"2024-09-13T16:01:20.414206+0000","last_clean":"2024-09-13T16:01:20.414206+0000","last_became_active":"2024-09-13T16:01:18.638047+0000","last_became_peered":"2024-09-13T16:01:18.638047+0000","last_unstale":"2024-09-13T16:01:20.414206+0000","last_undegraded":"2024-09-13T16:01:20.414206+0000","last_fullsized":"2024-09-13T16:01:20.414206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:20.422612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411352+0000","last_change":"2024-09-13T16:01:18.213077+0000","last_active":"2024-09-13T16:01:20.411352+0000","last_peered":"2024-09-13T16:01:20.411352+0000","last_clean":"2024-09-13T16:01:20.411352+0000","last_became_active":"2024-09-13T16:01:18.212732+0000","last_became_peered":"2024-09-13T16:01:18.212732+0000","last_unstale":"2024-09-13T16:01:20.411352+0000","last_undegraded":"2024-09-13T16:01:20.411352+0000","last_fullsized":"2024-09-13T16:01:20.411352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:55.507079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.414185+0000","last_change":"2024-09-13T16:01:18.623915+0000","last_active":"2024-09-13T16:01:20.414185+0000","last_peered":"2024-09-13T16:01:20.414185+0000","last_clean":"2024-09-13T16:01:20.414185+0000","last_became_active":"2024-09-13T16:01:18.623420+0000","last_became_peered":"2024-09-13T16:01:18.623420+0000","last_unstale":"2024-09-13T16:01:20.414185+0000","last_undegraded":"2024-09-13T16:01:20.414185+0000","last_fullsized":"2024-09-13T16:01:20.414185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:11.951128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411389+0000","last_change":"2024-09-13T16:01:18.213257+0000","last_active":"2024-09-13T16:01:20.411389+0000","last_peered":"2024-09-13T16:01:20.411389+0000","last_clean":"2024-09-13T16:01:20.411389+0000","last_became_active":"2024-09-13T16:01:18.212675+0000","last_became_peered":"2024-09-13T16:01:18.212675+0000","last_unstale":"2024-09-13T16:01:20.411389+0000","last_undegraded":"2024-09-13T16:01:20.411389+0000","last_fullsized":"2024-09-13T16:01:20.411389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:33.987093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411595+0000","last_change":"2024-09-13T16:01:18.634167+0000","last_active":"2024-09-13T16:01:20.411595+0000","last_peered":"2024-09-13T16:01:20.411595+0000","last_clean":"2024-09-13T16:01:20.411595+0000","last_became_active":"2024-09-13T16:01:18.633922+0000","last_became_peered":"2024-09-13T16:01:18.633922+0000","last_unstale":"2024-09-13T16:01:20.411595+0000","last_undegraded":"2024-09-13T16:01:20.411595+0000","last_fullsized":"2024-09-13T16:01:20.411595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:23.293334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411324+0000","last_change":"2024-09-13T16:01:18.196431+0000","last_active":"2024-09-13T16:01:20.411324+0000","last_peered":"2024-09-13T16:01:20.411324+0000","last_clean":"2024-09-13T16:01:20.411324+0000","last_became_active":"2024-09-13T16:01:18.195952+0000","last_became_peered":"2024-09-13T16:01:18.195952+0000","last_unstale":"2024-09-13T16:01:20.411324+0000","last_undegraded":"2024-09-13T16:01:20.411324+0000","last_fullsized":"2024-09-13T16:01:20.411324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:11.867906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411307+0000","last_change":"2024-09-13T16:01:18.608250+0000","last_active":"2024-09-13T16:01:20.411307+0000","last_peered":"2024-09-13T16:01:20.411307+0000","last_clean":"2024-09-13T16:01:20.411307+0000","last_became_active":"2024-09-13T16:01:18.607998+0000","last_became_peered":"2024-09-13T16:01:18.607998+0000","last_unstale":"2024-09-13T16:01:20.411307+0000","last_undegraded":"2024-09-13T16:01:20.411307+0000","last_fullsized":"2024-09-13T16:01:20.411307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:18.175635+0000","last_clean_scrub_stamp":"2024-09-13T16:01:18.175635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:25.722121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T16:01:20.411627+0000","last_change":"2024-09-13T16:01:18.209539+0000","last_active":"2024-09-13T16:01:20.411627+0000","last_peered":"2024-09-13T16:01:20.411627+0000","last_clean":"2024-09-13T16:01:20.411627+0000","last_became_active":"2024-09-13T16:01:18.209329+0000","last_became_peered":"2024-09-13T16:01:18.209329+0000","last_unstale":"2024-09-13T16:01:20.411627+0000","last_undegraded":"2024-09-13T16:01:20.411627+0000","last_fullsized":"2024-09-13T16:01:20.411627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:17.169335+0000","last_clean_scrub_stamp":"2024-09-13T16:01:17.169335+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:46.038225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:01:28.062 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T16:01:28.062 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T16:01:28.062 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T16:01:28.062 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T16:01:28.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.247+0000 7f3502800640 1 Processor -- start 2024-09-13T16:01:28.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.247+0000 7f3502800640 1 -- start start 2024-09-13T16:01:28.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.249+0000 7f3502800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34fc159a80 0x7f34fc06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.249+0000 7f3502800640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34fc153f00 con 0x7f34fc153b20 2024-09-13T16:01:28.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.249+0000 7f3502800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34fc0b1a40 con 0x7f34fc0b3990 2024-09-13T16:01:28.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.249+0000 7f3502800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc0ce600 con 0x7f34fc159a80 2024-09-13T16:01:28.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.249+0000 7f34fb400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f34fc153b20 0x7f34fc0b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39240/0 (socket says 172.21.15.70:39240) 2024-09-13T16:01:28.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.249+0000 7f34fb400640 1 -- 172.21.15.70:0/1082271621 learned_addr learned my addr 172.21.15.70:0/1082271621 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:28.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.249+0000 7f34fa000640 1 -- 172.21.15.70:0/1082271621 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485999117 0 0) 0x7f34fc153f00 con 0x7f34fc153b20 2024-09-13T16:01:28.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.249+0000 7f34fa000640 1 -- 172.21.15.70:0/1082271621 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34e0003520 con 0x7f34fc153b20 2024-09-13T16:01:28.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.249+0000 7f34fbe00640 1 --2- 172.21.15.70:0/1082271621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34fc159a80 0x7f34fc06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34fa000640 1 -- 172.21.15.70:0/1082271621 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1559782117 0 0) 0x7f34e0003520 con 0x7f34fc153b20 2024-09-13T16:01:28.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34fa000640 1 -- 172.21.15.70:0/1082271621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34fc159a80 msgr2=0x7f34fc06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:28.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34fa000640 1 --2- 172.21.15.70:0/1082271621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34fc159a80 0x7f34fc06d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34fa000640 1 -- 172.21.15.70:0/1082271621 >> v1:172.21.15.107:6789/0 conn(0x7f34fc0b3990 legacy=0x7f34fc06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:28.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34fa000640 1 -- 172.21.15.70:0/1082271621 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc15a1f0 con 0x7f34fc153b20 2024-09-13T16:01:28.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34fa000640 1 -- 172.21.15.70:0/1082271621 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f34ec001670 con 0x7f34fc153b20 2024-09-13T16:01:28.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34fa000640 1 -- 172.21.15.70:0/1082271621 >> v1:172.21.15.70:6789/0 conn(0x7f34fc153b20 legacy=0x7f34fc0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:28.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34fa000640 1 --2- 172.21.15.70:0/1082271621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34fc159a80 0x7f34e00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34fa000640 1 --2- 172.21.15.70:0/1082271621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34e0003ee0 0x7f34e00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34fa000640 1 --2- 172.21.15.70:0/1082271621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34e0004d00 0x7f34e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34fa000640 1 -- 172.21.15.70:0/1082271621 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc0ce600 con 0x7f34e0003ee0 2024-09-13T16:01:28.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34fa000640 1 -- 172.21.15.70:0/1082271621 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e000b9e0 con 0x7f34e0004d00 2024-09-13T16:01:28.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34fa000640 1 -- 172.21.15.70:0/1082271621 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e000bba0 con 0x7f34fc159a80 2024-09-13T16:01:28.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34fb400640 1 --2- 172.21.15.70:0/1082271621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34fc159a80 0x7f34e00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34faa00640 1 --2- 172.21.15.70:0/1082271621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34e0003ee0 0x7f34e00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34fbe00640 1 --2- 172.21.15.70:0/1082271621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34e0004d00 0x7f34e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34faa00640 1 -- 172.21.15.70:0/1082271621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34fc159a80 msgr2=0x7f34e00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:28.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34faa00640 1 --2- 172.21.15.70:0/1082271621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34fc159a80 0x7f34e00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34faa00640 1 -- 172.21.15.70:0/1082271621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34e0004d00 msgr2=0x7f34e0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:28.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34faa00640 1 --2- 172.21.15.70:0/1082271621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34e0004d00 0x7f34e0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.250+0000 7f34faa00640 1 -- 172.21.15.70:0/1082271621 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e0003520 con 0x7f34e0003ee0 2024-09-13T16:01:28.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.251+0000 7f34faa00640 1 --2- 172.21.15.70:0/1082271621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34e0003ee0 0x7f34e00047c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f34e8001860 tx=0x7f34e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e714f8890741b1c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:28.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.252+0000 7f34fa000640 1 -- 172.21.15.70:0/1082271621 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e802ab40 con 0x7f34e0003ee0 2024-09-13T16:01:28.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.252+0000 7f34fa000640 1 -- 172.21.15.70:0/1082271621 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e802acc0 con 0x7f34e0003ee0 2024-09-13T16:01:28.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.252+0000 7f34fa000640 1 -- 172.21.15.70:0/1082271621 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e8032680 con 0x7f34e0003ee0 2024-09-13T16:01:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.252+0000 7f3502800640 1 -- 172.21.15.70:0/1082271621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34e0003ee0 msgr2=0x7f34e00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.252+0000 7f3502800640 1 --2- 172.21.15.70:0/1082271621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34e0003ee0 0x7f34e00047c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f34e8001860 tx=0x7f34e00057f0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.252+0000 7f34fbe00640 1 -- 172.21.15.70:0/1082271621 reap_dead start 2024-09-13T16:01:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.252+0000 7f3502800640 1 -- 172.21.15.70:0/1082271621 shutdown_connections 2024-09-13T16:01:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.252+0000 7f3502800640 1 -- 172.21.15.70:0/1082271621 >> 172.21.15.70:0/1082271621 conn(0x7f34fc0b0510 msgr2=0x7f34fc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.252+0000 7f3502800640 1 -- 172.21.15.70:0/1082271621 shutdown_connections 2024-09-13T16:01:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.252+0000 7f3502800640 1 -- 172.21.15.70:0/1082271621 wait complete. 2024-09-13T16:01:28.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.254+0000 7f3502800640 1 Processor -- start 2024-09-13T16:01:28.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.254+0000 7f3502800640 1 -- start start 2024-09-13T16:01:28.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.255+0000 7f3502800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34e0003ee0 0x7f34fc149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.255+0000 7f3502800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc153f00 0x7f34fc0af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.255+0000 7f3502800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34fc154380 0x7f34fc0afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.255+0000 7f3502800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc1496c0 con 0x7f34fc153f00 2024-09-13T16:01:28.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.255+0000 7f3502800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc156d90 con 0x7f34e0003ee0 2024-09-13T16:01:28.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.255+0000 7f3502800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc159540 con 0x7f34fc154380 2024-09-13T16:01:28.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.255+0000 7f34faa00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc153f00 0x7f34fc0af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.255+0000 7f34faa00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc153f00 0x7f34fc0af500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36276/0 (socket says 172.21.15.70:36276) 2024-09-13T16:01:28.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.255+0000 7f34faa00640 1 -- 172.21.15.70:0/2287879048 learned_addr learned my addr 172.21.15.70:0/2287879048 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:28.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.255+0000 7f34fb400640 1 --2- 172.21.15.70:0/2287879048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34e0003ee0 0x7f34fc149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.255+0000 7f34fbe00640 1 --2- 172.21.15.70:0/2287879048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34fc154380 0x7f34fc0afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.255+0000 7f34faa00640 1 -- 172.21.15.70:0/2287879048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34fc154380 msgr2=0x7f34fc0afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:28.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.255+0000 7f34faa00640 1 --2- 172.21.15.70:0/2287879048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34fc154380 0x7f34fc0afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.255+0000 7f34faa00640 1 -- 172.21.15.70:0/2287879048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34e0003ee0 msgr2=0x7f34fc149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:28.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.255+0000 7f34faa00640 1 --2- 172.21.15.70:0/2287879048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34e0003ee0 0x7f34fc149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.255+0000 7f34faa00640 1 -- 172.21.15.70:0/2287879048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc159260 con 0x7f34fc153f00 2024-09-13T16:01:28.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.255+0000 7f34fbe00640 1 --2- 172.21.15.70:0/2287879048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34fc154380 0x7f34fc0afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:28.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.256+0000 7f34faa00640 1 --2- 172.21.15.70:0/2287879048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc153f00 0x7f34fc0af500 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f34e8001780 tx=0x7f34e8001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:28.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.256+0000 7f34f3400640 1 -- 172.21.15.70:0/2287879048 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e80067d0 con 0x7f34fc153f00 2024-09-13T16:01:28.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.256+0000 7f34f3400640 1 -- 172.21.15.70:0/2287879048 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e8006930 con 0x7f34fc153f00 2024-09-13T16:01:28.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.256+0000 7f3502800640 1 -- 172.21.15.70:0/2287879048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34fc156740 con 0x7f34fc153f00 2024-09-13T16:01:28.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.256+0000 7f34f3400640 1 -- 172.21.15.70:0/2287879048 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e8006ce0 con 0x7f34fc153f00 2024-09-13T16:01:28.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.256+0000 7f3502800640 1 -- 172.21.15.70:0/2287879048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34fc158e10 con 0x7f34fc153f00 2024-09-13T16:01:28.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.257+0000 7f3502800640 1 -- 172.21.15.70:0/2287879048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34fc158fd0 con 0x7f34fc153f00 2024-09-13T16:01:28.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.258+0000 7f34f3400640 1 -- 172.21.15.70:0/2287879048 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f34e8039040 con 0x7f34fc153f00 2024-09-13T16:01:28.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.259+0000 7f34f3400640 1 --2- 172.21.15.70:0/2287879048 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f34dc06ac00 0x7f34dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.259+0000 7f34f3400640 1 -- 172.21.15.70:0/2287879048 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34e80a93d0 con 0x7f34fc153f00 2024-09-13T16:01:28.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.259+0000 7f34fb400640 1 --2- 172.21.15.70:0/2287879048 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f34dc06ac00 0x7f34dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.260+0000 7f34fb400640 1 --2- 172.21.15.70:0/2287879048 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f34dc06ac00 0x7f34dc06d0c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f34ec001cb0 tx=0x7f34ec000ef0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:28.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.264+0000 7f34f3400640 1 -- 172.21.15.70:0/2287879048 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f34e8074650 con 0x7f34fc153f00 2024-09-13T16:01:28.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.466+0000 7f3502800640 1 -- 172.21.15.70:0/2287879048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f34fc0b1ed0 con 0x7f34fc153f00 2024-09-13T16:01:28.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.466+0000 7f34f3400640 1 -- 172.21.15.70:0/2287879048 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f34e8077c70 con 0x7f34fc153f00 2024-09-13T16:01:28.468 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:28.468 INFO:teuthology.orchestra.run.smithi070.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T16:01:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.468+0000 7f3502800640 1 -- 172.21.15.70:0/2287879048 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f34dc06ac00 msgr2=0x7f34dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.468+0000 7f3502800640 1 --2- 172.21.15.70:0/2287879048 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f34dc06ac00 0x7f34dc06d0c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f34ec001cb0 tx=0x7f34ec000ef0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.468+0000 7f3502800640 1 -- 172.21.15.70:0/2287879048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc153f00 msgr2=0x7f34fc0af500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.468+0000 7f3502800640 1 --2- 172.21.15.70:0/2287879048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc153f00 0x7f34fc0af500 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f34e8001780 tx=0x7f34e8001230 comp rx=0 tx=0).stop 2024-09-13T16:01:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.468+0000 7f3502800640 1 -- 172.21.15.70:0/2287879048 shutdown_connections 2024-09-13T16:01:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.468+0000 7f3502800640 1 --2- 172.21.15.70:0/2287879048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34fc154380 0x7f34fc0afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.469+0000 7f3502800640 1 --2- 172.21.15.70:0/2287879048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc153f00 0x7f34fc0af500 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.469+0000 7f3502800640 1 --2- 172.21.15.70:0/2287879048 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f34dc06ac00 0x7f34dc06d0c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.469+0000 7f3502800640 1 --2- 172.21.15.70:0/2287879048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34e0003ee0 0x7f34fc149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.469+0000 7f3502800640 1 -- 172.21.15.70:0/2287879048 >> 172.21.15.70:0/2287879048 conn(0x7f34fc0b0510 msgr2=0x7f34fc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.469+0000 7f3502800640 1 -- 172.21.15.70:0/2287879048 shutdown_connections 2024-09-13T16:01:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.469+0000 7f3502800640 1 -- 172.21.15.70:0/2287879048 wait complete. 2024-09-13T16:01:28.485 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T16:01:28.485 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:28.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.636+0000 7f65ff000640 1 Processor -- start 2024-09-13T16:01:28.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.636+0000 7f65ff000640 1 -- start start 2024-09-13T16:01:28.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.637+0000 7f65ff000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f80b1b00 0x7f65f80cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.637+0000 7f65ff000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f65f80cde50 0x7f65f815a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.638+0000 7f65ff000640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f806bea0 con 0x7f65f815a520 2024-09-13T16:01:28.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.638+0000 7f65ff000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f806c180 con 0x7f65f80cde50 2024-09-13T16:01:28.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.638+0000 7f65ff000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f806c460 con 0x7f65f80b1b00 2024-09-13T16:01:28.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.638+0000 7f65f7e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f65f815a520 0x7f65f806b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39250/0 (socket says 172.21.15.70:39250) 2024-09-13T16:01:28.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.638+0000 7f65f7e00640 1 -- 172.21.15.70:0/2609099365 learned_addr learned my addr 172.21.15.70:0/2609099365 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:28.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.638+0000 7f65f7400640 1 -- 172.21.15.70:0/2609099365 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929131214 0 0) 0x7f65f806bea0 con 0x7f65f815a520 2024-09-13T16:01:28.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.638+0000 7f65f7400640 1 -- 172.21.15.70:0/2609099365 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65dc003520 con 0x7f65f815a520 2024-09-13T16:01:28.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.638+0000 7f65fd000640 1 --2- 172.21.15.70:0/2609099365 >> v2:172.21.15.107:3300/0 conn(0x7f65f80cde50 0x7f65f815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.638+0000 7f65efe00640 1 --2- 172.21.15.70:0/2609099365 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f80b1b00 0x7f65f80cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.638+0000 7f65f7400640 1 -- 172.21.15.70:0/2609099365 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1992319358 0 0) 0x7f65dc003520 con 0x7f65f815a520 2024-09-13T16:01:28.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.638+0000 7f65f7400640 1 -- 172.21.15.70:0/2609099365 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f80b1b00 msgr2=0x7f65f80cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:28.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.638+0000 7f65f7400640 1 --2- 172.21.15.70:0/2609099365 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f80b1b00 0x7f65f80cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.638+0000 7f65f7400640 1 -- 172.21.15.70:0/2609099365 >> v2:172.21.15.107:3300/0 conn(0x7f65f80cde50 msgr2=0x7f65f815a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:28.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.638+0000 7f65f7400640 1 --2- 172.21.15.70:0/2609099365 >> v2:172.21.15.107:3300/0 conn(0x7f65f80cde50 0x7f65f815a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.638+0000 7f65f7400640 1 -- 172.21.15.70:0/2609099365 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f806c740 con 0x7f65f815a520 2024-09-13T16:01:28.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.639+0000 7f65f7400640 1 -- 172.21.15.70:0/2609099365 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f65e8001670 con 0x7f65f815a520 2024-09-13T16:01:28.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.639+0000 7f65f7400640 1 -- 172.21.15.70:0/2609099365 >> v1:172.21.15.70:6789/0 conn(0x7f65f815a520 legacy=0x7f65f806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:28.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.639+0000 7f65f7400640 1 --2- 172.21.15.70:0/2609099365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc003970 0x7f65dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.639+0000 7f65f7400640 1 --2- 172.21.15.70:0/2609099365 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f80b1b00 0x7f65dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.639+0000 7f65f7400640 1 --2- 172.21.15.70:0/2609099365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65dc004d00 0x7f65dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.639+0000 7f65f7400640 1 -- 172.21.15.70:0/2609099365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f806c180 con 0x7f65dc003970 2024-09-13T16:01:28.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.639+0000 7f65f7400640 1 -- 172.21.15.70:0/2609099365 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f806c460 con 0x7f65dc004d00 2024-09-13T16:01:28.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.639+0000 7f65f7400640 1 -- 172.21.15.70:0/2609099365 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc00b980 con 0x7f65f80b1b00 2024-09-13T16:01:28.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.639+0000 7f65f7e00640 1 --2- 172.21.15.70:0/2609099365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc003970 0x7f65dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.639+0000 7f65fd000640 1 --2- 172.21.15.70:0/2609099365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65dc004d00 0x7f65dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.639+0000 7f65efe00640 1 --2- 172.21.15.70:0/2609099365 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f80b1b00 0x7f65dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.639+0000 7f65f7e00640 1 -- 172.21.15.70:0/2609099365 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f80b1b00 msgr2=0x7f65dc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:28.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.639+0000 7f65f7e00640 1 --2- 172.21.15.70:0/2609099365 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f80b1b00 0x7f65dc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.639+0000 7f65f7e00640 1 -- 172.21.15.70:0/2609099365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65dc004d00 msgr2=0x7f65dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:28.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.639+0000 7f65f7e00640 1 --2- 172.21.15.70:0/2609099365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65dc004d00 0x7f65dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.639+0000 7f65f7e00640 1 -- 172.21.15.70:0/2609099365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc003520 con 0x7f65dc003970 2024-09-13T16:01:28.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.639+0000 7f65efe00640 1 --2- 172.21.15.70:0/2609099365 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f80b1b00 0x7f65dc0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:28.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.639+0000 7f65fd000640 1 --2- 172.21.15.70:0/2609099365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65dc004d00 0x7f65dc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:28.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.640+0000 7f65f7e00640 1 --2- 172.21.15.70:0/2609099365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc003970 0x7f65dc003d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f65e800c1c0 tx=0x7f65dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5282b0923a235d15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:28.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.640+0000 7f65f7400640 1 -- 172.21.15.70:0/2609099365 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8005ad0 con 0x7f65dc003970 2024-09-13T16:01:28.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.640+0000 7f65f7400640 1 -- 172.21.15.70:0/2609099365 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e8005c30 con 0x7f65dc003970 2024-09-13T16:01:28.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.640+0000 7f65f7400640 1 -- 172.21.15.70:0/2609099365 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8007070 con 0x7f65dc003970 2024-09-13T16:01:28.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.641+0000 7f65ff000640 1 -- 172.21.15.70:0/2609099365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc003970 msgr2=0x7f65dc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:28.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.641+0000 7f65ff000640 1 --2- 172.21.15.70:0/2609099365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc003970 0x7f65dc003d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f65e800c1c0 tx=0x7f65dc0057f0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.641+0000 7f65fd000640 1 -- 172.21.15.70:0/2609099365 reap_dead start 2024-09-13T16:01:28.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.641+0000 7f65ff000640 1 -- 172.21.15.70:0/2609099365 shutdown_connections 2024-09-13T16:01:28.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.641+0000 7f65ff000640 1 -- 172.21.15.70:0/2609099365 >> 172.21.15.70:0/2609099365 conn(0x7f65f80b0510 msgr2=0x7f65f80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:28.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.641+0000 7f65ff000640 1 -- 172.21.15.70:0/2609099365 shutdown_connections 2024-09-13T16:01:28.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.641+0000 7f65ff000640 1 -- 172.21.15.70:0/2609099365 wait complete. 2024-09-13T16:01:28.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.643+0000 7f65ff000640 1 Processor -- start 2024-09-13T16:01:28.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.643+0000 7f65ff000640 1 -- start start 2024-09-13T16:01:28.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.644+0000 7f65ff000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65dc003970 0x7f65f81e2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.644+0000 7f65ff000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f8154590 0x7f65f8144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.644+0000 7f65ff000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65f81449d0 0x7f65f81e3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.644+0000 7f65ff000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f815bb30 con 0x7f65f81449d0 2024-09-13T16:01:28.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.644+0000 7f65ff000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f815c990 con 0x7f65dc003970 2024-09-13T16:01:28.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.644+0000 7f65ff000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f815bd80 con 0x7f65f8154590 2024-09-13T16:01:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.644+0000 7f65fd000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65f81449d0 0x7f65f81e3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.644+0000 7f65fd000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65f81449d0 0x7f65f81e3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36294/0 (socket says 172.21.15.70:36294) 2024-09-13T16:01:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.644+0000 7f65fd000640 1 -- 172.21.15.70:0/2634088945 learned_addr learned my addr 172.21.15.70:0/2634088945 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.644+0000 7f65f7e00640 1 --2- 172.21.15.70:0/2634088945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65dc003970 0x7f65f81e2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.644+0000 7f65efe00640 1 --2- 172.21.15.70:0/2634088945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f8154590 0x7f65f8144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.644+0000 7f65fd000640 1 -- 172.21.15.70:0/2634088945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f8154590 msgr2=0x7f65f8144010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.644+0000 7f65fd000640 1 --2- 172.21.15.70:0/2634088945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f8154590 0x7f65f8144010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.644+0000 7f65fd000640 1 -- 172.21.15.70:0/2634088945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65dc003970 msgr2=0x7f65f81e2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.644+0000 7f65fd000640 1 --2- 172.21.15.70:0/2634088945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65dc003970 0x7f65f81e2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.644+0000 7f65fd000640 1 -- 172.21.15.70:0/2634088945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f815c060 con 0x7f65f81449d0 2024-09-13T16:01:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.645+0000 7f65efe00640 1 --2- 172.21.15.70:0/2634088945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f8154590 0x7f65f8144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.645+0000 7f65fd000640 1 --2- 172.21.15.70:0/2634088945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65f81449d0 0x7f65f81e3740 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f65f806b530 tx=0x7f65f0010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.645+0000 7f65f4c00640 1 -- 172.21.15.70:0/2634088945 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f000e050 con 0x7f65f81449d0 2024-09-13T16:01:28.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.645+0000 7f65f4c00640 1 -- 172.21.15.70:0/2634088945 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f000f040 con 0x7f65f81449d0 2024-09-13T16:01:28.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.645+0000 7f65ff000640 1 -- 172.21.15.70:0/2634088945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f815c340 con 0x7f65f81449d0 2024-09-13T16:01:28.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.645+0000 7f65f4c00640 1 -- 172.21.15.70:0/2634088945 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f0003990 con 0x7f65f81449d0 2024-09-13T16:01:28.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.645+0000 7f65ff000640 1 -- 172.21.15.70:0/2634088945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f8144550 con 0x7f65f81449d0 2024-09-13T16:01:28.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.646+0000 7f65ff000640 1 -- 172.21.15.70:0/2634088945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f815cad0 con 0x7f65f81449d0 2024-09-13T16:01:28.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.647+0000 7f65f4c00640 1 -- 172.21.15.70:0/2634088945 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f65f0015440 con 0x7f65f81449d0 2024-09-13T16:01:28.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.648+0000 7f65f4c00640 1 --2- 172.21.15.70:0/2634088945 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f65d406ac30 0x7f65d406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.648+0000 7f65f4c00640 1 -- 172.21.15.70:0/2634088945 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65f0089860 con 0x7f65f81449d0 2024-09-13T16:01:28.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.648+0000 7f65f7e00640 1 --2- 172.21.15.70:0/2634088945 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f65d406ac30 0x7f65d406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.649+0000 7f65f7e00640 1 --2- 172.21.15.70:0/2634088945 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f65d406ac30 0x7f65d406d0f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f65e8033000 tx=0x7f65e802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:28.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.652+0000 7f65f4c00640 1 -- 172.21.15.70:0/2634088945 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f65f0054a40 con 0x7f65f81449d0 2024-09-13T16:01:28.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.821+0000 7f65ff000640 1 -- 172.21.15.70:0/2634088945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65f8071370 con 0x7f65f81449d0 2024-09-13T16:01:28.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.822+0000 7f65f4c00640 1 -- 172.21.15.70:0/2634088945 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f65f0058060 con 0x7f65f81449d0 2024-09-13T16:01:28.823 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:28.823 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:19.595458+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:28.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.824+0000 7f65ff000640 1 -- 172.21.15.70:0/2634088945 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f65d406ac30 msgr2=0x7f65d406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:28.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.824+0000 7f65ff000640 1 --2- 172.21.15.70:0/2634088945 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f65d406ac30 0x7f65d406d0f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f65e8033000 tx=0x7f65e802e000 comp rx=0 tx=0).stop 2024-09-13T16:01:28.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.824+0000 7f65ff000640 1 -- 172.21.15.70:0/2634088945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65f81449d0 msgr2=0x7f65f81e3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:28.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.824+0000 7f65ff000640 1 --2- 172.21.15.70:0/2634088945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65f81449d0 0x7f65f81e3740 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f65f806b530 tx=0x7f65f0010590 comp rx=0 tx=0).stop 2024-09-13T16:01:28.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.824+0000 7f65ff000640 1 -- 172.21.15.70:0/2634088945 shutdown_connections 2024-09-13T16:01:28.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.824+0000 7f65ff000640 1 --2- 172.21.15.70:0/2634088945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65f81449d0 0x7f65f81e3740 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.824+0000 7f65ff000640 1 --2- 172.21.15.70:0/2634088945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f8154590 0x7f65f8144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.824+0000 7f65ff000640 1 --2- 172.21.15.70:0/2634088945 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f65d406ac30 0x7f65d406d0f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.824+0000 7f65ff000640 1 --2- 172.21.15.70:0/2634088945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65dc003970 0x7f65f81e2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.824+0000 7f65ff000640 1 -- 172.21.15.70:0/2634088945 >> 172.21.15.70:0/2634088945 conn(0x7f65f80b0510 msgr2=0x7f65f80b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:28.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.824+0000 7f65ff000640 1 -- 172.21.15.70:0/2634088945 shutdown_connections 2024-09-13T16:01:28.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.824+0000 7f65ff000640 1 -- 172.21.15.70:0/2634088945 wait complete. 2024-09-13T16:01:28.841 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:01:06.070694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:01:16.922043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:01:17.580304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:01:28.842 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:01:28.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.994+0000 7f7125a00640 1 Processor -- start 2024-09-13T16:01:28.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.994+0000 7f7125a00640 1 -- start start 2024-09-13T16:01:28.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.995+0000 7f7125a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7120154ad0 0x7f71200cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.995+0000 7f7125a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f712006f830 0x7f712006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:28.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.995+0000 7f7125a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712006b7c0 con 0x7f71200ce2c0 2024-09-13T16:01:28.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.995+0000 7f7125a00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712006b5b0 con 0x7f712006f830 2024-09-13T16:01:28.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.995+0000 7f7125a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712006baa0 con 0x7f7120154ad0 2024-09-13T16:01:28.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.995+0000 7f7117e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f712006f830 0x7f712006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.995+0000 7f7117e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f712006f830 0x7f712006fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36310/0 (socket says 172.21.15.70:36310) 2024-09-13T16:01:28.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.995+0000 7f7117e00640 1 -- 172.21.15.70:0/2545448500 learned_addr learned my addr 172.21.15.70:0/2545448500 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:28.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.996+0000 7f711ea00640 1 --2- 172.21.15.70:0/2545448500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7120154ad0 0x7f71200cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:28.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.996+0000 7f7117e00640 1 -- 172.21.15.70:0/2545448500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7120154ad0 msgr2=0x7f71200cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:28.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.996+0000 7f7117e00640 1 --2- 172.21.15.70:0/2545448500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7120154ad0 0x7f71200cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:28.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.996+0000 7f7117e00640 1 -- 172.21.15.70:0/2545448500 >> v1:172.21.15.107:6789/0 conn(0x7f71200ce2c0 legacy=0x7f71200cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:28.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.996+0000 7f7117e00640 1 -- 172.21.15.70:0/2545448500 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712006bd80 con 0x7f712006f830 2024-09-13T16:01:28.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.996+0000 7f711ea00640 1 --2- 172.21.15.70:0/2545448500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7120154ad0 0x7f71200cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:28.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.997+0000 7f7117e00640 1 --2- 172.21.15.70:0/2545448500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f712006f830 0x7f712006fee0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f71080098a0 tx=0x7f710802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec82a8ca3a27ed20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:28.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.997+0000 7f711e000640 1 -- 172.21.15.70:0/2545448500 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108032440 con 0x7f712006f830 2024-09-13T16:01:28.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.997+0000 7f711e000640 1 -- 172.21.15.70:0/2545448500 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71080325a0 con 0x7f712006f830 2024-09-13T16:01:29.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.997+0000 7f711e000640 1 -- 172.21.15.70:0/2545448500 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108032930 con 0x7f712006f830 2024-09-13T16:01:29.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.998+0000 7f7125a00640 1 -- 172.21.15.70:0/2545448500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f712006f830 msgr2=0x7f712006fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.998+0000 7f7125a00640 1 --2- 172.21.15.70:0/2545448500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f712006f830 0x7f712006fee0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f71080098a0 tx=0x7f710802a200 comp rx=0 tx=0).stop 2024-09-13T16:01:29.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.998+0000 7f7125a00640 1 -- 172.21.15.70:0/2545448500 shutdown_connections 2024-09-13T16:01:29.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.998+0000 7f7125a00640 1 --2- 172.21.15.70:0/2545448500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f712006f830 0x7f712006fee0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.998+0000 7f7125a00640 1 --2- 172.21.15.70:0/2545448500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7120154ad0 0x7f71200cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.998+0000 7f7125a00640 1 -- 172.21.15.70:0/2545448500 >> 172.21.15.70:0/2545448500 conn(0x7f71200b0580 msgr2=0x7f71200b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:29.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.998+0000 7f7125a00640 1 -- 172.21.15.70:0/2545448500 shutdown_connections 2024-09-13T16:01:29.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.998+0000 7f7125a00640 1 -- 172.21.15.70:0/2545448500 wait complete. 2024-09-13T16:01:29.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.999+0000 7f7125a00640 1 Processor -- start 2024-09-13T16:01:29.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:28.999+0000 7f7125a00640 1 -- start start 2024-09-13T16:01:29.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.000+0000 7f7125a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7120154ad0 0x7f7120140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.000+0000 7f7125a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7120142560 0x7f71201429c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.000+0000 7f7125a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71200b3040 0x7f71200b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.000+0000 7f7125a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7120143090 con 0x7f7120154ad0 2024-09-13T16:01:29.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.000+0000 7f7125a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71200b3a30 con 0x7f71200b3040 2024-09-13T16:01:29.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.000+0000 7f7125a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71201f2920 con 0x7f7120142560 2024-09-13T16:01:29.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.001+0000 7f711ea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7120154ad0 0x7f7120140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.001+0000 7f711ea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7120154ad0 0x7f7120140260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36320/0 (socket says 172.21.15.70:36320) 2024-09-13T16:01:29.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.001+0000 7f711ea00640 1 -- 172.21.15.70:0/3664784082 learned_addr learned my addr 172.21.15.70:0/3664784082 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:29.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.001+0000 7f7117e00640 1 --2- 172.21.15.70:0/3664784082 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7120142560 0x7f71201429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.001+0000 7f711f400640 1 --2- 172.21.15.70:0/3664784082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71200b3040 0x7f71200b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.001+0000 7f711ea00640 1 -- 172.21.15.70:0/3664784082 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7120142560 msgr2=0x7f71201429c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.001+0000 7f711ea00640 1 --2- 172.21.15.70:0/3664784082 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7120142560 0x7f71201429c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.001+0000 7f711ea00640 1 -- 172.21.15.70:0/3664784082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71200b3040 msgr2=0x7f71200b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.001+0000 7f711ea00640 1 --2- 172.21.15.70:0/3664784082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71200b3040 0x7f71200b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.001+0000 7f711ea00640 1 -- 172.21.15.70:0/3664784082 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71080094d0 con 0x7f7120154ad0 2024-09-13T16:01:29.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.001+0000 7f711ea00640 1 --2- 172.21.15.70:0/3664784082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7120154ad0 0x7f7120140260 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f711000d7d0 tx=0x7f711000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:29.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.001+0000 7f7116a00640 1 -- 172.21.15.70:0/3664784082 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110004030 con 0x7f7120154ad0 2024-09-13T16:01:29.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.002+0000 7f7116a00640 1 -- 172.21.15.70:0/3664784082 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7110004190 con 0x7f7120154ad0 2024-09-13T16:01:29.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.002+0000 7f7116a00640 1 -- 172.21.15.70:0/3664784082 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110004520 con 0x7f7120154ad0 2024-09-13T16:01:29.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.002+0000 7f7125a00640 1 -- 172.21.15.70:0/3664784082 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71200b29e0 con 0x7f7120154ad0 2024-09-13T16:01:29.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.002+0000 7f7125a00640 1 -- 172.21.15.70:0/3664784082 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71201f2e50 con 0x7f7120154ad0 2024-09-13T16:01:29.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.003+0000 7f7125a00640 1 -- 172.21.15.70:0/3664784082 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71200cdd80 con 0x7f7120154ad0 2024-09-13T16:01:29.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.003+0000 7f7116a00640 1 -- 172.21.15.70:0/3664784082 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f71100096a0 con 0x7f7120154ad0 2024-09-13T16:01:29.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.005+0000 7f7116a00640 1 --2- 172.21.15.70:0/3664784082 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f70fc06ac00 0x7f70fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.005+0000 7f7116a00640 1 -- 172.21.15.70:0/3664784082 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7110089430 con 0x7f7120154ad0 2024-09-13T16:01:29.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.005+0000 7f7117e00640 1 --2- 172.21.15.70:0/3664784082 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f70fc06ac00 0x7f70fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.006+0000 7f7117e00640 1 --2- 172.21.15.70:0/3664784082 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f70fc06ac00 0x7f70fc06d0c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7108034000 tx=0x7f710802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:29.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.009+0000 7f7116a00640 1 -- 172.21.15.70:0/3664784082 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7110054620 con 0x7f7120154ad0 2024-09-13T16:01:29.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.175+0000 7f7125a00640 1 -- 172.21.15.70:0/3664784082 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f712015ef00 con 0x7f7120154ad0 2024-09-13T16:01:29.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.176+0000 7f7116a00640 1 -- 172.21.15.70:0/3664784082 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7110057c40 con 0x7f7120154ad0 2024-09-13T16:01:29.177 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-13T16:01:29.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.178+0000 7f7125a00640 1 -- 172.21.15.70:0/3664784082 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f70fc06ac00 msgr2=0x7f70fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.178+0000 7f7125a00640 1 --2- 172.21.15.70:0/3664784082 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f70fc06ac00 0x7f70fc06d0c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7108034000 tx=0x7f710802e000 comp rx=0 tx=0).stop 2024-09-13T16:01:29.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.178+0000 7f7125a00640 1 -- 172.21.15.70:0/3664784082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7120154ad0 msgr2=0x7f7120140260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.178+0000 7f7125a00640 1 --2- 172.21.15.70:0/3664784082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7120154ad0 0x7f7120140260 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f711000d7d0 tx=0x7f711000dc90 comp rx=0 tx=0).stop 2024-09-13T16:01:29.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.178+0000 7f7125a00640 1 -- 172.21.15.70:0/3664784082 shutdown_connections 2024-09-13T16:01:29.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.178+0000 7f7125a00640 1 --2- 172.21.15.70:0/3664784082 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f70fc06ac00 0x7f70fc06d0c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.178+0000 7f7125a00640 1 --2- 172.21.15.70:0/3664784082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71200b3040 0x7f71200b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.178+0000 7f7125a00640 1 --2- 172.21.15.70:0/3664784082 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7120142560 0x7f71201429c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.178+0000 7f7125a00640 1 --2- 172.21.15.70:0/3664784082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7120154ad0 0x7f7120140260 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.178+0000 7f7125a00640 1 -- 172.21.15.70:0/3664784082 >> 172.21.15.70:0/3664784082 conn(0x7f71200b0580 msgr2=0x7f712014a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:29.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.178+0000 7f7125a00640 1 -- 172.21.15.70:0/3664784082 shutdown_connections 2024-09-13T16:01:29.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.178+0000 7f7125a00640 1 -- 172.21.15.70:0/3664784082 wait complete. 2024-09-13T16:01:29.195 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:01:29.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.348+0000 7f2f24c00640 1 Processor -- start 2024-09-13T16:01:29.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.349+0000 7f2f24c00640 1 -- start start 2024-09-13T16:01:29.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.350+0000 7f2f24c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2f200b1ed0 0x7f2f200cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.350+0000 7f2f24c00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f200b30e0 con 0x7f2f2015a420 2024-09-13T16:01:29.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.350+0000 7f2f24c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2015a800 con 0x7f2f200cdae0 2024-09-13T16:01:29.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.350+0000 7f2f24c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f200b24d0 con 0x7f2f200b1ed0 2024-09-13T16:01:29.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.350+0000 7f2f1f400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f2f2015a420 0x7f2f200cbb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39256/0 (socket says 172.21.15.70:39256) 2024-09-13T16:01:29.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.350+0000 7f2f1f400640 1 -- 172.21.15.70:0/207009118 learned_addr learned my addr 172.21.15.70:0/207009118 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:29.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.350+0000 7f2f1ea00640 1 --2- 172.21.15.70:0/207009118 >> v2:172.21.15.107:3300/0 conn(0x7f2f200b1ed0 0x7f2f200cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.350+0000 7f2f1e000640 1 -- 172.21.15.70:0/207009118 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2948288601 0 0) 0x7f2f200b30e0 con 0x7f2f2015a420 2024-09-13T16:01:29.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.350+0000 7f2f1e000640 1 -- 172.21.15.70:0/207009118 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f04003520 con 0x7f2f2015a420 2024-09-13T16:01:29.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.351+0000 7f2f1e000640 1 -- 172.21.15.70:0/207009118 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991438507 0 0) 0x7f2f2015a800 con 0x7f2f200cdae0 2024-09-13T16:01:29.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.351+0000 7f2f1e000640 1 -- 172.21.15.70:0/207009118 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f200b30e0 con 0x7f2f200cdae0 2024-09-13T16:01:29.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.351+0000 7f2f1e000640 1 -- 172.21.15.70:0/207009118 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 119383419 0 0) 0x7f2f04003520 con 0x7f2f2015a420 2024-09-13T16:01:29.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.351+0000 7f2f1ea00640 1 -- 172.21.15.70:0/207009118 >> v1:172.21.15.107:6789/0 conn(0x7f2f200cdae0 legacy=0x7f2f2006b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.351+0000 7f2f1ea00640 1 -- 172.21.15.70:0/207009118 >> v1:172.21.15.70:6789/0 conn(0x7f2f2015a420 legacy=0x7f2f200cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.351+0000 7f2f1ea00640 1 -- 172.21.15.70:0/207009118 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f200b27b0 con 0x7f2f200b1ed0 2024-09-13T16:01:29.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.352+0000 7f2f1ea00640 1 --2- 172.21.15.70:0/207009118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f200b1ed0 0x7f2f200cd5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0097a0 tx=0x7f2f0c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26fa2f42ca815c00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:29.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.352+0000 7f2f1e000640 1 -- 172.21.15.70:0/207009118 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f100019f0 con 0x7f2f200b1ed0 2024-09-13T16:01:29.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.352+0000 7f2f1e000640 1 -- 172.21.15.70:0/207009118 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c02ac50 con 0x7f2f200b1ed0 2024-09-13T16:01:29.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.352+0000 7f2f1e000640 1 -- 172.21.15.70:0/207009118 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c032440 con 0x7f2f200b1ed0 2024-09-13T16:01:29.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.353+0000 7f2f24c00640 1 -- 172.21.15.70:0/207009118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f200b1ed0 msgr2=0x7f2f200cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.353+0000 7f2f24c00640 1 --2- 172.21.15.70:0/207009118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f200b1ed0 0x7f2f200cd5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0097a0 tx=0x7f2f0c02a1c0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.353+0000 7f2f24c00640 1 -- 172.21.15.70:0/207009118 shutdown_connections 2024-09-13T16:01:29.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.353+0000 7f2f24c00640 1 --2- 172.21.15.70:0/207009118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f200b1ed0 0x7f2f200cd5a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.353+0000 7f2f24c00640 1 -- 172.21.15.70:0/207009118 >> 172.21.15.70:0/207009118 conn(0x7f2f20069ed0 msgr2=0x7f2f2006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:29.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.353+0000 7f2f24c00640 1 -- 172.21.15.70:0/207009118 shutdown_connections 2024-09-13T16:01:29.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.353+0000 7f2f24c00640 1 -- 172.21.15.70:0/207009118 wait complete. 2024-09-13T16:01:29.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.354+0000 7f2f24c00640 1 Processor -- start 2024-09-13T16:01:29.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.355+0000 7f2f24c00640 1 -- start start 2024-09-13T16:01:29.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.355+0000 7f2f24c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f200b1ed0 0x7f2f20070120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.355+0000 7f2f24c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f200cdae0 0x7f2f2013f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.355+0000 7f2f24c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f2015a420 0x7f2f2013c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.355+0000 7f2f24c00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2013fdc0 con 0x7f2f2015a420 2024-09-13T16:01:29.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.355+0000 7f2f24c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f20071310 con 0x7f2f200cdae0 2024-09-13T16:01:29.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.355+0000 7f2f24c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2013cad0 con 0x7f2f200b1ed0 2024-09-13T16:01:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.356+0000 7f2f1fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f2015a420 0x7f2f2013c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.356+0000 7f2f1fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f2015a420 0x7f2f2013c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36324/0 (socket says 172.21.15.70:36324) 2024-09-13T16:01:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.356+0000 7f2f1fe00640 1 -- 172.21.15.70:0/1557409142 learned_addr learned my addr 172.21.15.70:0/1557409142 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.356+0000 7f2f1f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f200b1ed0 0x7f2f20070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.356+0000 7f2f1ea00640 1 --2- 172.21.15.70:0/1557409142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f200cdae0 0x7f2f2013f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.356+0000 7f2f1fe00640 1 -- 172.21.15.70:0/1557409142 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f200b1ed0 msgr2=0x7f2f20070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.356+0000 7f2f1fe00640 1 --2- 172.21.15.70:0/1557409142 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f200b1ed0 0x7f2f20070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.356+0000 7f2f1fe00640 1 -- 172.21.15.70:0/1557409142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f200cdae0 msgr2=0x7f2f2013f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.356+0000 7f2f1fe00640 1 --2- 172.21.15.70:0/1557409142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f200cdae0 0x7f2f2013f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.356+0000 7f2f1fe00640 1 -- 172.21.15.70:0/1557409142 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c009400 con 0x7f2f2015a420 2024-09-13T16:01:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.356+0000 7f2f1fe00640 1 --2- 172.21.15.70:0/1557409142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f2015a420 0x7f2f2013c590 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800c400 tx=0x7f2f1800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.357+0000 7f2f17400640 1 -- 172.21.15.70:0/1557409142 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f180052d0 con 0x7f2f2015a420 2024-09-13T16:01:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.357+0000 7f2f17400640 1 -- 172.21.15.70:0/1557409142 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f18005430 con 0x7f2f2015a420 2024-09-13T16:01:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.357+0000 7f2f24c00640 1 -- 172.21.15.70:0/1557409142 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f20070700 con 0x7f2f2015a420 2024-09-13T16:01:29.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.357+0000 7f2f17400640 1 -- 172.21.15.70:0/1557409142 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f180037f0 con 0x7f2f2015a420 2024-09-13T16:01:29.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.357+0000 7f2f24c00640 1 -- 172.21.15.70:0/1557409142 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f20070cc0 con 0x7f2f2015a420 2024-09-13T16:01:29.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.358+0000 7f2f24c00640 1 -- 172.21.15.70:0/1557409142 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f20071480 con 0x7f2f2015a420 2024-09-13T16:01:29.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.359+0000 7f2f17400640 1 -- 172.21.15.70:0/1557409142 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2f18003950 con 0x7f2f2015a420 2024-09-13T16:01:29.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.359+0000 7f2f17400640 1 --2- 172.21.15.70:0/1557409142 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2f0006ac00 0x7f2f0006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.360+0000 7f2f17400640 1 -- 172.21.15.70:0/1557409142 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f180888f0 con 0x7f2f2015a420 2024-09-13T16:01:29.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.360+0000 7f2f1f400640 1 --2- 172.21.15.70:0/1557409142 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2f0006ac00 0x7f2f0006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.360+0000 7f2f1f400640 1 --2- 172.21.15.70:0/1557409142 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2f0006ac00 0x7f2f0006d0c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2f10002230 tx=0x7f2f10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:29.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.364+0000 7f2f17400640 1 -- 172.21.15.70:0/1557409142 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2f18053ae0 con 0x7f2f2015a420 2024-09-13T16:01:29.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.535+0000 7f2f24c00640 1 -- 172.21.15.70:0/1557409142 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2f200cd5a0 con 0x7f2f2015a420 2024-09-13T16:01:29.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.535+0000 7f2f17400640 1 -- 172.21.15.70:0/1557409142 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2f18017020 con 0x7f2f2015a420 2024-09-13T16:01:29.536 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-13T16:01:29.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.537+0000 7f2f24c00640 1 -- 172.21.15.70:0/1557409142 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2f0006ac00 msgr2=0x7f2f0006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.537+0000 7f2f24c00640 1 --2- 172.21.15.70:0/1557409142 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2f0006ac00 0x7f2f0006d0c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2f10002230 tx=0x7f2f10009040 comp rx=0 tx=0).stop 2024-09-13T16:01:29.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.537+0000 7f2f24c00640 1 -- 172.21.15.70:0/1557409142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f2015a420 msgr2=0x7f2f2013c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.537+0000 7f2f24c00640 1 --2- 172.21.15.70:0/1557409142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f2015a420 0x7f2f2013c590 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800c400 tx=0x7f2f1800c8c0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.537+0000 7f2f24c00640 1 -- 172.21.15.70:0/1557409142 shutdown_connections 2024-09-13T16:01:29.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.537+0000 7f2f24c00640 1 --2- 172.21.15.70:0/1557409142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f2015a420 0x7f2f2013c590 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.537+0000 7f2f24c00640 1 --2- 172.21.15.70:0/1557409142 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2f0006ac00 0x7f2f0006d0c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.537+0000 7f2f24c00640 1 --2- 172.21.15.70:0/1557409142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f200cdae0 0x7f2f2013f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.537+0000 7f2f24c00640 1 --2- 172.21.15.70:0/1557409142 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f200b1ed0 0x7f2f20070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.537+0000 7f2f24c00640 1 -- 172.21.15.70:0/1557409142 >> 172.21.15.70:0/1557409142 conn(0x7f2f20069ed0 msgr2=0x7f2f2006c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:29.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.537+0000 7f2f24c00640 1 -- 172.21.15.70:0/1557409142 shutdown_connections 2024-09-13T16:01:29.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.538+0000 7f2f24c00640 1 -- 172.21.15.70:0/1557409142 wait complete. 2024-09-13T16:01:29.554 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:01:29.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.709+0000 7f8a30a00640 1 Processor -- start 2024-09-13T16:01:29.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.709+0000 7f8a30a00640 1 -- start start 2024-09-13T16:01:29.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.710+0000 7f8a30a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8a2c071690 0x7f8a2c15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.710+0000 7f8a30a00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2c06f5f0 con 0x7f8a2c156f60 2024-09-13T16:01:29.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.710+0000 7f8a30a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2c070450 con 0x7f8a2c0cafa0 2024-09-13T16:01:29.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.710+0000 7f8a30a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2c15aa30 con 0x7f8a2c071690 2024-09-13T16:01:29.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.710+0000 7f8a29e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f8a2c156f60 0x7f8a2c070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39260/0 (socket says 172.21.15.70:39260) 2024-09-13T16:01:29.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.710+0000 7f8a29e00640 1 -- 172.21.15.70:0/3196736934 learned_addr learned my addr 172.21.15.70:0/3196736934 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:29.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a29400640 1 -- 172.21.15.70:0/3196736934 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473300634 0 0) 0x7f8a2c06f5f0 con 0x7f8a2c156f60 2024-09-13T16:01:29.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a29400640 1 -- 172.21.15.70:0/3196736934 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a10005730 con 0x7f8a2c156f60 2024-09-13T16:01:29.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a23e00640 1 --2- 172.21.15.70:0/3196736934 >> v2:172.21.15.107:3300/0 conn(0x7f8a2c071690 0x7f8a2c15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a29400640 1 -- 172.21.15.70:0/3196736934 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2382673822 0 0) 0x7f8a10005730 con 0x7f8a2c156f60 2024-09-13T16:01:29.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a29400640 1 -- 172.21.15.70:0/3196736934 >> v2:172.21.15.107:3300/0 conn(0x7f8a2c071690 msgr2=0x7f8a2c15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:29.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a29400640 1 --2- 172.21.15.70:0/3196736934 >> v2:172.21.15.107:3300/0 conn(0x7f8a2c071690 0x7f8a2c15a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a29400640 1 -- 172.21.15.70:0/3196736934 >> v1:172.21.15.107:6789/0 conn(0x7f8a2c0cafa0 legacy=0x7f8a2c0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a29400640 1 -- 172.21.15.70:0/3196736934 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c06f840 con 0x7f8a2c156f60 2024-09-13T16:01:29.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a29400640 1 -- 172.21.15.70:0/3196736934 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f8a1c001670 con 0x7f8a2c156f60 2024-09-13T16:01:29.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a29400640 1 -- 172.21.15.70:0/3196736934 >> v1:172.21.15.70:6789/0 conn(0x7f8a2c156f60 legacy=0x7f8a2c070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a29400640 1 --2- 172.21.15.70:0/3196736934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a10005b80 0x7f8a10005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a29400640 1 --2- 172.21.15.70:0/3196736934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a100069d0 0x7f8a10006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a29400640 1 --2- 172.21.15.70:0/3196736934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a10007390 0x7f8a1000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a29400640 1 -- 172.21.15.70:0/3196736934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c15aa30 con 0x7f8a10005b80 2024-09-13T16:01:29.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a29400640 1 -- 172.21.15.70:0/3196736934 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1000e2e0 con 0x7f8a100069d0 2024-09-13T16:01:29.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a29400640 1 -- 172.21.15.70:0/3196736934 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1000e4a0 con 0x7f8a10007390 2024-09-13T16:01:29.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a29e00640 1 --2- 172.21.15.70:0/3196736934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a10005b80 0x7f8a10005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a23e00640 1 --2- 172.21.15.70:0/3196736934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a100069d0 0x7f8a10006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.711+0000 7f8a2a800640 1 --2- 172.21.15.70:0/3196736934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a10007390 0x7f8a1000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.712+0000 7f8a29e00640 1 -- 172.21.15.70:0/3196736934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a10007390 msgr2=0x7f8a1000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:29.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.712+0000 7f8a29e00640 1 --2- 172.21.15.70:0/3196736934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a10007390 0x7f8a1000db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.712+0000 7f8a29e00640 1 -- 172.21.15.70:0/3196736934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a100069d0 msgr2=0x7f8a10006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.712+0000 7f8a29e00640 1 --2- 172.21.15.70:0/3196736934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a100069d0 0x7f8a10006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.712+0000 7f8a29e00640 1 -- 172.21.15.70:0/3196736934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a10005730 con 0x7f8a10005b80 2024-09-13T16:01:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.712+0000 7f8a2a800640 1 -- 172.21.15.70:0/3196736934 reap_dead start 2024-09-13T16:01:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.713+0000 7f8a29e00640 1 --2- 172.21.15.70:0/3196736934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a10005b80 0x7f8a10005fa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00c240 tx=0x7f8a10007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2721e9ecaa824f4d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.713+0000 7f8a29400640 1 -- 172.21.15.70:0/3196736934 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c005ad0 con 0x7f8a10005b80 2024-09-13T16:01:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.713+0000 7f8a29400640 1 -- 172.21.15.70:0/3196736934 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c02d070 con 0x7f8a10005b80 2024-09-13T16:01:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.713+0000 7f8a29400640 1 -- 172.21.15.70:0/3196736934 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c007070 con 0x7f8a10005b80 2024-09-13T16:01:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.713+0000 7f8a30a00640 1 -- 172.21.15.70:0/3196736934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a10005b80 msgr2=0x7f8a10005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.713+0000 7f8a30a00640 1 --2- 172.21.15.70:0/3196736934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a10005b80 0x7f8a10005fa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00c240 tx=0x7f8a10007a00 comp rx=0 tx=0).stop 2024-09-13T16:01:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.713+0000 7f8a30a00640 1 -- 172.21.15.70:0/3196736934 shutdown_connections 2024-09-13T16:01:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.713+0000 7f8a30a00640 1 --2- 172.21.15.70:0/3196736934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a10005b80 0x7f8a10005fa0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.713+0000 7f8a30a00640 1 -- 172.21.15.70:0/3196736934 >> 172.21.15.70:0/3196736934 conn(0x7f8a2c0b0580 msgr2=0x7f8a2c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:29.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.714+0000 7f8a30a00640 1 -- 172.21.15.70:0/3196736934 shutdown_connections 2024-09-13T16:01:29.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.714+0000 7f8a30a00640 1 -- 172.21.15.70:0/3196736934 wait complete. 2024-09-13T16:01:29.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.715+0000 7f8a30a00640 1 Processor -- start 2024-09-13T16:01:29.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.715+0000 7f8a30a00640 1 -- start start 2024-09-13T16:01:29.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.716+0000 7f8a30a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a10005b80 0x7f8a2c1482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.716+0000 7f8a30a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a2c150110 0x7f8a2c06be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.716+0000 7f8a30a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a2c150590 0x7f8a2c06c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.716+0000 7f8a30a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c148800 con 0x7f8a2c150590 2024-09-13T16:01:29.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.716+0000 7f8a30a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c15c6c0 con 0x7f8a2c150110 2024-09-13T16:01:29.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.716+0000 7f8a30a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c14f630 con 0x7f8a10005b80 2024-09-13T16:01:29.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.716+0000 7f8a2a800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a2c150590 0x7f8a2c06c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.716+0000 7f8a2a800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a2c150590 0x7f8a2c06c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36332/0 (socket says 172.21.15.70:36332) 2024-09-13T16:01:29.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.716+0000 7f8a2a800640 1 -- 172.21.15.70:0/1500222239 learned_addr learned my addr 172.21.15.70:0/1500222239 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:29.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.717+0000 7f8a29e00640 1 --2- 172.21.15.70:0/1500222239 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a10005b80 0x7f8a2c1482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.717+0000 7f8a2a800640 1 -- 172.21.15.70:0/1500222239 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a10005b80 msgr2=0x7f8a2c1482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.717+0000 7f8a23e00640 1 --2- 172.21.15.70:0/1500222239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a2c150110 0x7f8a2c06be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.717+0000 7f8a2a800640 1 --2- 172.21.15.70:0/1500222239 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a10005b80 0x7f8a2c1482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.717+0000 7f8a2a800640 1 -- 172.21.15.70:0/1500222239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a2c150110 msgr2=0x7f8a2c06be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.717+0000 7f8a2a800640 1 --2- 172.21.15.70:0/1500222239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a2c150110 0x7f8a2c06be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.717+0000 7f8a2a800640 1 -- 172.21.15.70:0/1500222239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c14f910 con 0x7f8a2c150590 2024-09-13T16:01:29.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.717+0000 7f8a29e00640 1 --2- 172.21.15.70:0/1500222239 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a10005b80 0x7f8a2c1482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:29.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.717+0000 7f8a23e00640 1 --2- 172.21.15.70:0/1500222239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a2c150110 0x7f8a2c06be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:29.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.717+0000 7f8a2a800640 1 --2- 172.21.15.70:0/1500222239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a2c150590 0x7f8a2c06c380 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0cb3a0 tx=0x7f8a2400fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:29.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.717+0000 7f8a22000640 1 -- 172.21.15.70:0/1500222239 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a24003b80 con 0x7f8a2c150590 2024-09-13T16:01:29.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.717+0000 7f8a22000640 1 -- 172.21.15.70:0/1500222239 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a24003d00 con 0x7f8a2c150590 2024-09-13T16:01:29.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.717+0000 7f8a30a00640 1 -- 172.21.15.70:0/1500222239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2c14fbf0 con 0x7f8a2c150590 2024-09-13T16:01:29.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.717+0000 7f8a22000640 1 -- 172.21.15.70:0/1500222239 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a24005310 con 0x7f8a2c150590 2024-09-13T16:01:29.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.717+0000 7f8a30a00640 1 -- 172.21.15.70:0/1500222239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c1546a0 con 0x7f8a2c150590 2024-09-13T16:01:29.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.718+0000 7f8a30a00640 1 -- 172.21.15.70:0/1500222239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2c157340 con 0x7f8a2c150590 2024-09-13T16:01:29.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.719+0000 7f8a22000640 1 -- 172.21.15.70:0/1500222239 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8a24005470 con 0x7f8a2c150590 2024-09-13T16:01:29.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.720+0000 7f8a22000640 1 --2- 172.21.15.70:0/1500222239 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f8a0806ac30 0x7f8a0806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.720+0000 7f8a22000640 1 -- 172.21.15.70:0/1500222239 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a240892a0 con 0x7f8a2c150590 2024-09-13T16:01:29.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.720+0000 7f8a29e00640 1 --2- 172.21.15.70:0/1500222239 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f8a0806ac30 0x7f8a0806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.721+0000 7f8a29e00640 1 --2- 172.21.15.70:0/1500222239 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f8a0806ac30 0x7f8a0806d0f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c032000 tx=0x7f8a1c02d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:29.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.724+0000 7f8a22000640 1 -- 172.21.15.70:0/1500222239 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8a24054470 con 0x7f8a2c150590 2024-09-13T16:01:29.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.891+0000 7f8a30a00640 1 -- 172.21.15.70:0/1500222239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8a2c0b0bb0 con 0x7f8a2c150590 2024-09-13T16:01:29.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.892+0000 7f8a22000640 1 -- 172.21.15.70:0/1500222239 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8a24057a90 con 0x7f8a2c150590 2024-09-13T16:01:29.893 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-13T16:01:29.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.894+0000 7f8a30a00640 1 -- 172.21.15.70:0/1500222239 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f8a0806ac30 msgr2=0x7f8a0806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.894+0000 7f8a30a00640 1 --2- 172.21.15.70:0/1500222239 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f8a0806ac30 0x7f8a0806d0f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c032000 tx=0x7f8a1c02d000 comp rx=0 tx=0).stop 2024-09-13T16:01:29.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.894+0000 7f8a30a00640 1 -- 172.21.15.70:0/1500222239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a2c150590 msgr2=0x7f8a2c06c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.894+0000 7f8a30a00640 1 --2- 172.21.15.70:0/1500222239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a2c150590 0x7f8a2c06c380 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0cb3a0 tx=0x7f8a2400fd40 comp rx=0 tx=0).stop 2024-09-13T16:01:29.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.894+0000 7f8a30a00640 1 -- 172.21.15.70:0/1500222239 shutdown_connections 2024-09-13T16:01:29.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.894+0000 7f8a30a00640 1 --2- 172.21.15.70:0/1500222239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a2c150590 0x7f8a2c06c380 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.894+0000 7f8a30a00640 1 --2- 172.21.15.70:0/1500222239 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f8a0806ac30 0x7f8a0806d0f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.894+0000 7f8a30a00640 1 --2- 172.21.15.70:0/1500222239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a2c150110 0x7f8a2c06be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.894+0000 7f8a30a00640 1 --2- 172.21.15.70:0/1500222239 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a10005b80 0x7f8a2c1482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.894+0000 7f8a30a00640 1 -- 172.21.15.70:0/1500222239 >> 172.21.15.70:0/1500222239 conn(0x7f8a2c0b0580 msgr2=0x7f8a2c15a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:29.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.894+0000 7f8a30a00640 1 -- 172.21.15.70:0/1500222239 shutdown_connections 2024-09-13T16:01:29.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:29.894+0000 7f8a30a00640 1 -- 172.21.15.70:0/1500222239 wait complete. 2024-09-13T16:01:29.911 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:01:30.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.061+0000 7f3cb8c00640 1 Processor -- start 2024-09-13T16:01:30.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.061+0000 7f3cb8c00640 1 -- start start 2024-09-13T16:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.062+0000 7f3cb8c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3cb415cb50 0x7f3cb40b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.062+0000 7f3cb8c00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3cb406a5e0 0x7f3cb40b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.062+0000 7f3cb8c00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb40b4110 con 0x7f3cb415c770 2024-09-13T16:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.062+0000 7f3cb8c00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb40ae1e0 con 0x7f3cb406a5e0 2024-09-13T16:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.062+0000 7f3cb8c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb40ad140 con 0x7f3cb415cb50 2024-09-13T16:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.062+0000 7f3cb2800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3cb406a5e0 0x7f3cb40b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.062+0000 7f3cb1e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3cb415c770 0x7f3cb4069ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:37190/0 (socket says 172.21.15.70:37190) 2024-09-13T16:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.062+0000 7f3cb2800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3cb406a5e0 0x7f3cb40b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49858/0 (socket says 172.21.15.70:49858) 2024-09-13T16:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.062+0000 7f3cb1e00640 1 -- 172.21.15.70:0/1935126868 learned_addr learned my addr 172.21.15.70:0/1935126868 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.063+0000 7f3cabe00640 1 --2- 172.21.15.70:0/1935126868 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3cb415cb50 0x7f3cb40b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.063+0000 7f3cb2800640 1 -- 172.21.15.70:0/1935126868 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3cb415cb50 msgr2=0x7f3cb40b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.063+0000 7f3cb2800640 1 --2- 172.21.15.70:0/1935126868 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3cb415cb50 0x7f3cb40b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.063+0000 7f3cb2800640 1 -- 172.21.15.70:0/1935126868 >> v1:172.21.15.70:6789/0 conn(0x7f3cb415c770 legacy=0x7f3cb4069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:30.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.063+0000 7f3cb2800640 1 -- 172.21.15.70:0/1935126868 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb40ad420 con 0x7f3cb406a5e0 2024-09-13T16:01:30.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.063+0000 7f3cabe00640 1 --2- 172.21.15.70:0/1935126868 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3cb415cb50 0x7f3cb40b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.064+0000 7f3cb2800640 1 --2- 172.21.15.70:0/1935126868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb406a5e0 0x7f3cb40b3bd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009d90 tx=0x7f3cac02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573e6b1e28dcb0d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.064+0000 7f3cb1400640 1 -- 172.21.15.70:0/1935126868 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac007740 con 0x7f3cb406a5e0 2024-09-13T16:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.064+0000 7f3cb1400640 1 -- 172.21.15.70:0/1935126868 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac02d050 con 0x7f3cb406a5e0 2024-09-13T16:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.064+0000 7f3cb1400640 1 -- 172.21.15.70:0/1935126868 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac007ac0 con 0x7f3cb406a5e0 2024-09-13T16:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.064+0000 7f3cb8c00640 1 -- 172.21.15.70:0/1935126868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb406a5e0 msgr2=0x7f3cb40b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.064+0000 7f3cb8c00640 1 --2- 172.21.15.70:0/1935126868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb406a5e0 0x7f3cb40b3bd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009d90 tx=0x7f3cac02a660 comp rx=0 tx=0).stop 2024-09-13T16:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.065+0000 7f3cb8c00640 1 -- 172.21.15.70:0/1935126868 shutdown_connections 2024-09-13T16:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.065+0000 7f3cb8c00640 1 --2- 172.21.15.70:0/1935126868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb406a5e0 0x7f3cb40b3bd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.065+0000 7f3cb8c00640 1 --2- 172.21.15.70:0/1935126868 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3cb415cb50 0x7f3cb40b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.065+0000 7f3cb8c00640 1 -- 172.21.15.70:0/1935126868 >> 172.21.15.70:0/1935126868 conn(0x7f3cb406afe0 msgr2=0x7f3cb406b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.065+0000 7f3cb8c00640 1 -- 172.21.15.70:0/1935126868 shutdown_connections 2024-09-13T16:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.065+0000 7f3cb8c00640 1 -- 172.21.15.70:0/1935126868 wait complete. 2024-09-13T16:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.066+0000 7f3cb8c00640 1 Processor -- start 2024-09-13T16:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.066+0000 7f3cb8c00640 1 -- start start 2024-09-13T16:01:30.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.067+0000 7f3cb8c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb406a5e0 0x7f3cb4150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.067+0000 7f3cb8c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cb415c770 0x7f3cb40b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.067+0000 7f3cb8c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3cb415cb50 0x7f3cb40b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.067+0000 7f3cb8c00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb41546b0 con 0x7f3cb406a5e0 2024-09-13T16:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.067+0000 7f3cb8c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb41f25a0 con 0x7f3cb415c770 2024-09-13T16:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.067+0000 7f3cb8c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb41f2810 con 0x7f3cb415cb50 2024-09-13T16:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.067+0000 7f3cb1e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb406a5e0 0x7f3cb4150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.067+0000 7f3cb1e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb406a5e0 0x7f3cb4150b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49874/0 (socket says 172.21.15.70:49874) 2024-09-13T16:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.067+0000 7f3cb1e00640 1 -- 172.21.15.70:0/2206222304 learned_addr learned my addr 172.21.15.70:0/2206222304 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.068+0000 7f3cb2800640 1 --2- 172.21.15.70:0/2206222304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3cb415cb50 0x7f3cb40b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.068+0000 7f3cabe00640 1 --2- 172.21.15.70:0/2206222304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cb415c770 0x7f3cb40b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.068+0000 7f3cb1e00640 1 -- 172.21.15.70:0/2206222304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3cb415cb50 msgr2=0x7f3cb40b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.068+0000 7f3cb1e00640 1 --2- 172.21.15.70:0/2206222304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3cb415cb50 0x7f3cb40b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.068+0000 7f3cb1e00640 1 -- 172.21.15.70:0/2206222304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cb415c770 msgr2=0x7f3cb40b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.068+0000 7f3cb1e00640 1 --2- 172.21.15.70:0/2206222304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cb415c770 0x7f3cb40b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.068+0000 7f3cb1e00640 1 -- 172.21.15.70:0/2206222304 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac009a70 con 0x7f3cb406a5e0 2024-09-13T16:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.068+0000 7f3cabe00640 1 --2- 172.21.15.70:0/2206222304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cb415c770 0x7f3cb40b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.068+0000 7f3cb1e00640 1 --2- 172.21.15.70:0/2206222304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb406a5e0 0x7f3cb4150b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400c4d0 tx=0x7f3ca400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.068+0000 7f3caa000640 1 -- 172.21.15.70:0/2206222304 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4005ce0 con 0x7f3cb406a5e0 2024-09-13T16:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.068+0000 7f3caa000640 1 -- 172.21.15.70:0/2206222304 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca4005e40 con 0x7f3cb406a5e0 2024-09-13T16:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.068+0000 7f3cb8c00640 1 -- 172.21.15.70:0/2206222304 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb41f2af0 con 0x7f3cb406a5e0 2024-09-13T16:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.068+0000 7f3caa000640 1 -- 172.21.15.70:0/2206222304 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4007270 con 0x7f3cb406a5e0 2024-09-13T16:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.068+0000 7f3cb8c00640 1 -- 172.21.15.70:0/2206222304 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb41f30b0 con 0x7f3cb406a5e0 2024-09-13T16:01:30.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.070+0000 7f3cb8c00640 1 -- 172.21.15.70:0/2206222304 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb4069ed0 con 0x7f3cb406a5e0 2024-09-13T16:01:30.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.070+0000 7f3caa000640 1 -- 172.21.15.70:0/2206222304 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3ca40073d0 con 0x7f3cb406a5e0 2024-09-13T16:01:30.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.072+0000 7f3caa000640 1 --2- 172.21.15.70:0/2206222304 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f3c9006ac00 0x7f3c9006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:30.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.072+0000 7f3caa000640 1 -- 172.21.15.70:0/2206222304 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ca4088730 con 0x7f3cb406a5e0 2024-09-13T16:01:30.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.072+0000 7f3cabe00640 1 --2- 172.21.15.70:0/2206222304 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f3c9006ac00 0x7f3c9006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:30.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.072+0000 7f3cabe00640 1 --2- 172.21.15.70:0/2206222304 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f3c9006ac00 0x7f3c9006d0c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4152b90 tx=0x7f3c9c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:30.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.076+0000 7f3caa000640 1 -- 172.21.15.70:0/2206222304 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3ca4053a50 con 0x7f3cb406a5e0 2024-09-13T16:01:30.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.279+0000 7f3cb8c00640 1 -- 172.21.15.70:0/2206222304 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3cb415ea20 con 0x7f3cb406a5e0 2024-09-13T16:01:30.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.279+0000 7f3caa000640 1 -- 172.21.15.70:0/2206222304 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4728 (secure 0 0 0) 0x7f3ca4017090 con 0x7f3cb406a5e0 2024-09-13T16:01:30.280 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:30.281 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2852595148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2852595148},{"type":"v1","addr":"172.21.15.107:6834","nonce":2852595148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2578992914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2578992914},{"type":"v1","addr":"172.21.15.70:6835","nonce":2578992914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/927553867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":927553867},{"type":"v1","addr":"172.21.15.70:6837","nonce":927553867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:01:18.592735+0000","modified":"2024-09-13T16:01:21.606407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6835/712016246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":712016246},{"type":"v1","addr":"172.21.15.107:6835","nonce":712016246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:01:30.281 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2024-09-13T16:01:30.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.281+0000 7f3cb8c00640 1 -- 172.21.15.70:0/2206222304 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f3c9006ac00 msgr2=0x7f3c9006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:30.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.281+0000 7f3cb8c00640 1 --2- 172.21.15.70:0/2206222304 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f3c9006ac00 0x7f3c9006d0c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4152b90 tx=0x7f3c9c008040 comp rx=0 tx=0).stop 2024-09-13T16:01:30.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.281+0000 7f3cb8c00640 1 -- 172.21.15.70:0/2206222304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb406a5e0 msgr2=0x7f3cb4150b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:30.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.281+0000 7f3cb8c00640 1 --2- 172.21.15.70:0/2206222304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb406a5e0 0x7f3cb4150b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400c4d0 tx=0x7f3ca400c990 comp rx=0 tx=0).stop 2024-09-13T16:01:30.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.281+0000 7f3cb8c00640 1 -- 172.21.15.70:0/2206222304 shutdown_connections 2024-09-13T16:01:30.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.281+0000 7f3cb8c00640 1 --2- 172.21.15.70:0/2206222304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3cb415cb50 0x7f3cb40b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.281+0000 7f3cb8c00640 1 --2- 172.21.15.70:0/2206222304 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f3c9006ac00 0x7f3c9006d0c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.281+0000 7f3cb8c00640 1 --2- 172.21.15.70:0/2206222304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cb415c770 0x7f3cb40b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.281+0000 7f3cb8c00640 1 --2- 172.21.15.70:0/2206222304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb406a5e0 0x7f3cb4150b60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.281+0000 7f3cb8c00640 1 -- 172.21.15.70:0/2206222304 >> 172.21.15.70:0/2206222304 conn(0x7f3cb406afe0 msgr2=0x7f3cb4070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:30.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.281+0000 7f3cb8c00640 1 -- 172.21.15.70:0/2206222304 shutdown_connections 2024-09-13T16:01:30.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.281+0000 7f3cb8c00640 1 -- 172.21.15.70:0/2206222304 wait complete. 2024-09-13T16:01:30.299 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:30.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.449+0000 7f64aae00640 1 Processor -- start 2024-09-13T16:01:30.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.450+0000 7f64aae00640 1 -- start start 2024-09-13T16:01:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.451+0000 7f64aae00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f64a4071560 0x7f64a40ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.451+0000 7f64aae00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a406f4b0 0x7f64a40b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.451+0000 7f64aae00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a40cd850 con 0x7f64a4159480 2024-09-13T16:01:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.451+0000 7f64aae00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a40cd570 con 0x7f64a4071560 2024-09-13T16:01:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.451+0000 7f64aae00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a40b1740 con 0x7f64a406f4b0 2024-09-13T16:01:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.451+0000 7f64a9000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f64a4071560 0x7f64a40ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.451+0000 7f64a9000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f64a4071560 0x7f64a40ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49882/0 (socket says 172.21.15.70:49882) 2024-09-13T16:01:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.451+0000 7f64a9000640 1 -- 172.21.15.70:0/3816207121 learned_addr learned my addr 172.21.15.70:0/3816207121 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.451+0000 7f64aa400640 1 --2- 172.21.15.70:0/3816207121 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a406f4b0 0x7f64a40b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.452+0000 7f64a9000640 1 -- 172.21.15.70:0/3816207121 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a406f4b0 msgr2=0x7f64a40b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.452+0000 7f64a9000640 1 --2- 172.21.15.70:0/3816207121 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a406f4b0 0x7f64a40b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.452+0000 7f64a9000640 1 -- 172.21.15.70:0/3816207121 >> v1:172.21.15.107:6789/0 conn(0x7f64a4159480 legacy=0x7f64a4070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.452+0000 7f64a9000640 1 -- 172.21.15.70:0/3816207121 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a40b1a20 con 0x7f64a4071560 2024-09-13T16:01:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.453+0000 7f64a9000640 1 --2- 172.21.15.70:0/3816207121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a4071560 0x7f64a40ccf90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6490009870 tx=0x7f649002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96980e035753fd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.453+0000 7f64a3e00640 1 -- 172.21.15.70:0/3816207121 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6490032440 con 0x7f64a4071560 2024-09-13T16:01:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.453+0000 7f64a3e00640 1 -- 172.21.15.70:0/3816207121 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64900325a0 con 0x7f64a4071560 2024-09-13T16:01:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.453+0000 7f64a3e00640 1 -- 172.21.15.70:0/3816207121 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6490032930 con 0x7f64a4071560 2024-09-13T16:01:30.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.453+0000 7f64aae00640 1 -- 172.21.15.70:0/3816207121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a4071560 msgr2=0x7f64a40ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:30.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.453+0000 7f64aae00640 1 --2- 172.21.15.70:0/3816207121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a4071560 0x7f64a40ccf90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6490009870 tx=0x7f649002a1c0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.453+0000 7f64aae00640 1 -- 172.21.15.70:0/3816207121 shutdown_connections 2024-09-13T16:01:30.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.453+0000 7f64aae00640 1 --2- 172.21.15.70:0/3816207121 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a406f4b0 0x7f64a40b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.453+0000 7f64aae00640 1 --2- 172.21.15.70:0/3816207121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a4071560 0x7f64a40ccf90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.453+0000 7f64aae00640 1 -- 172.21.15.70:0/3816207121 >> 172.21.15.70:0/3816207121 conn(0x7f64a40ae310 msgr2=0x7f64a40ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:30.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.454+0000 7f64aae00640 1 -- 172.21.15.70:0/3816207121 shutdown_connections 2024-09-13T16:01:30.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.454+0000 7f64aae00640 1 -- 172.21.15.70:0/3816207121 wait complete. 2024-09-13T16:01:30.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.455+0000 7f64aae00640 1 Processor -- start 2024-09-13T16:01:30.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.455+0000 7f64aae00640 1 -- start start 2024-09-13T16:01:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.456+0000 7f64aae00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a406f4b0 0x7f64a4140ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.456+0000 7f64aae00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64a4071560 0x7f64a40a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.456+0000 7f64aae00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a4159480 0x7f64a4152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.456+0000 7f64aae00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a40a89a0 con 0x7f64a4159480 2024-09-13T16:01:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.456+0000 7f64aae00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a41545d0 con 0x7f64a4071560 2024-09-13T16:01:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.456+0000 7f64aae00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a414eec0 con 0x7f64a406f4b0 2024-09-13T16:01:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.456+0000 7f64aa400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a4159480 0x7f64a4152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.456+0000 7f64aa400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a4159480 0x7f64a4152b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49894/0 (socket says 172.21.15.70:49894) 2024-09-13T16:01:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.456+0000 7f64aa400640 1 -- 172.21.15.70:0/437579567 learned_addr learned my addr 172.21.15.70:0/437579567 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.457+0000 7f64a9000640 1 --2- 172.21.15.70:0/437579567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64a4071560 0x7f64a40a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.457+0000 7f64a9a00640 1 --2- 172.21.15.70:0/437579567 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a406f4b0 0x7f64a4140ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.457+0000 7f64aa400640 1 -- 172.21.15.70:0/437579567 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a406f4b0 msgr2=0x7f64a4140ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.457+0000 7f64aa400640 1 --2- 172.21.15.70:0/437579567 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a406f4b0 0x7f64a4140ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.457+0000 7f64aa400640 1 -- 172.21.15.70:0/437579567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64a4071560 msgr2=0x7f64a40a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.457+0000 7f64aa400640 1 --2- 172.21.15.70:0/437579567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64a4071560 0x7f64a40a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.457+0000 7f64aa400640 1 -- 172.21.15.70:0/437579567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64900094d0 con 0x7f64a4159480 2024-09-13T16:01:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.457+0000 7f64aa400640 1 --2- 172.21.15.70:0/437579567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a4159480 0x7f64a4152b20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f649c00efc0 tx=0x7f649c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.457+0000 7f64a1600640 1 -- 172.21.15.70:0/437579567 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649c014480 con 0x7f64a4159480 2024-09-13T16:01:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.457+0000 7f64a1600640 1 -- 172.21.15.70:0/437579567 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649c00f040 con 0x7f64a4159480 2024-09-13T16:01:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.457+0000 7f64a1600640 1 -- 172.21.15.70:0/437579567 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649c014820 con 0x7f64a4159480 2024-09-13T16:01:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.457+0000 7f64aae00640 1 -- 172.21.15.70:0/437579567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a414f1a0 con 0x7f64a4159480 2024-09-13T16:01:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.458+0000 7f64aae00640 1 -- 172.21.15.70:0/437579567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a4141270 con 0x7f64a4159480 2024-09-13T16:01:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.458+0000 7f64aae00640 1 -- 172.21.15.70:0/437579567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a4067360 con 0x7f64a4159480 2024-09-13T16:01:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.459+0000 7f64a1600640 1 -- 172.21.15.70:0/437579567 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f649c014980 con 0x7f64a4159480 2024-09-13T16:01:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.460+0000 7f64a1600640 1 --2- 172.21.15.70:0/437579567 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f648406ac00 0x7f648406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.460+0000 7f64a1600640 1 -- 172.21.15.70:0/437579567 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f649c089ee0 con 0x7f64a4159480 2024-09-13T16:01:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.460+0000 7f64a9a00640 1 --2- 172.21.15.70:0/437579567 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f648406ac00 0x7f648406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:30.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.461+0000 7f64a9a00640 1 --2- 172.21.15.70:0/437579567 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f648406ac00 0x7f648406d0c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6498000f60 tx=0x7f6498009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:30.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.464+0000 7f64a1600640 1 -- 172.21.15.70:0/437579567 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f649c055040 con 0x7f64a4159480 2024-09-13T16:01:30.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.634+0000 7f64aae00640 1 -- 172.21.15.70:0/437579567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64a40b2220 con 0x7f64a4159480 2024-09-13T16:01:30.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.635+0000 7f64a1600640 1 -- 172.21.15.70:0/437579567 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f649c018020 con 0x7f64a4159480 2024-09-13T16:01:30.637 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:30.637 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:19.595458+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.637+0000 7f64aae00640 1 -- 172.21.15.70:0/437579567 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f648406ac00 msgr2=0x7f648406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.637+0000 7f64aae00640 1 --2- 172.21.15.70:0/437579567 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f648406ac00 0x7f648406d0c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6498000f60 tx=0x7f6498009040 comp rx=0 tx=0).stop 2024-09-13T16:01:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.637+0000 7f64aae00640 1 -- 172.21.15.70:0/437579567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a4159480 msgr2=0x7f64a4152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.637+0000 7f64aae00640 1 --2- 172.21.15.70:0/437579567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a4159480 0x7f64a4152b20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f649c00efc0 tx=0x7f649c00c490 comp rx=0 tx=0).stop 2024-09-13T16:01:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.637+0000 7f64aae00640 1 -- 172.21.15.70:0/437579567 shutdown_connections 2024-09-13T16:01:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.637+0000 7f64aae00640 1 --2- 172.21.15.70:0/437579567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a4159480 0x7f64a4152b20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.637+0000 7f64aae00640 1 --2- 172.21.15.70:0/437579567 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f648406ac00 0x7f648406d0c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.637+0000 7f64aae00640 1 --2- 172.21.15.70:0/437579567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64a4071560 0x7f64a40a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.637+0000 7f64aae00640 1 --2- 172.21.15.70:0/437579567 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64a406f4b0 0x7f64a4140ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.637+0000 7f64aae00640 1 -- 172.21.15.70:0/437579567 >> 172.21.15.70:0/437579567 conn(0x7f64a40ae310 msgr2=0x7f64a40b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.637+0000 7f64aae00640 1 -- 172.21.15.70:0/437579567 shutdown_connections 2024-09-13T16:01:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.637+0000 7f64aae00640 1 -- 172.21.15.70:0/437579567 wait complete. 2024-09-13T16:01:30.654 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:01:06.070694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:01:16.922043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:01:17.580304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:01:30.655 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:01:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.808+0000 7f364c000640 1 Processor -- start 2024-09-13T16:01:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.808+0000 7f364c000640 1 -- start start 2024-09-13T16:01:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.809+0000 7f364c000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3644154ad0 0x7f36440cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.809+0000 7f364c000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f364406f830 0x7f364406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.809+0000 7f364c000640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364406b7c0 con 0x7f36440ce2c0 2024-09-13T16:01:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.809+0000 7f364c000640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364406b5b0 con 0x7f364406f830 2024-09-13T16:01:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.809+0000 7f364c000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364406baa0 con 0x7f3644154ad0 2024-09-13T16:01:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.809+0000 7f3648c00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f364406f830 0x7f364406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.809+0000 7f364a000640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f36440ce2c0 0x7f36440cbac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:37192/0 (socket says 172.21.15.70:37192) 2024-09-13T16:01:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.809+0000 7f364a000640 1 -- 172.21.15.70:0/1956176835 learned_addr learned my addr 172.21.15.70:0/1956176835 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.810+0000 7f3649600640 1 --2- 172.21.15.70:0/1956176835 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3644154ad0 0x7f36440cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.810+0000 7f3648c00640 1 -- 172.21.15.70:0/1956176835 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3644154ad0 msgr2=0x7f36440cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.810+0000 7f3648c00640 1 --2- 172.21.15.70:0/1956176835 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3644154ad0 0x7f36440cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.810+0000 7f3648c00640 1 -- 172.21.15.70:0/1956176835 >> v1:172.21.15.70:6789/0 conn(0x7f36440ce2c0 legacy=0x7f36440cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:30.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.810+0000 7f3648c00640 1 -- 172.21.15.70:0/1956176835 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364406bd80 con 0x7f364406f830 2024-09-13T16:01:30.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.810+0000 7f3649600640 1 --2- 172.21.15.70:0/1956176835 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3644154ad0 0x7f36440cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:30.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.810+0000 7f3643e00640 1 -- 172.21.15.70:0/1956176835 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227675852 0 0) 0x7f364406b7c0 con 0x7f36440ce2c0 2024-09-13T16:01:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.811+0000 7f3648c00640 1 --2- 172.21.15.70:0/1956176835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f364406f830 0x7f364406fee0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f36300097d0 tx=0x7f363002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ec38461515780b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.811+0000 7f3643e00640 1 -- 172.21.15.70:0/1956176835 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363002ae40 con 0x7f364406f830 2024-09-13T16:01:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.811+0000 7f3643e00640 1 -- 172.21.15.70:0/1956176835 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3630032440 con 0x7f364406f830 2024-09-13T16:01:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.811+0000 7f3643e00640 1 -- 172.21.15.70:0/1956176835 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36300327d0 con 0x7f364406f830 2024-09-13T16:01:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.812+0000 7f364c000640 1 -- 172.21.15.70:0/1956176835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f364406f830 msgr2=0x7f364406fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.812+0000 7f364c000640 1 --2- 172.21.15.70:0/1956176835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f364406f830 0x7f364406fee0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f36300097d0 tx=0x7f363002a130 comp rx=0 tx=0).stop 2024-09-13T16:01:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.812+0000 7f364c000640 1 -- 172.21.15.70:0/1956176835 shutdown_connections 2024-09-13T16:01:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.812+0000 7f364c000640 1 --2- 172.21.15.70:0/1956176835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f364406f830 0x7f364406fee0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.812+0000 7f364c000640 1 --2- 172.21.15.70:0/1956176835 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3644154ad0 0x7f36440cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.812+0000 7f364c000640 1 -- 172.21.15.70:0/1956176835 >> 172.21.15.70:0/1956176835 conn(0x7f36440b0580 msgr2=0x7f36440b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:30.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.812+0000 7f364c000640 1 -- 172.21.15.70:0/1956176835 shutdown_connections 2024-09-13T16:01:30.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.812+0000 7f364c000640 1 -- 172.21.15.70:0/1956176835 wait complete. 2024-09-13T16:01:30.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.813+0000 7f364c000640 1 Processor -- start 2024-09-13T16:01:30.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.814+0000 7f364c000640 1 -- start start 2024-09-13T16:01:30.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.814+0000 7f364c000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3644154ad0 0x7f3644153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:30.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.814+0000 7f364c000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f364414a660 0x7f364413eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:30.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.814+0000 7f364c000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f364413f400 0x7f36441f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:30.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.814+0000 7f364c000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3644153aa0 con 0x7f3644154ad0 2024-09-13T16:01:30.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.814+0000 7f364c000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364414a1d0 con 0x7f364413f400 2024-09-13T16:01:30.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.814+0000 7f364c000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3644149620 con 0x7f364414a660 2024-09-13T16:01:30.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.815+0000 7f3649600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3644154ad0 0x7f3644153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:30.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.815+0000 7f3649600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3644154ad0 0x7f3644153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49910/0 (socket says 172.21.15.70:49910) 2024-09-13T16:01:30.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.815+0000 7f3649600640 1 -- 172.21.15.70:0/1166642214 learned_addr learned my addr 172.21.15.70:0/1166642214 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:30.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.815+0000 7f3648c00640 1 --2- 172.21.15.70:0/1166642214 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f364414a660 0x7f364413eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:30.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.815+0000 7f364a000640 1 --2- 172.21.15.70:0/1166642214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f364413f400 0x7f36441f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:30.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.815+0000 7f3649600640 1 -- 172.21.15.70:0/1166642214 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f364414a660 msgr2=0x7f364413eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:30.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.815+0000 7f3649600640 1 --2- 172.21.15.70:0/1166642214 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f364414a660 0x7f364413eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.815+0000 7f3649600640 1 -- 172.21.15.70:0/1166642214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f364413f400 msgr2=0x7f36441f2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:30.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.815+0000 7f3649600640 1 --2- 172.21.15.70:0/1166642214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f364413f400 0x7f36441f2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.815+0000 7f3649600640 1 -- 172.21.15.70:0/1166642214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3630009400 con 0x7f3644154ad0 2024-09-13T16:01:30.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.815+0000 7f364a000640 1 --2- 172.21.15.70:0/1166642214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f364413f400 0x7f36441f2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:30.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.815+0000 7f3649600640 1 --2- 172.21.15.70:0/1166642214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3644154ad0 0x7f3644153560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f363800d7d0 tx=0x7f363800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:30.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.816+0000 7f3641600640 1 -- 172.21.15.70:0/1166642214 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3638004030 con 0x7f3644154ad0 2024-09-13T16:01:30.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.816+0000 7f3641600640 1 -- 172.21.15.70:0/1166642214 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3638004190 con 0x7f3644154ad0 2024-09-13T16:01:30.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.816+0000 7f3641600640 1 -- 172.21.15.70:0/1166642214 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3638004520 con 0x7f3644154ad0 2024-09-13T16:01:30.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.816+0000 7f364c000640 1 -- 172.21.15.70:0/1166642214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36441498a0 con 0x7f3644154ad0 2024-09-13T16:01:30.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.816+0000 7f364c000640 1 -- 172.21.15.70:0/1166642214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3644149e60 con 0x7f3644154ad0 2024-09-13T16:01:30.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.817+0000 7f364c000640 1 -- 172.21.15.70:0/1166642214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36440cdd80 con 0x7f3644154ad0 2024-09-13T16:01:30.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.818+0000 7f3641600640 1 -- 172.21.15.70:0/1166642214 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f36380096a0 con 0x7f3644154ad0 2024-09-13T16:01:30.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.819+0000 7f3641600640 1 --2- 172.21.15.70:0/1166642214 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f362406ac30 0x7f362406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:30.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.819+0000 7f3641600640 1 -- 172.21.15.70:0/1166642214 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36380894b0 con 0x7f3644154ad0 2024-09-13T16:01:30.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.819+0000 7f3648c00640 1 --2- 172.21.15.70:0/1166642214 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f362406ac30 0x7f362406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:30.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.820+0000 7f3648c00640 1 --2- 172.21.15.70:0/1166642214 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f362406ac30 0x7f362406d0f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3630034000 tx=0x7f363002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:30.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.823+0000 7f3641600640 1 -- 172.21.15.70:0/1166642214 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3638054680 con 0x7f3644154ad0 2024-09-13T16:01:30.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.989+0000 7f364c000640 1 -- 172.21.15.70:0/1166642214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3644147720 con 0x7f3644154ad0 2024-09-13T16:01:30.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.990+0000 7f3641600640 1 -- 172.21.15.70:0/1166642214 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3638057ca0 con 0x7f3644154ad0 2024-09-13T16:01:30.991 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-13T16:01:30.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.991+0000 7f364c000640 1 -- 172.21.15.70:0/1166642214 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f362406ac30 msgr2=0x7f362406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:30.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.991+0000 7f364c000640 1 --2- 172.21.15.70:0/1166642214 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f362406ac30 0x7f362406d0f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3630034000 tx=0x7f363002e000 comp rx=0 tx=0).stop 2024-09-13T16:01:30.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.991+0000 7f364c000640 1 -- 172.21.15.70:0/1166642214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3644154ad0 msgr2=0x7f3644153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:30.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.991+0000 7f364c000640 1 --2- 172.21.15.70:0/1166642214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3644154ad0 0x7f3644153560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f363800d7d0 tx=0x7f363800dc90 comp rx=0 tx=0).stop 2024-09-13T16:01:30.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.992+0000 7f364c000640 1 -- 172.21.15.70:0/1166642214 shutdown_connections 2024-09-13T16:01:30.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.992+0000 7f364c000640 1 --2- 172.21.15.70:0/1166642214 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f362406ac30 0x7f362406d0f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.992+0000 7f364c000640 1 --2- 172.21.15.70:0/1166642214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f364413f400 0x7f36441f2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.992+0000 7f364c000640 1 --2- 172.21.15.70:0/1166642214 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f364414a660 0x7f364413eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.992+0000 7f364c000640 1 --2- 172.21.15.70:0/1166642214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3644154ad0 0x7f3644153560 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:30.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.992+0000 7f364c000640 1 -- 172.21.15.70:0/1166642214 >> 172.21.15.70:0/1166642214 conn(0x7f36440b0580 msgr2=0x7f36440ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:30.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.992+0000 7f364c000640 1 -- 172.21.15.70:0/1166642214 shutdown_connections 2024-09-13T16:01:30.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:30.992+0000 7f364c000640 1 -- 172.21.15.70:0/1166642214 wait complete. 2024-09-13T16:01:31.009 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:01:31.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.161+0000 7fe0c7200640 1 Processor -- start 2024-09-13T16:01:31.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.162+0000 7fe0c7200640 1 -- start start 2024-09-13T16:01:31.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.163+0000 7fe0c7200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe0c00b1db0 0x7fe0c015a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:31.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.163+0000 7fe0c7200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0c006b630 0x7fe0c00cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:31.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.163+0000 7fe0c7200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c0157310 con 0x7fe0c0156f30 2024-09-13T16:01:31.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.163+0000 7fe0c7200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c006bae0 con 0x7fe0c00b1db0 2024-09-13T16:01:31.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.163+0000 7fe0c7200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00b29c0 con 0x7fe0c006b630 2024-09-13T16:01:31.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.163+0000 7fe0c6800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0c006b630 0x7fe0c00cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:31.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.163+0000 7fe0c6800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0c006b630 0x7fe0c00cc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:53470/0 (socket says 172.21.15.70:53470) 2024-09-13T16:01:31.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.163+0000 7fe0c6800640 1 -- 172.21.15.70:0/2247793427 learned_addr learned my addr 172.21.15.70:0/2247793427 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:31.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.163+0000 7fe0c5400640 1 --2- 172.21.15.70:0/2247793427 >> v2:172.21.15.107:3300/0 conn(0x7fe0c00b1db0 0x7fe0c015a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:31.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.164+0000 7fe0c6800640 1 -- 172.21.15.70:0/2247793427 >> v2:172.21.15.107:3300/0 conn(0x7fe0c00b1db0 msgr2=0x7fe0c015a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:31.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.164+0000 7fe0c6800640 1 --2- 172.21.15.70:0/2247793427 >> v2:172.21.15.107:3300/0 conn(0x7fe0c00b1db0 0x7fe0c015a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.164+0000 7fe0c6800640 1 -- 172.21.15.70:0/2247793427 >> v1:172.21.15.107:6789/0 conn(0x7fe0c0156f30 legacy=0x7fe0c00b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:31.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.164+0000 7fe0c6800640 1 -- 172.21.15.70:0/2247793427 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00b2ca0 con 0x7fe0c006b630 2024-09-13T16:01:31.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.165+0000 7fe0c6800640 1 --2- 172.21.15.70:0/2247793427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0c006b630 0x7fe0c00cc4a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009e50 tx=0x7fe0bc02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a918d4f7162aaf0a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:31.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.165+0000 7fe0c4a00640 1 -- 172.21.15.70:0/2247793427 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc031600 con 0x7fe0c006b630 2024-09-13T16:01:31.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.165+0000 7fe0c4a00640 1 -- 172.21.15.70:0/2247793427 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0bc02d050 con 0x7fe0c006b630 2024-09-13T16:01:31.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.165+0000 7fe0c4a00640 1 -- 172.21.15.70:0/2247793427 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc031980 con 0x7fe0c006b630 2024-09-13T16:01:31.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.166+0000 7fe0c7200640 1 -- 172.21.15.70:0/2247793427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0c006b630 msgr2=0x7fe0c00cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:31.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.166+0000 7fe0c7200640 1 --2- 172.21.15.70:0/2247793427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0c006b630 0x7fe0c00cc4a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009e50 tx=0x7fe0bc02a710 comp rx=0 tx=0).stop 2024-09-13T16:01:31.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.166+0000 7fe0c7200640 1 -- 172.21.15.70:0/2247793427 shutdown_connections 2024-09-13T16:01:31.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.166+0000 7fe0c7200640 1 --2- 172.21.15.70:0/2247793427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0c006b630 0x7fe0c00cc4a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.166+0000 7fe0c7200640 1 --2- 172.21.15.70:0/2247793427 >> v2:172.21.15.107:3300/0 conn(0x7fe0c00b1db0 0x7fe0c015a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.166+0000 7fe0c7200640 1 -- 172.21.15.70:0/2247793427 >> 172.21.15.70:0/2247793427 conn(0x7fe0c0069ed0 msgr2=0x7fe0c006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:31.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.166+0000 7fe0c7200640 1 -- 172.21.15.70:0/2247793427 shutdown_connections 2024-09-13T16:01:31.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.166+0000 7fe0c7200640 1 -- 172.21.15.70:0/2247793427 wait complete. 2024-09-13T16:01:31.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.167+0000 7fe0c7200640 1 Processor -- start 2024-09-13T16:01:31.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.168+0000 7fe0c7200640 1 -- start start 2024-09-13T16:01:31.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.168+0000 7fe0c7200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0c006b630 0x7fe0c014cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:31.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.168+0000 7fe0c7200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0c00b1db0 0x7fe0c01f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:31.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.168+0000 7fe0c7200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0c0156f30 0x7fe0c00ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:31.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.168+0000 7fe0c7200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c01f4110 con 0x7fe0c006b630 2024-09-13T16:01:31.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.168+0000 7fe0c7200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c01f3dc0 con 0x7fe0c00b1db0 2024-09-13T16:01:31.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.168+0000 7fe0c7200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c0151b20 con 0x7fe0c0156f30 2024-09-13T16:01:31.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.169+0000 7fe0c5e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0c006b630 0x7fe0c014cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:31.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.169+0000 7fe0c5e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0c006b630 0x7fe0c014cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49918/0 (socket says 172.21.15.70:49918) 2024-09-13T16:01:31.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.169+0000 7fe0c5e00640 1 -- 172.21.15.70:0/2814251533 learned_addr learned my addr 172.21.15.70:0/2814251533 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:31.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.169+0000 7fe0c5400640 1 --2- 172.21.15.70:0/2814251533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0c00b1db0 0x7fe0c01f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:31.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.169+0000 7fe0c6800640 1 --2- 172.21.15.70:0/2814251533 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0c0156f30 0x7fe0c00ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:31.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.169+0000 7fe0c5e00640 1 -- 172.21.15.70:0/2814251533 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0c0156f30 msgr2=0x7fe0c00ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:31.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.169+0000 7fe0c5e00640 1 --2- 172.21.15.70:0/2814251533 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0c0156f30 0x7fe0c00ad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.169+0000 7fe0c5e00640 1 -- 172.21.15.70:0/2814251533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0c00b1db0 msgr2=0x7fe0c01f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:31.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.169+0000 7fe0c5e00640 1 --2- 172.21.15.70:0/2814251533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0c00b1db0 0x7fe0c01f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.169+0000 7fe0c5e00640 1 -- 172.21.15.70:0/2814251533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc009b30 con 0x7fe0c006b630 2024-09-13T16:01:31.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.169+0000 7fe0c5e00640 1 --2- 172.21.15.70:0/2814251533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0c006b630 0x7fe0c014cbe0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400c400 tx=0x7fe0b400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:31.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.170+0000 7fe0ba000640 1 -- 172.21.15.70:0/2814251533 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b40052d0 con 0x7fe0c006b630 2024-09-13T16:01:31.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.170+0000 7fe0ba000640 1 -- 172.21.15.70:0/2814251533 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b4005430 con 0x7fe0c006b630 2024-09-13T16:01:31.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.170+0000 7fe0ba000640 1 -- 172.21.15.70:0/2814251533 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4003830 con 0x7fe0c006b630 2024-09-13T16:01:31.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.170+0000 7fe0c7200640 1 -- 172.21.15.70:0/2814251533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c0151e00 con 0x7fe0c006b630 2024-09-13T16:01:31.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.170+0000 7fe0c7200640 1 -- 172.21.15.70:0/2814251533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c01517f0 con 0x7fe0c006b630 2024-09-13T16:01:31.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.171+0000 7fe0c7200640 1 -- 172.21.15.70:0/2814251533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c0152320 con 0x7fe0c006b630 2024-09-13T16:01:31.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.172+0000 7fe0ba000640 1 -- 172.21.15.70:0/2814251533 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe0b4003990 con 0x7fe0c006b630 2024-09-13T16:01:31.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.172+0000 7fe0ba000640 1 --2- 172.21.15.70:0/2814251533 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe0a406ac00 0x7fe0a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:31.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.172+0000 7fe0ba000640 1 -- 172.21.15.70:0/2814251533 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0b4088830 con 0x7fe0c006b630 2024-09-13T16:01:31.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.173+0000 7fe0c5400640 1 --2- 172.21.15.70:0/2814251533 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe0a406ac00 0x7fe0a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:31.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.173+0000 7fe0c5400640 1 --2- 172.21.15.70:0/2814251533 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe0a406ac00 0x7fe0a406d0c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00cd810 tx=0x7fe0b0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:31.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.177+0000 7fe0ba000640 1 -- 172.21.15.70:0/2814251533 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe0b4053ab0 con 0x7fe0c006b630 2024-09-13T16:01:31.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.344+0000 7fe0c7200640 1 -- 172.21.15.70:0/2814251533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0c01f4380 con 0x7fe0c006b630 2024-09-13T16:01:31.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.344+0000 7fe0ba000640 1 -- 172.21.15.70:0/2814251533 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe0b40570d0 con 0x7fe0c006b630 2024-09-13T16:01:31.346 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-13T16:01:31.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.346+0000 7fe0c7200640 1 -- 172.21.15.70:0/2814251533 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe0a406ac00 msgr2=0x7fe0a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:31.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.346+0000 7fe0c7200640 1 --2- 172.21.15.70:0/2814251533 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe0a406ac00 0x7fe0a406d0c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00cd810 tx=0x7fe0b0009190 comp rx=0 tx=0).stop 2024-09-13T16:01:31.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.346+0000 7fe0c7200640 1 -- 172.21.15.70:0/2814251533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0c006b630 msgr2=0x7fe0c014cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:31.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.346+0000 7fe0c7200640 1 --2- 172.21.15.70:0/2814251533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0c006b630 0x7fe0c014cbe0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400c400 tx=0x7fe0b400c8c0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.346+0000 7fe0c7200640 1 -- 172.21.15.70:0/2814251533 shutdown_connections 2024-09-13T16:01:31.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.347+0000 7fe0c7200640 1 --2- 172.21.15.70:0/2814251533 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0c0156f30 0x7fe0c00ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.347+0000 7fe0c7200640 1 --2- 172.21.15.70:0/2814251533 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe0a406ac00 0x7fe0a406d0c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.347+0000 7fe0c7200640 1 --2- 172.21.15.70:0/2814251533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0c00b1db0 0x7fe0c01f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.347+0000 7fe0c7200640 1 --2- 172.21.15.70:0/2814251533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0c006b630 0x7fe0c014cbe0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.347+0000 7fe0c7200640 1 -- 172.21.15.70:0/2814251533 >> 172.21.15.70:0/2814251533 conn(0x7fe0c0069ed0 msgr2=0x7fe0c0159930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:31.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.347+0000 7fe0c7200640 1 -- 172.21.15.70:0/2814251533 shutdown_connections 2024-09-13T16:01:31.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.347+0000 7fe0c7200640 1 -- 172.21.15.70:0/2814251533 wait complete. 2024-09-13T16:01:31.363 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:01:31.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.517+0000 7ffa4ce00640 1 Processor -- start 2024-09-13T16:01:31.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.517+0000 7ffa4ce00640 1 -- start start 2024-09-13T16:01:31.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.518+0000 7ffa4ce00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ffa4815a420 0x7ffa480b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:31.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.518+0000 7ffa4ce00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa480cbf40 0x7ffa4806b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:31.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.518+0000 7ffa4ce00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa480b30e0 con 0x7ffa480cbb00 2024-09-13T16:01:31.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.518+0000 7ffa4ce00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa4815a800 con 0x7ffa4815a420 2024-09-13T16:01:31.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.518+0000 7ffa4ce00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa480b24d0 con 0x7ffa480cbf40 2024-09-13T16:01:31.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.518+0000 7ffa46a00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7ffa480cbb00 0x7ffa480cd5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:37198/0 (socket says 172.21.15.70:37198) 2024-09-13T16:01:31.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.518+0000 7ffa46a00640 1 -- 172.21.15.70:0/136690259 learned_addr learned my addr 172.21.15.70:0/136690259 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:31.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.518+0000 7ffa47400640 1 --2- 172.21.15.70:0/136690259 >> v2:172.21.15.70:3300/0 conn(0x7ffa4815a420 0x7ffa480b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:31.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.519+0000 7ffa47e00640 1 --2- 172.21.15.70:0/136690259 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa480cbf40 0x7ffa4806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:31.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.519+0000 7ffa46000640 1 -- 172.21.15.70:0/136690259 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673784393 0 0) 0x7ffa480b30e0 con 0x7ffa480cbb00 2024-09-13T16:01:31.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.519+0000 7ffa46000640 1 -- 172.21.15.70:0/136690259 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa2c003520 con 0x7ffa480cbb00 2024-09-13T16:01:31.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.519+0000 7ffa47400640 1 -- 172.21.15.70:0/136690259 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa480cbf40 msgr2=0x7ffa4806b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:31.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.519+0000 7ffa47400640 1 --2- 172.21.15.70:0/136690259 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa480cbf40 0x7ffa4806b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.519+0000 7ffa47400640 1 -- 172.21.15.70:0/136690259 >> v1:172.21.15.70:6789/0 conn(0x7ffa480cbb00 legacy=0x7ffa480cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:31.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.519+0000 7ffa47400640 1 -- 172.21.15.70:0/136690259 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa480b27b0 con 0x7ffa4815a420 2024-09-13T16:01:31.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.520+0000 7ffa47400640 1 --2- 172.21.15.70:0/136690259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa4815a420 0x7ffa480b1ed0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009d90 tx=0x7ffa3802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d900c9f6a197357b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:31.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.520+0000 7ffa46000640 1 -- 172.21.15.70:0/136690259 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38007740 con 0x7ffa4815a420 2024-09-13T16:01:31.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.520+0000 7ffa46000640 1 -- 172.21.15.70:0/136690259 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3802d050 con 0x7ffa4815a420 2024-09-13T16:01:31.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.520+0000 7ffa46000640 1 -- 172.21.15.70:0/136690259 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38007ac0 con 0x7ffa4815a420 2024-09-13T16:01:31.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.521+0000 7ffa4ce00640 1 -- 172.21.15.70:0/136690259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa4815a420 msgr2=0x7ffa480b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.521+0000 7ffa4ce00640 1 --2- 172.21.15.70:0/136690259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa4815a420 0x7ffa480b1ed0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009d90 tx=0x7ffa3802a660 comp rx=0 tx=0).stop 2024-09-13T16:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.521+0000 7ffa4ce00640 1 -- 172.21.15.70:0/136690259 shutdown_connections 2024-09-13T16:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.521+0000 7ffa4ce00640 1 --2- 172.21.15.70:0/136690259 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa480cbf40 0x7ffa4806b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.521+0000 7ffa4ce00640 1 --2- 172.21.15.70:0/136690259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa4815a420 0x7ffa480b1ed0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.521+0000 7ffa4ce00640 1 -- 172.21.15.70:0/136690259 >> 172.21.15.70:0/136690259 conn(0x7ffa48069ed0 msgr2=0x7ffa4806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.521+0000 7ffa4ce00640 1 -- 172.21.15.70:0/136690259 shutdown_connections 2024-09-13T16:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.521+0000 7ffa4ce00640 1 -- 172.21.15.70:0/136690259 wait complete. 2024-09-13T16:01:31.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.522+0000 7ffa4ce00640 1 Processor -- start 2024-09-13T16:01:31.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.522+0000 7ffa4ce00640 1 -- start start 2024-09-13T16:01:31.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.523+0000 7ffa4ce00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa480cbb00 0x7ffa4814ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:31.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.523+0000 7ffa4ce00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa480cbf40 0x7ffa4814c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:31.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.523+0000 7ffa4ce00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa4815a420 0x7ffa481f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:31.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.523+0000 7ffa4ce00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa481f3a00 con 0x7ffa480cbb00 2024-09-13T16:01:31.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.523+0000 7ffa4ce00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4814b340 con 0x7ffa480cbf40 2024-09-13T16:01:31.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.523+0000 7ffa4ce00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4814c550 con 0x7ffa4815a420 2024-09-13T16:01:31.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.524+0000 7ffa47400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa480cbb00 0x7ffa4814ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:31.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.524+0000 7ffa47400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa480cbb00 0x7ffa4814ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49936/0 (socket says 172.21.15.70:49936) 2024-09-13T16:01:31.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.524+0000 7ffa47400640 1 -- 172.21.15.70:0/1415160830 learned_addr learned my addr 172.21.15.70:0/1415160830 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:31.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.524+0000 7ffa47e00640 1 --2- 172.21.15.70:0/1415160830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa4815a420 0x7ffa481f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:31.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.524+0000 7ffa46a00640 1 --2- 172.21.15.70:0/1415160830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa480cbf40 0x7ffa4814c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:31.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.524+0000 7ffa47400640 1 -- 172.21.15.70:0/1415160830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa4815a420 msgr2=0x7ffa481f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:31.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.524+0000 7ffa47400640 1 --2- 172.21.15.70:0/1415160830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa4815a420 0x7ffa481f2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.524+0000 7ffa47400640 1 -- 172.21.15.70:0/1415160830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa480cbf40 msgr2=0x7ffa4814c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:31.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.524+0000 7ffa47400640 1 --2- 172.21.15.70:0/1415160830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa480cbf40 0x7ffa4814c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.524+0000 7ffa47400640 1 -- 172.21.15.70:0/1415160830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa38009a70 con 0x7ffa480cbb00 2024-09-13T16:01:31.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.524+0000 7ffa46a00640 1 --2- 172.21.15.70:0/1415160830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa480cbf40 0x7ffa4814c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:31.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.524+0000 7ffa47400640 1 --2- 172.21.15.70:0/1415160830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa480cbb00 0x7ffa4814ae00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009eb0 tx=0x7ffa38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:31.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.525+0000 7ffa3f400640 1 -- 172.21.15.70:0/1415160830 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3803b820 con 0x7ffa480cbb00 2024-09-13T16:01:31.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.525+0000 7ffa3f400640 1 -- 172.21.15.70:0/1415160830 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3803b980 con 0x7ffa480cbb00 2024-09-13T16:01:31.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.525+0000 7ffa3f400640 1 -- 172.21.15.70:0/1415160830 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3803bd30 con 0x7ffa480cbb00 2024-09-13T16:01:31.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.525+0000 7ffa4ce00640 1 -- 172.21.15.70:0/1415160830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa481f3440 con 0x7ffa480cbb00 2024-09-13T16:01:31.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.525+0000 7ffa4ce00640 1 -- 172.21.15.70:0/1415160830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4814c1e0 con 0x7ffa480cbb00 2024-09-13T16:01:31.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.526+0000 7ffa4ce00640 1 -- 172.21.15.70:0/1415160830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa480adff0 con 0x7ffa480cbb00 2024-09-13T16:01:31.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.527+0000 7ffa3f400640 1 -- 172.21.15.70:0/1415160830 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffa38044460 con 0x7ffa480cbb00 2024-09-13T16:01:31.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.528+0000 7ffa3f400640 1 --2- 172.21.15.70:0/1415160830 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ffa2806ac00 0x7ffa2806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:31.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.528+0000 7ffa3f400640 1 -- 172.21.15.70:0/1415160830 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa380aabb0 con 0x7ffa480cbb00 2024-09-13T16:01:31.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.528+0000 7ffa46a00640 1 --2- 172.21.15.70:0/1415160830 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ffa2806ac00 0x7ffa2806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:31.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.529+0000 7ffa46a00640 1 --2- 172.21.15.70:0/1415160830 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ffa2806ac00 0x7ffa2806d0c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffa340011e0 tx=0x7ffa34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:31.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.532+0000 7ffa3f400640 1 -- 172.21.15.70:0/1415160830 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ffa38075cf0 con 0x7ffa480cbb00 2024-09-13T16:01:31.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.702+0000 7ffa4ce00640 1 -- 172.21.15.70:0/1415160830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffa480b1ed0 con 0x7ffa480cbb00 2024-09-13T16:01:31.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.702+0000 7ffa3f400640 1 -- 172.21.15.70:0/1415160830 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffa38079310 con 0x7ffa480cbb00 2024-09-13T16:01:31.703 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-13T16:01:31.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.704+0000 7ffa4ce00640 1 -- 172.21.15.70:0/1415160830 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ffa2806ac00 msgr2=0x7ffa2806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:31.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.704+0000 7ffa4ce00640 1 --2- 172.21.15.70:0/1415160830 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ffa2806ac00 0x7ffa2806d0c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffa340011e0 tx=0x7ffa34009040 comp rx=0 tx=0).stop 2024-09-13T16:01:31.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.704+0000 7ffa4ce00640 1 -- 172.21.15.70:0/1415160830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa480cbb00 msgr2=0x7ffa4814ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:31.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.704+0000 7ffa4ce00640 1 --2- 172.21.15.70:0/1415160830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa480cbb00 0x7ffa4814ae00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009eb0 tx=0x7ffa38004a40 comp rx=0 tx=0).stop 2024-09-13T16:01:31.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.704+0000 7ffa4ce00640 1 -- 172.21.15.70:0/1415160830 shutdown_connections 2024-09-13T16:01:31.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.704+0000 7ffa4ce00640 1 --2- 172.21.15.70:0/1415160830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa4815a420 0x7ffa481f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.704+0000 7ffa4ce00640 1 --2- 172.21.15.70:0/1415160830 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ffa2806ac00 0x7ffa2806d0c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.704+0000 7ffa4ce00640 1 --2- 172.21.15.70:0/1415160830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa480cbf40 0x7ffa4814c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.704+0000 7ffa4ce00640 1 --2- 172.21.15.70:0/1415160830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa480cbb00 0x7ffa4814ae00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.705+0000 7ffa4ce00640 1 -- 172.21.15.70:0/1415160830 >> 172.21.15.70:0/1415160830 conn(0x7ffa48069ed0 msgr2=0x7ffa48156630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:31.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.705+0000 7ffa4ce00640 1 -- 172.21.15.70:0/1415160830 shutdown_connections 2024-09-13T16:01:31.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.705+0000 7ffa4ce00640 1 -- 172.21.15.70:0/1415160830 wait complete. 2024-09-13T16:01:31.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:01:31.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.872+0000 7ff5d1600640 1 Processor -- start 2024-09-13T16:01:31.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.872+0000 7ff5d1600640 1 -- start start 2024-09-13T16:01:31.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.873+0000 7ff5d1600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5cc15fdd0 0x7ff5cc0d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.873+0000 7ff5d1600640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff5cc0b1c50 0x7ff5cc0d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.873+0000 7ff5d1600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5cc1601b0 con 0x7ff5cc1603b0 2024-09-13T16:01:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.873+0000 7ff5d1600640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5cc0cd6a0 con 0x7ff5cc0b1c50 2024-09-13T16:01:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.873+0000 7ff5d1600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc0d17e0 con 0x7ff5cc15fdd0 2024-09-13T16:01:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.873+0000 7ff5cb400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff5cc0b1c50 0x7ff5cc0d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.873+0000 7ff5cb400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff5cc0b1c50 0x7ff5cc0d1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49950/0 (socket says 172.21.15.70:49950) 2024-09-13T16:01:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.873+0000 7ff5cb400640 1 -- 172.21.15.70:0/1131508085 learned_addr learned my addr 172.21.15.70:0/1131508085 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.873+0000 7ff5cbe00640 1 --2- 172.21.15.70:0/1131508085 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5cc15fdd0 0x7ff5cc0d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.874+0000 7ff5cb400640 1 -- 172.21.15.70:0/1131508085 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5cc15fdd0 msgr2=0x7ff5cc0d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.874+0000 7ff5cb400640 1 --2- 172.21.15.70:0/1131508085 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5cc15fdd0 0x7ff5cc0d1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.874+0000 7ff5cb400640 1 -- 172.21.15.70:0/1131508085 >> v1:172.21.15.107:6789/0 conn(0x7ff5cc1603b0 legacy=0x7ff5cc1607e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.874+0000 7ff5cb400640 1 -- 172.21.15.70:0/1131508085 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc0cfd50 con 0x7ff5cc0b1c50 2024-09-13T16:01:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.875+0000 7ff5cb400640 1 --2- 172.21.15.70:0/1131508085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5cc0b1c50 0x7ff5cc0d1fd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009870 tx=0x7ff5b802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a16e27d20908d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.875+0000 7ff5caa00640 1 -- 172.21.15.70:0/1131508085 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8032440 con 0x7ff5cc0b1c50 2024-09-13T16:01:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.875+0000 7ff5caa00640 1 -- 172.21.15.70:0/1131508085 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b80325a0 con 0x7ff5cc0b1c50 2024-09-13T16:01:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.875+0000 7ff5caa00640 1 -- 172.21.15.70:0/1131508085 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8032930 con 0x7ff5cc0b1c50 2024-09-13T16:01:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.875+0000 7ff5d1600640 1 -- 172.21.15.70:0/1131508085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5cc0b1c50 msgr2=0x7ff5cc0d1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.875+0000 7ff5d1600640 1 --2- 172.21.15.70:0/1131508085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5cc0b1c50 0x7ff5cc0d1fd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009870 tx=0x7ff5b802a1c0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.876+0000 7ff5d1600640 1 -- 172.21.15.70:0/1131508085 shutdown_connections 2024-09-13T16:01:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.876+0000 7ff5d1600640 1 --2- 172.21.15.70:0/1131508085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5cc0b1c50 0x7ff5cc0d1fd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.876+0000 7ff5d1600640 1 --2- 172.21.15.70:0/1131508085 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5cc15fdd0 0x7ff5cc0d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.876+0000 7ff5d1600640 1 -- 172.21.15.70:0/1131508085 >> 172.21.15.70:0/1131508085 conn(0x7ff5cc06a7c0 msgr2=0x7ff5cc06abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:31.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.876+0000 7ff5d1600640 1 -- 172.21.15.70:0/1131508085 shutdown_connections 2024-09-13T16:01:31.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.876+0000 7ff5d1600640 1 -- 172.21.15.70:0/1131508085 wait complete. 2024-09-13T16:01:31.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.877+0000 7ff5d1600640 1 Processor -- start 2024-09-13T16:01:31.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.877+0000 7ff5d1600640 1 -- start start 2024-09-13T16:01:31.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.878+0000 7ff5d1600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5cc0b1c50 0x7ff5cc1f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:31.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.878+0000 7ff5d1600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5cc15fdd0 0x7ff5cc15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:31.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.878+0000 7ff5d1600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5cc1603b0 0x7ff5cc15bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:31.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.878+0000 7ff5d1600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc1f39a0 con 0x7ff5cc1603b0 2024-09-13T16:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.878+0000 7ff5d1600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc1f3370 con 0x7ff5cc15fdd0 2024-09-13T16:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.878+0000 7ff5d1600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc1f3170 con 0x7ff5cc0b1c50 2024-09-13T16:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.878+0000 7ff5d0c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5cc1603b0 0x7ff5cc15bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.878+0000 7ff5d0c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5cc1603b0 0x7ff5cc15bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49966/0 (socket says 172.21.15.70:49966) 2024-09-13T16:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.878+0000 7ff5d0c00640 1 -- 172.21.15.70:0/1763194671 learned_addr learned my addr 172.21.15.70:0/1763194671 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.878+0000 7ff5cbe00640 1 --2- 172.21.15.70:0/1763194671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5cc0b1c50 0x7ff5cc1f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.879+0000 7ff5cb400640 1 --2- 172.21.15.70:0/1763194671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5cc15fdd0 0x7ff5cc15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.879+0000 7ff5d0c00640 1 -- 172.21.15.70:0/1763194671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5cc0b1c50 msgr2=0x7ff5cc1f2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.879+0000 7ff5d0c00640 1 --2- 172.21.15.70:0/1763194671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5cc0b1c50 0x7ff5cc1f2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.879+0000 7ff5d0c00640 1 -- 172.21.15.70:0/1763194671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5cc15fdd0 msgr2=0x7ff5cc15ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.879+0000 7ff5d0c00640 1 --2- 172.21.15.70:0/1763194671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5cc15fdd0 0x7ff5cc15ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.879+0000 7ff5d0c00640 1 -- 172.21.15.70:0/1763194671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b80094d0 con 0x7ff5cc1603b0 2024-09-13T16:01:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.879+0000 7ff5d0c00640 1 --2- 172.21.15.70:0/1763194671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5cc1603b0 0x7ff5cc15bf40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400c7a0 tx=0x7ff5c400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.879+0000 7ff5c3e00640 1 -- 172.21.15.70:0/1763194671 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4003b70 con 0x7ff5cc1603b0 2024-09-13T16:01:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.879+0000 7ff5c3e00640 1 -- 172.21.15.70:0/1763194671 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c4003cf0 con 0x7ff5cc1603b0 2024-09-13T16:01:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.879+0000 7ff5d1600640 1 -- 172.21.15.70:0/1763194671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5cc0c9030 con 0x7ff5cc1603b0 2024-09-13T16:01:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.879+0000 7ff5c3e00640 1 -- 172.21.15.70:0/1763194671 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c400aa90 con 0x7ff5cc1603b0 2024-09-13T16:01:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.880+0000 7ff5d1600640 1 -- 172.21.15.70:0/1763194671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5cc1f35c0 con 0x7ff5cc1603b0 2024-09-13T16:01:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.881+0000 7ff5d1600640 1 -- 172.21.15.70:0/1763194671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5cc1f3ae0 con 0x7ff5cc1603b0 2024-09-13T16:01:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.881+0000 7ff5c3e00640 1 -- 172.21.15.70:0/1763194671 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff5c400abf0 con 0x7ff5cc1603b0 2024-09-13T16:01:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.882+0000 7ff5c3e00640 1 --2- 172.21.15.70:0/1763194671 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ff5ac06ac00 0x7ff5ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.882+0000 7ff5c3e00640 1 -- 172.21.15.70:0/1763194671 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5c4088ff0 con 0x7ff5cc1603b0 2024-09-13T16:01:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.882+0000 7ff5cbe00640 1 --2- 172.21.15.70:0/1763194671 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ff5ac06ac00 0x7ff5ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:31.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.883+0000 7ff5cbe00640 1 --2- 172.21.15.70:0/1763194671 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ff5ac06ac00 0x7ff5ac06d0c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009b40 tx=0x7ff5bc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:31.886+0000 7ff5c3e00640 1 -- 172.21.15.70:0/1763194671 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff5cc1f3ae0 con 0x7ff5cc1603b0 2024-09-13T16:01:32.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.087+0000 7ff5d1600640 1 -- 172.21.15.70:0/1763194671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5cc1f3ae0 con 0x7ff5cc1603b0 2024-09-13T16:01:32.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.088+0000 7ff5c3e00640 1 -- 172.21.15.70:0/1763194671 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4728 (secure 0 0 0) 0x7ff5cc1f3ae0 con 0x7ff5cc1603b0 2024-09-13T16:01:32.089 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:32.089 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2852595148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2852595148},{"type":"v1","addr":"172.21.15.107:6834","nonce":2852595148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2578992914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2578992914},{"type":"v1","addr":"172.21.15.70:6835","nonce":2578992914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/927553867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":927553867},{"type":"v1","addr":"172.21.15.70:6837","nonce":927553867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:01:18.592735+0000","modified":"2024-09-13T16:01:21.606407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6835/712016246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":712016246},{"type":"v1","addr":"172.21.15.107:6835","nonce":712016246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:01:32.090 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2024-09-13T16:01:32.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.090+0000 7ff5d1600640 1 -- 172.21.15.70:0/1763194671 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ff5ac06ac00 msgr2=0x7ff5ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:32.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.090+0000 7ff5d1600640 1 --2- 172.21.15.70:0/1763194671 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ff5ac06ac00 0x7ff5ac06d0c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009b40 tx=0x7ff5bc009190 comp rx=0 tx=0).stop 2024-09-13T16:01:32.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.090+0000 7ff5d1600640 1 -- 172.21.15.70:0/1763194671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5cc1603b0 msgr2=0x7ff5cc15bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:32.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.090+0000 7ff5d1600640 1 --2- 172.21.15.70:0/1763194671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5cc1603b0 0x7ff5cc15bf40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400c7a0 tx=0x7ff5c400cc60 comp rx=0 tx=0).stop 2024-09-13T16:01:32.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.090+0000 7ff5d1600640 1 -- 172.21.15.70:0/1763194671 shutdown_connections 2024-09-13T16:01:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.090+0000 7ff5d1600640 1 --2- 172.21.15.70:0/1763194671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5cc1603b0 0x7ff5cc15bf40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.090+0000 7ff5d1600640 1 --2- 172.21.15.70:0/1763194671 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ff5ac06ac00 0x7ff5ac06d0c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.090+0000 7ff5d1600640 1 --2- 172.21.15.70:0/1763194671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5cc15fdd0 0x7ff5cc15ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.090+0000 7ff5d1600640 1 --2- 172.21.15.70:0/1763194671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5cc0b1c50 0x7ff5cc1f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.090+0000 7ff5d1600640 1 -- 172.21.15.70:0/1763194671 >> 172.21.15.70:0/1763194671 conn(0x7ff5cc06a7c0 msgr2=0x7ff5cc0d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.090+0000 7ff5d1600640 1 -- 172.21.15.70:0/1763194671 shutdown_connections 2024-09-13T16:01:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.090+0000 7ff5d1600640 1 -- 172.21.15.70:0/1763194671 wait complete. 2024-09-13T16:01:32.108 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:32.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.263+0000 7f420d000640 1 Processor -- start 2024-09-13T16:01:32.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.263+0000 7f420d000640 1 -- start start 2024-09-13T16:01:32.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.264+0000 7f420d000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f420815a5c0 0x7f42080b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:32.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.264+0000 7f420d000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f42080cbac0 0x7f42080b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:32.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.264+0000 7f420d000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42080cbfc0 con 0x7f42080afe10 2024-09-13T16:01:32.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.264+0000 7f420d000640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42080cce20 con 0x7f42080cbac0 2024-09-13T16:01:32.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.264+0000 7f420d000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42080707a0 con 0x7f420815a5c0 2024-09-13T16:01:32.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.265+0000 7f41ffe00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f42080cbac0 0x7f42080b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:32.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.265+0000 7f41ffe00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f42080cbac0 0x7f42080b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49968/0 (socket says 172.21.15.70:49968) 2024-09-13T16:01:32.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.265+0000 7f41ffe00640 1 -- 172.21.15.70:0/1861157956 learned_addr learned my addr 172.21.15.70:0/1861157956 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:32.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.265+0000 7f4207400640 1 --2- 172.21.15.70:0/1861157956 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f420815a5c0 0x7f42080b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:32.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.265+0000 7f41ffe00640 1 -- 172.21.15.70:0/1861157956 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f420815a5c0 msgr2=0x7f42080b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:32.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.265+0000 7f41ffe00640 1 --2- 172.21.15.70:0/1861157956 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f420815a5c0 0x7f42080b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.265+0000 7f41ffe00640 1 -- 172.21.15.70:0/1861157956 >> v1:172.21.15.107:6789/0 conn(0x7f42080afe10 legacy=0x7f420806f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:32.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.265+0000 7f41ffe00640 1 -- 172.21.15.70:0/1861157956 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4208070a80 con 0x7f42080cbac0 2024-09-13T16:01:32.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.266+0000 7f41ffe00640 1 --2- 172.21.15.70:0/1861157956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42080cbac0 0x7f42080b3ef0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f41f0009870 tx=0x7f41f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c9033d2cc35bc02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:32.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.266+0000 7f4206a00640 1 -- 172.21.15.70:0/1861157956 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0032440 con 0x7f42080cbac0 2024-09-13T16:01:32.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.267+0000 7f4206a00640 1 -- 172.21.15.70:0/1861157956 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f00325a0 con 0x7f42080cbac0 2024-09-13T16:01:32.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.267+0000 7f4206a00640 1 -- 172.21.15.70:0/1861157956 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0032930 con 0x7f42080cbac0 2024-09-13T16:01:32.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.267+0000 7f420d000640 1 -- 172.21.15.70:0/1861157956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42080cbac0 msgr2=0x7f42080b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:32.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.267+0000 7f420d000640 1 --2- 172.21.15.70:0/1861157956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42080cbac0 0x7f42080b3ef0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f41f0009870 tx=0x7f41f002a270 comp rx=0 tx=0).stop 2024-09-13T16:01:32.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.267+0000 7f420d000640 1 -- 172.21.15.70:0/1861157956 shutdown_connections 2024-09-13T16:01:32.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.267+0000 7f420d000640 1 --2- 172.21.15.70:0/1861157956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42080cbac0 0x7f42080b3ef0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.267+0000 7f420d000640 1 --2- 172.21.15.70:0/1861157956 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f420815a5c0 0x7f42080b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.267+0000 7f420d000640 1 -- 172.21.15.70:0/1861157956 >> 172.21.15.70:0/1861157956 conn(0x7f42080ae310 msgr2=0x7f42080ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:32.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.267+0000 7f420d000640 1 -- 172.21.15.70:0/1861157956 shutdown_connections 2024-09-13T16:01:32.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.267+0000 7f420d000640 1 -- 172.21.15.70:0/1861157956 wait complete. 2024-09-13T16:01:32.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.270+0000 7f420d000640 1 Processor -- start 2024-09-13T16:01:32.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.270+0000 7f420d000640 1 -- start start 2024-09-13T16:01:32.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.271+0000 7f420d000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42080afe10 0x7f42081e2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:32.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.272+0000 7f420d000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42080cbac0 0x7f42081e0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:32.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.272+0000 7f420d000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f420815a5c0 0x7f4208142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:32.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.272+0000 7f420d000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4208152960 con 0x7f42080afe10 2024-09-13T16:01:32.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.272+0000 7f420d000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42081e0c40 con 0x7f42080cbac0 2024-09-13T16:01:32.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.272+0000 7f420d000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42081e28d0 con 0x7f420815a5c0 2024-09-13T16:01:32.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.272+0000 7f4207400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42080afe10 0x7f42081e2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:32.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.272+0000 7f4207400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42080afe10 0x7f42081e2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49978/0 (socket says 172.21.15.70:49978) 2024-09-13T16:01:32.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.272+0000 7f4207400640 1 -- 172.21.15.70:0/1572846044 learned_addr learned my addr 172.21.15.70:0/1572846044 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:32.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.272+0000 7f4207e00640 1 --2- 172.21.15.70:0/1572846044 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f420815a5c0 0x7f4208142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:32.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.272+0000 7f41ffe00640 1 --2- 172.21.15.70:0/1572846044 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42080cbac0 0x7f42081e0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:32.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.272+0000 7f4207400640 1 -- 172.21.15.70:0/1572846044 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f420815a5c0 msgr2=0x7f4208142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:32.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.272+0000 7f4207400640 1 --2- 172.21.15.70:0/1572846044 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f420815a5c0 0x7f4208142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.272+0000 7f4207400640 1 -- 172.21.15.70:0/1572846044 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42080cbac0 msgr2=0x7f42081e0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:32.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.272+0000 7f4207400640 1 --2- 172.21.15.70:0/1572846044 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42080cbac0 0x7f42081e0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.272+0000 7f4207400640 1 -- 172.21.15.70:0/1572846044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f00094d0 con 0x7f42080afe10 2024-09-13T16:01:32.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.273+0000 7f4207400640 1 --2- 172.21.15.70:0/1572846044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42080afe10 0x7f42081e2110 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f41f800e9b0 tx=0x7f41f800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:32.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.273+0000 7f41ff400640 1 -- 172.21.15.70:0/1572846044 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f8009670 con 0x7f42080afe10 2024-09-13T16:01:32.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.273+0000 7f41ff400640 1 -- 172.21.15.70:0/1572846044 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f800c9a0 con 0x7f42080afe10 2024-09-13T16:01:32.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.273+0000 7f41ff400640 1 -- 172.21.15.70:0/1572846044 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f800cd50 con 0x7f42080afe10 2024-09-13T16:01:32.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.273+0000 7f420d000640 1 -- 172.21.15.70:0/1572846044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42081e0ee0 con 0x7f42080afe10 2024-09-13T16:01:32.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.273+0000 7f420d000640 1 -- 172.21.15.70:0/1572846044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42081e14a0 con 0x7f42080afe10 2024-09-13T16:01:32.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.274+0000 7f420d000640 1 -- 172.21.15.70:0/1572846044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4208067360 con 0x7f42080afe10 2024-09-13T16:01:32.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.275+0000 7f41ff400640 1 -- 172.21.15.70:0/1572846044 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f41f8013470 con 0x7f42080afe10 2024-09-13T16:01:32.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.276+0000 7f41ff400640 1 --2- 172.21.15.70:0/1572846044 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f41e406ac00 0x7f41e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:32.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.276+0000 7f41ff400640 1 -- 172.21.15.70:0/1572846044 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41f80895b0 con 0x7f42080afe10 2024-09-13T16:01:32.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.276+0000 7f41ffe00640 1 --2- 172.21.15.70:0/1572846044 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f41e406ac00 0x7f41e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:32.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.277+0000 7f41ffe00640 1 --2- 172.21.15.70:0/1572846044 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f41e406ac00 0x7f41e406d0c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f41f0034000 tx=0x7f41f002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:32.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.280+0000 7f41ff400640 1 -- 172.21.15.70:0/1572846044 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f41f8054830 con 0x7f42080afe10 2024-09-13T16:01:32.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.462+0000 7f420d000640 1 -- 172.21.15.70:0/1572846044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42081e1690 con 0x7f42080afe10 2024-09-13T16:01:32.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.463+0000 7f41ff400640 1 -- 172.21.15.70:0/1572846044 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f41f8057e50 con 0x7f42080afe10 2024-09-13T16:01:32.464 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:32.465 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:19.595458+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:32.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.465+0000 7f420d000640 1 -- 172.21.15.70:0/1572846044 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f41e406ac00 msgr2=0x7f41e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:32.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.465+0000 7f420d000640 1 --2- 172.21.15.70:0/1572846044 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f41e406ac00 0x7f41e406d0c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f41f0034000 tx=0x7f41f002e000 comp rx=0 tx=0).stop 2024-09-13T16:01:32.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.465+0000 7f420d000640 1 -- 172.21.15.70:0/1572846044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42080afe10 msgr2=0x7f42081e2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:32.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.465+0000 7f420d000640 1 --2- 172.21.15.70:0/1572846044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42080afe10 0x7f42081e2110 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f41f800e9b0 tx=0x7f41f800ee70 comp rx=0 tx=0).stop 2024-09-13T16:01:32.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.465+0000 7f420d000640 1 -- 172.21.15.70:0/1572846044 shutdown_connections 2024-09-13T16:01:32.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.465+0000 7f420d000640 1 --2- 172.21.15.70:0/1572846044 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f420815a5c0 0x7f4208142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.465+0000 7f420d000640 1 --2- 172.21.15.70:0/1572846044 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f41e406ac00 0x7f41e406d0c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.465+0000 7f420d000640 1 --2- 172.21.15.70:0/1572846044 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42080cbac0 0x7f42081e0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.465+0000 7f420d000640 1 --2- 172.21.15.70:0/1572846044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42080afe10 0x7f42081e2110 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.465+0000 7f420d000640 1 -- 172.21.15.70:0/1572846044 >> 172.21.15.70:0/1572846044 conn(0x7f42080ae310 msgr2=0x7f42080af600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:32.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.465+0000 7f420d000640 1 -- 172.21.15.70:0/1572846044 shutdown_connections 2024-09-13T16:01:32.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.465+0000 7f420d000640 1 -- 172.21.15.70:0/1572846044 wait complete. 2024-09-13T16:01:32.483 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:01:32.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.636+0000 7fb6a1400640 1 Processor -- start 2024-09-13T16:01:32.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.636+0000 7fb6a1400640 1 -- start start 2024-09-13T16:01:32.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.638+0000 7fb6a1400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb69c153b20 0x7fb69c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:32.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.638+0000 7fb6a1400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb69c06f660 0x7fb69c06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:32.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.638+0000 7fb6a1400640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69c153f00 con 0x7fb69c159a80 2024-09-13T16:01:32.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.638+0000 7fb6a1400640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69c0ce600 con 0x7fb69c153b20 2024-09-13T16:01:32.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.638+0000 7fb6a1400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69c070f90 con 0x7fb69c06f660 2024-09-13T16:01:32.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.638+0000 7fb693e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb69c159a80 0x7fb69c0b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:37200/0 (socket says 172.21.15.70:37200) 2024-09-13T16:01:32.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.638+0000 7fb693e00640 1 -- 172.21.15.70:0/2620975707 learned_addr learned my addr 172.21.15.70:0/2620975707 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:32.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.638+0000 7fb69a800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb69c153b20 0x7fb69c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:32.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.638+0000 7fb69b200640 1 --2- 172.21.15.70:0/2620975707 >> v2:172.21.15.107:3300/0 conn(0x7fb69c06f660 0x7fb69c06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:32.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.639+0000 7fb69a800640 1 -- 172.21.15.70:0/2620975707 >> v2:172.21.15.107:3300/0 conn(0x7fb69c06f660 msgr2=0x7fb69c06fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:32.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.639+0000 7fb69a800640 1 --2- 172.21.15.70:0/2620975707 >> v2:172.21.15.107:3300/0 conn(0x7fb69c06f660 0x7fb69c06fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.639+0000 7fb69a800640 1 -- 172.21.15.70:0/2620975707 >> v1:172.21.15.70:6789/0 conn(0x7fb69c159a80 legacy=0x7fb69c0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:32.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.639+0000 7fb699e00640 1 -- 172.21.15.70:0/2620975707 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734853174 0 0) 0x7fb69c153f00 con 0x7fb69c159a80 2024-09-13T16:01:32.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.639+0000 7fb69a800640 1 -- 172.21.15.70:0/2620975707 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c0b1a40 con 0x7fb69c153b20 2024-09-13T16:01:32.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.640+0000 7fb69a800640 1 --2- 172.21.15.70:0/2620975707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69c153b20 0x7fb69c0b3990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb69c0cb060 tx=0x7fb68c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a60a9de76f5568 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:32.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.640+0000 7fb699e00640 1 -- 172.21.15.70:0/2620975707 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c032440 con 0x7fb69c153b20 2024-09-13T16:01:32.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.640+0000 7fb699e00640 1 -- 172.21.15.70:0/2620975707 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c0325a0 con 0x7fb69c153b20 2024-09-13T16:01:32.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.641+0000 7fb699e00640 1 -- 172.21.15.70:0/2620975707 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c032930 con 0x7fb69c153b20 2024-09-13T16:01:32.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.641+0000 7fb6a1400640 1 -- 172.21.15.70:0/2620975707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69c153b20 msgr2=0x7fb69c0b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:32.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.641+0000 7fb6a1400640 1 --2- 172.21.15.70:0/2620975707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69c153b20 0x7fb69c0b3990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb69c0cb060 tx=0x7fb68c02a1e0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.641+0000 7fb6a1400640 1 -- 172.21.15.70:0/2620975707 shutdown_connections 2024-09-13T16:01:32.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.641+0000 7fb6a1400640 1 --2- 172.21.15.70:0/2620975707 >> v2:172.21.15.107:3300/0 conn(0x7fb69c06f660 0x7fb69c06fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.641+0000 7fb6a1400640 1 --2- 172.21.15.70:0/2620975707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69c153b20 0x7fb69c0b3990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.641+0000 7fb6a1400640 1 -- 172.21.15.70:0/2620975707 >> 172.21.15.70:0/2620975707 conn(0x7fb69c0b0510 msgr2=0x7fb69c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:32.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.641+0000 7fb6a1400640 1 -- 172.21.15.70:0/2620975707 shutdown_connections 2024-09-13T16:01:32.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.641+0000 7fb6a1400640 1 -- 172.21.15.70:0/2620975707 wait complete. 2024-09-13T16:01:32.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.644+0000 7fb6a1400640 1 Processor -- start 2024-09-13T16:01:32.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.644+0000 7fb6a1400640 1 -- start start 2024-09-13T16:01:32.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.645+0000 7fb6a1400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb69c06f660 0x7fb69c143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:32.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.646+0000 7fb6a1400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69c153b20 0x7fb69c154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:32.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.646+0000 7fb6a1400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb69c159a80 0x7fb69c158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:32.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.646+0000 7fb6a1400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c159300 con 0x7fb69c153b20 2024-09-13T16:01:32.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.646+0000 7fb6a1400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c143540 con 0x7fb69c06f660 2024-09-13T16:01:32.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.646+0000 7fb6a1400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c155270 con 0x7fb69c159a80 2024-09-13T16:01:32.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.646+0000 7fb693e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69c153b20 0x7fb69c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:32.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.646+0000 7fb693e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69c153b20 0x7fb69c154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50006/0 (socket says 172.21.15.70:50006) 2024-09-13T16:01:32.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.646+0000 7fb693e00640 1 -- 172.21.15.70:0/219413974 learned_addr learned my addr 172.21.15.70:0/219413974 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:32.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.646+0000 7fb69a800640 1 --2- 172.21.15.70:0/219413974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb69c06f660 0x7fb69c143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:32.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.646+0000 7fb69b200640 1 --2- 172.21.15.70:0/219413974 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb69c159a80 0x7fb69c158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:32.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.646+0000 7fb693e00640 1 -- 172.21.15.70:0/219413974 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb69c159a80 msgr2=0x7fb69c158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:32.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.646+0000 7fb693e00640 1 --2- 172.21.15.70:0/219413974 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb69c159a80 0x7fb69c158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.646+0000 7fb693e00640 1 -- 172.21.15.70:0/219413974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb69c06f660 msgr2=0x7fb69c143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:32.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.646+0000 7fb693e00640 1 --2- 172.21.15.70:0/219413974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb69c06f660 0x7fb69c143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.646+0000 7fb693e00640 1 -- 172.21.15.70:0/219413974 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c009400 con 0x7fb69c153b20 2024-09-13T16:01:32.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.646+0000 7fb69b200640 1 --2- 172.21.15.70:0/219413974 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb69c159a80 0x7fb69c158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:32.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.646+0000 7fb69a800640 1 --2- 172.21.15.70:0/219413974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb69c06f660 0x7fb69c143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:32.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.647+0000 7fb693e00640 1 --2- 172.21.15.70:0/219413974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69c153b20 0x7fb69c154d30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb68400c500 tx=0x7fb68400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:32.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.647+0000 7fb692a00640 1 -- 172.21.15.70:0/219413974 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb684007560 con 0x7fb69c153b20 2024-09-13T16:01:32.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.647+0000 7fb692a00640 1 -- 172.21.15.70:0/219413974 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6840047e0 con 0x7fb69c153b20 2024-09-13T16:01:32.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.647+0000 7fb692a00640 1 -- 172.21.15.70:0/219413974 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb684004b90 con 0x7fb69c153b20 2024-09-13T16:01:32.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.647+0000 7fb6a1400640 1 -- 172.21.15.70:0/219413974 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69c159020 con 0x7fb69c153b20 2024-09-13T16:01:32.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.647+0000 7fb6a1400640 1 -- 172.21.15.70:0/219413974 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69c154530 con 0x7fb69c153b20 2024-09-13T16:01:32.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.648+0000 7fb6a1400640 1 -- 172.21.15.70:0/219413974 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69c1540b0 con 0x7fb69c153b20 2024-09-13T16:01:32.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.649+0000 7fb692a00640 1 -- 172.21.15.70:0/219413974 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb684004cf0 con 0x7fb69c153b20 2024-09-13T16:01:32.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.650+0000 7fb692a00640 1 --2- 172.21.15.70:0/219413974 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb67806ac30 0x7fb67806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:32.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.650+0000 7fb692a00640 1 -- 172.21.15.70:0/219413974 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6840884b0 con 0x7fb69c153b20 2024-09-13T16:01:32.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.650+0000 7fb69a800640 1 --2- 172.21.15.70:0/219413974 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb67806ac30 0x7fb67806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:32.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.651+0000 7fb69a800640 1 --2- 172.21.15.70:0/219413974 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb67806ac30 0x7fb67806d0f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb68c034000 tx=0x7fb68c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:32.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.658+0000 7fb692a00640 1 -- 172.21.15.70:0/219413974 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb69c1540b0 con 0x7fb69c153b20 2024-09-13T16:01:32.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.870+0000 7fb6a1400640 1 -- 172.21.15.70:0/219413974 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb69c1540b0 con 0x7fb69c153b20 2024-09-13T16:01:32.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.871+0000 7fb692a00640 1 -- 172.21.15.70:0/219413974 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4728 (secure 0 0 0) 0x7fb69c1540b0 con 0x7fb69c153b20 2024-09-13T16:01:32.872 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:32.872 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2852595148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2852595148},{"type":"v1","addr":"172.21.15.107:6834","nonce":2852595148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2578992914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2578992914},{"type":"v1","addr":"172.21.15.70:6835","nonce":2578992914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/927553867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":927553867},{"type":"v1","addr":"172.21.15.70:6837","nonce":927553867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:01:18.592735+0000","modified":"2024-09-13T16:01:21.606407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6835/712016246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":712016246},{"type":"v1","addr":"172.21.15.107:6835","nonce":712016246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:01:32.872 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2024-09-13T16:01:32.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.873+0000 7fb6a1400640 1 -- 172.21.15.70:0/219413974 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb67806ac30 msgr2=0x7fb67806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:32.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.873+0000 7fb6a1400640 1 --2- 172.21.15.70:0/219413974 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb67806ac30 0x7fb67806d0f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb68c034000 tx=0x7fb68c02e000 comp rx=0 tx=0).stop 2024-09-13T16:01:32.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.873+0000 7fb6a1400640 1 -- 172.21.15.70:0/219413974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69c153b20 msgr2=0x7fb69c154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:32.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.873+0000 7fb6a1400640 1 --2- 172.21.15.70:0/219413974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69c153b20 0x7fb69c154d30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb68400c500 tx=0x7fb68400c9c0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.873+0000 7fb6a1400640 1 -- 172.21.15.70:0/219413974 shutdown_connections 2024-09-13T16:01:32.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.873+0000 7fb6a1400640 1 --2- 172.21.15.70:0/219413974 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb69c159a80 0x7fb69c158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.873+0000 7fb6a1400640 1 --2- 172.21.15.70:0/219413974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69c153b20 0x7fb69c154d30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.873+0000 7fb6a1400640 1 --2- 172.21.15.70:0/219413974 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb67806ac30 0x7fb67806d0f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.873+0000 7fb6a1400640 1 --2- 172.21.15.70:0/219413974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb69c06f660 0x7fb69c143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.873+0000 7fb6a1400640 1 -- 172.21.15.70:0/219413974 >> 172.21.15.70:0/219413974 conn(0x7fb69c0b0510 msgr2=0x7fb69c0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:32.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.873+0000 7fb6a1400640 1 -- 172.21.15.70:0/219413974 shutdown_connections 2024-09-13T16:01:32.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:32.873+0000 7fb6a1400640 1 -- 172.21.15.70:0/219413974 wait complete. 2024-09-13T16:01:33.292 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T16:01:18.592735+0000', 'modified': '2024-09-13T16:01:21.606407+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.107:6835/712016246', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6833', 'nonce': 712016246}, {'type': 'v1', 'addr': '172.21.15.107:6835', 'nonce': 712016246}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T16:01:33.292 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T16:01:33.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T16:01:33.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.448+0000 7f5e6ee00640 1 Processor -- start 2024-09-13T16:01:33.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.449+0000 7f5e6ee00640 1 -- start start 2024-09-13T16:01:33.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.450+0000 7f5e6ee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e680cbd60 0x7f5e68069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.450+0000 7f5e6ee00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6806a860 con 0x7f5e6806a410 2024-09-13T16:01:33.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.450+0000 7f5e6ee00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e680ac870 con 0x7f5e681453d0 2024-09-13T16:01:33.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.450+0000 7f5e6ee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680b1d20 con 0x7f5e680cbd60 2024-09-13T16:01:33.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.450+0000 7f5e6e400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5e6806a410 0x7f5e680acfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:37202/0 (socket says 172.21.15.70:37202) 2024-09-13T16:01:33.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.450+0000 7f5e6e400640 1 -- 172.21.15.70:0/3167905865 learned_addr learned my addr 172.21.15.70:0/3167905865 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:33.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.450+0000 7f5e6d000640 1 --2- 172.21.15.70:0/3167905865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e680cbd60 0x7f5e68069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.450+0000 7f5e67e00640 1 -- 172.21.15.70:0/3167905865 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2322836994 0 0) 0x7f5e60001490 con 0x7f5e6806a410 2024-09-13T16:01:33.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.450+0000 7f5e67e00640 1 -- 172.21.15.70:0/3167905865 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e50003520 con 0x7f5e6806a410 2024-09-13T16:01:33.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.451+0000 7f5e6d000640 1 -- 172.21.15.70:0/3167905865 >> v1:172.21.15.107:6789/0 conn(0x7f5e681453d0 legacy=0x7f5e680b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:33.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.451+0000 7f5e6d000640 1 -- 172.21.15.70:0/3167905865 >> v1:172.21.15.70:6789/0 conn(0x7f5e6806a410 legacy=0x7f5e680acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:33.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.451+0000 7f5e6d000640 1 -- 172.21.15.70:0/3167905865 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e680b2000 con 0x7f5e680cbd60 2024-09-13T16:01:33.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.452+0000 7f5e6d000640 1 --2- 172.21.15.70:0/3167905865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e680cbd60 0x7f5e68069ed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5e540097d0 tx=0x7f5e5402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9c8db573c509dad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:33.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.452+0000 7f5e67e00640 1 -- 172.21.15.70:0/3167905865 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54032440 con 0x7f5e680cbd60 2024-09-13T16:01:33.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.452+0000 7f5e67e00640 1 -- 172.21.15.70:0/3167905865 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e540325a0 con 0x7f5e680cbd60 2024-09-13T16:01:33.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.452+0000 7f5e67e00640 1 -- 172.21.15.70:0/3167905865 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54032930 con 0x7f5e680cbd60 2024-09-13T16:01:33.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.452+0000 7f5e6ee00640 1 -- 172.21.15.70:0/3167905865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e680cbd60 msgr2=0x7f5e68069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:33.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.452+0000 7f5e6ee00640 1 --2- 172.21.15.70:0/3167905865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e680cbd60 0x7f5e68069ed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5e540097d0 tx=0x7f5e5402a180 comp rx=0 tx=0).stop 2024-09-13T16:01:33.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.453+0000 7f5e6ee00640 1 -- 172.21.15.70:0/3167905865 shutdown_connections 2024-09-13T16:01:33.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.453+0000 7f5e6ee00640 1 --2- 172.21.15.70:0/3167905865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e680cbd60 0x7f5e68069ed0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.453+0000 7f5e6ee00640 1 -- 172.21.15.70:0/3167905865 >> 172.21.15.70:0/3167905865 conn(0x7f5e680affd0 msgr2=0x7f5e680b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:33.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.453+0000 7f5e6ee00640 1 -- 172.21.15.70:0/3167905865 shutdown_connections 2024-09-13T16:01:33.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.453+0000 7f5e6ee00640 1 -- 172.21.15.70:0/3167905865 wait complete. 2024-09-13T16:01:33.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.454+0000 7f5e6ee00640 1 Processor -- start 2024-09-13T16:01:33.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.454+0000 7f5e6ee00640 1 -- start start 2024-09-13T16:01:33.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.455+0000 7f5e6ee00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e6806a410 0x7f5e68152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.455+0000 7f5e6ee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e680cbd60 0x7f5e68071790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.455+0000 7f5e6ee00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e681453d0 0x7f5e680ae470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.455+0000 7f5e6ee00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e68071300 con 0x7f5e681453d0 2024-09-13T16:01:33.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.455+0000 7f5e6ee00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680706f0 con 0x7f5e6806a410 2024-09-13T16:01:33.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.455+0000 7f5e6ee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680709d0 con 0x7f5e680cbd60 2024-09-13T16:01:33.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.456+0000 7f5e6e400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e681453d0 0x7f5e680ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.456+0000 7f5e6e400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e681453d0 0x7f5e680ae470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50008/0 (socket says 172.21.15.70:50008) 2024-09-13T16:01:33.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.456+0000 7f5e6e400640 1 -- 172.21.15.70:0/1063437962 learned_addr learned my addr 172.21.15.70:0/1063437962 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:33.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.456+0000 7f5e6d000640 1 --2- 172.21.15.70:0/1063437962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e680cbd60 0x7f5e68071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.456+0000 7f5e6da00640 1 --2- 172.21.15.70:0/1063437962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e6806a410 0x7f5e68152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.456+0000 7f5e6e400640 1 -- 172.21.15.70:0/1063437962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e680cbd60 msgr2=0x7f5e68071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:33.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.456+0000 7f5e6e400640 1 --2- 172.21.15.70:0/1063437962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e680cbd60 0x7f5e68071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.456+0000 7f5e6e400640 1 -- 172.21.15.70:0/1063437962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e6806a410 msgr2=0x7f5e68152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:33.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.456+0000 7f5e6e400640 1 --2- 172.21.15.70:0/1063437962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e6806a410 0x7f5e68152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.456+0000 7f5e6e400640 1 -- 172.21.15.70:0/1063437962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54009400 con 0x7f5e681453d0 2024-09-13T16:01:33.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.456+0000 7f5e6da00640 1 --2- 172.21.15.70:0/1063437962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e6806a410 0x7f5e68152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:33.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.457+0000 7f5e6e400640 1 --2- 172.21.15.70:0/1063437962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e681453d0 0x7f5e680ae470 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000cb40 tx=0x7f5e6000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:33.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.457+0000 7f5e65600640 1 -- 172.21.15.70:0/1063437962 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000aca0 con 0x7f5e681453d0 2024-09-13T16:01:33.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.457+0000 7f5e65600640 1 -- 172.21.15.70:0/1063437962 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6000ae00 con 0x7f5e681453d0 2024-09-13T16:01:33.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.457+0000 7f5e6ee00640 1 -- 172.21.15.70:0/1063437962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e68070cb0 con 0x7f5e681453d0 2024-09-13T16:01:33.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.457+0000 7f5e65600640 1 -- 172.21.15.70:0/1063437962 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60012620 con 0x7f5e681453d0 2024-09-13T16:01:33.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.457+0000 7f5e6ee00640 1 -- 172.21.15.70:0/1063437962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e68153210 con 0x7f5e681453d0 2024-09-13T16:01:33.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.459+0000 7f5e65600640 1 -- 172.21.15.70:0/1063437962 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5e60007070 con 0x7f5e681453d0 2024-09-13T16:01:33.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.460+0000 7f5e65600640 1 --2- 172.21.15.70:0/1063437962 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5e4806ac00 0x7f5e4806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.460+0000 7f5e65600640 1 -- 172.21.15.70:0/1063437962 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e60089210 con 0x7f5e681453d0 2024-09-13T16:01:33.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.461+0000 7f5e6da00640 1 --2- 172.21.15.70:0/1063437962 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5e4806ac00 0x7f5e4806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.461+0000 7f5e731c9740 1 Processor -- start 2024-09-13T16:01:33.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.461+0000 7f5e731c9740 1 -- start start 2024-09-13T16:01:33.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.461+0000 7f5e6da00640 1 --2- 172.21.15.70:0/1063437962 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5e4806ac00 0x7f5e4806d0c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c007fd0 tx=0x7f5e5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:33.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.462+0000 7f5e731c9740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c737a840 0x55d3c737ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.462+0000 7f5e731c9740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c7378000 0x55d3c73c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.462+0000 7f5e731c9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 0x55d3c73c8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.462+0000 7f5e731c9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3c72e3ab0 con 0x55d3c73a1cf0 2024-09-13T16:01:33.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.462+0000 7f5e731c9740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3c72e1240 con 0x55d3c7378000 2024-09-13T16:01:33.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.462+0000 7f5e731c9740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d3c72dcb30 con 0x55d3c737a840 2024-09-13T16:01:33.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.462+0000 7f5e6e400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 0x55d3c73c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.462+0000 7f5e6e400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 0x55d3c73c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50016/0 (socket says 172.21.15.70:50016) 2024-09-13T16:01:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.462+0000 7f5e6e400640 1 -- 172.21.15.70:0/1025422243 learned_addr learned my addr 172.21.15.70:0/1025422243 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.462+0000 7f5e6da00640 1 --2- 172.21.15.70:0/1025422243 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c737a840 0x55d3c737ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.462+0000 7f5e6d000640 1 --2- 172.21.15.70:0/1025422243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c7378000 0x55d3c73c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.463+0000 7f5e6e400640 1 -- 172.21.15.70:0/1025422243 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c737a840 msgr2=0x55d3c737ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.463+0000 7f5e6e400640 1 --2- 172.21.15.70:0/1025422243 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c737a840 0x55d3c737ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.463+0000 7f5e6e400640 1 -- 172.21.15.70:0/1025422243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c7378000 msgr2=0x55d3c73c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.463+0000 7f5e6e400640 1 --2- 172.21.15.70:0/1025422243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c7378000 0x55d3c73c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.463+0000 7f5e6e400640 1 -- 172.21.15.70:0/1025422243 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3c72a7bd0 con 0x55d3c73a1cf0 2024-09-13T16:01:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.463+0000 7f5e6e400640 1 --2- 172.21.15.70:0/1025422243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 0x55d3c73c8250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5e60058050 tx=0x7f5e600580c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28d9c1713d1a7fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.463+0000 7f5e5a000640 1 -- 172.21.15.70:0/1025422243 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60060400 con 0x55d3c73a1cf0 2024-09-13T16:01:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.463+0000 7f5e5a000640 1 -- 172.21.15.70:0/1025422243 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6005e070 con 0x55d3c73a1cf0 2024-09-13T16:01:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.463+0000 7f5e5a000640 1 -- 172.21.15.70:0/1025422243 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e600547d0 con 0x55d3c73a1cf0 2024-09-13T16:01:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.464+0000 7f5e731c9740 1 -- 172.21.15.70:0/1025422243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 msgr2=0x55d3c73c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.464+0000 7f5e731c9740 1 --2- 172.21.15.70:0/1025422243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 0x55d3c73c8250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5e60058050 tx=0x7f5e600580c0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.464+0000 7f5e731c9740 1 -- 172.21.15.70:0/1025422243 shutdown_connections 2024-09-13T16:01:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.464+0000 7f5e731c9740 1 --2- 172.21.15.70:0/1025422243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 0x55d3c73c8250 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.464+0000 7f5e731c9740 1 --2- 172.21.15.70:0/1025422243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c7378000 0x55d3c73c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.464+0000 7f5e731c9740 1 --2- 172.21.15.70:0/1025422243 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c737a840 0x55d3c737ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.464+0000 7f5e731c9740 1 -- 172.21.15.70:0/1025422243 >> 172.21.15.70:0/1025422243 conn(0x55d3c7376f70 msgr2=0x55d3c73bf420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.464+0000 7f5e731c9740 1 -- 172.21.15.70:0/1025422243 shutdown_connections 2024-09-13T16:01:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.464+0000 7f5e731c9740 1 -- 172.21.15.70:0/1025422243 wait complete. 2024-09-13T16:01:33.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.465+0000 7f5e731c9740 1 -- start start 2024-09-13T16:01:33.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.465+0000 7f5e731c9740 1 Processor -- start 2024-09-13T16:01:33.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.466+0000 7f5e731c9740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c737a840 0x55d3c738c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.466+0000 7f5e731c9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 0x55d3c73a3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.466+0000 7f5e731c9740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c73a3b80 0x55d3c73bc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.466+0000 7f5e731c9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3c727e260 con 0x55d3c73a1cf0 2024-09-13T16:01:33.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.466+0000 7f5e731c9740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3c727df00 con 0x55d3c73a3b80 2024-09-13T16:01:33.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.466+0000 7f5e731c9740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d3c7043f20 con 0x55d3c737a840 2024-09-13T16:01:33.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.466+0000 7f5e731c9740 10 client.0 _ll_register_callbacks cb 0x55d3c72d61a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:01:33.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.466+0000 7f5e6d000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 0x55d3c73a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.466+0000 7f5e6d000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 0x55d3c73a3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50022/0 (socket says 172.21.15.70:50022) 2024-09-13T16:01:33.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.466+0000 7f5e6d000640 1 -- 172.21.15.70:0/3810359107 learned_addr learned my addr 172.21.15.70:0/3810359107 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:33.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.466+0000 7f5e6da00640 1 --2- 172.21.15.70:0/3810359107 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c737a840 0x55d3c738c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.466+0000 7f5e6e400640 1 --2- 172.21.15.70:0/3810359107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c73a3b80 0x55d3c73bc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.466+0000 7f5e6d000640 1 -- 172.21.15.70:0/3810359107 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c737a840 msgr2=0x55d3c738c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:33.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.466+0000 7f5e6d000640 1 --2- 172.21.15.70:0/3810359107 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c737a840 0x55d3c738c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.466+0000 7f5e6d000640 1 -- 172.21.15.70:0/3810359107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c73a3b80 msgr2=0x55d3c73bc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:33.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.466+0000 7f5e6d000640 1 --2- 172.21.15.70:0/3810359107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c73a3b80 0x55d3c73bc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.466+0000 7f5e6d000640 1 -- 172.21.15.70:0/3810359107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e68153210 con 0x55d3c73a1cf0 2024-09-13T16:01:33.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.467+0000 7f5e6d000640 1 --2- 172.21.15.70:0/3810359107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 0x55d3c73a3640 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5e540097d0 tx=0x7f5e54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f959bd16ffc0394 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:33.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.467+0000 7f5e4ea00640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-13T16:01:33.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.467+0000 7f5e4ea00640 1 -- 172.21.15.70:0/3810359107 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5403c850 con 0x55d3c73a1cf0 2024-09-13T16:01:33.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.467+0000 7f5e731c9740 1 -- 172.21.15.70:0/3810359107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d3c7306cd0 con 0x55d3c73a1cf0 2024-09-13T16:01:33.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.467+0000 7f5e4ea00640 1 -- 172.21.15.70:0/3810359107 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e54042070 con 0x55d3c73a1cf0 2024-09-13T16:01:33.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.467+0000 7f5e4ea00640 1 -- 172.21.15.70:0/3810359107 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e54006e10 con 0x55d3c73a1cf0 2024-09-13T16:01:33.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.467+0000 7f5e731c9740 10 client.4668 fetch_fsmap learned FSMap version 8 2024-09-13T16:01:33.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.467+0000 7f5e731c9740 1 -- 172.21.15.70:0/3810359107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55d3c72db1b0 con 0x55d3c73a1cf0 2024-09-13T16:01:33.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.467+0000 7f5e4ea00640 1 -- 172.21.15.70:0/3810359107 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d3c7306cd0 con 0x55d3c73a1cf0 2024-09-13T16:01:33.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.468+0000 7f5e4ea00640 1 -- 172.21.15.70:0/3810359107 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5e5403c9b0 con 0x55d3c73a1cf0 2024-09-13T16:01:33.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.468+0000 7f5e731c9740 10 client.4668 fetch_fsmap finished waiting for FSMap version 8 2024-09-13T16:01:33.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.468+0000 7f5e731c9740 10 client.4668 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T16:01:33.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.468+0000 7f5e731c9740 20 client.4668 populate_metadata read hostname 'smithi070' 2024-09-13T16:01:33.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.468+0000 7f5e731c9740 1 --2- 172.21.15.70:0/3810359107 >> [v2:172.21.15.107:6833/712016246,v1:172.21.15.107:6835/712016246] conn(0x55d3c738e930 0x55d3c738f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.468+0000 7f5e731c9740 4 client.4668 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:01:33.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.468+0000 7f5e731c9740 1 -- 172.21.15.70:0/3810359107 --> [v2:172.21.15.107:6833/712016246,v1:172.21.15.107:6835/712016246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d3c6fd03c0 con 0x55d3c738e930 2024-09-13T16:01:33.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.468+0000 7f5e6da00640 1 --2- 172.21.15.70:0/3810359107 >> [v2:172.21.15.107:6833/712016246,v1:172.21.15.107:6835/712016246] conn(0x55d3c738e930 0x55d3c738f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.469+0000 7f5e4ea00640 10 client.4668 ms_handle_connect on v2:172.21.15.107:6833/712016246 2024-09-13T16:01:33.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.469+0000 7f5e6da00640 1 --2- 172.21.15.70:0/3810359107 >> [v2:172.21.15.107:6833/712016246,v1:172.21.15.107:6835/712016246] conn(0x55d3c738e930 0x55d3c738f690 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d2a01b44d05316d server_cookie=5b51096ddd416810 in_seq=0 out_seq=0 2024-09-13T16:01:33.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.470+0000 7f5e4ea00640 1 -- 172.21.15.70:0/3810359107 <== mds.0 v2:172.21.15.107:6833/712016246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d3c6fd03c0 con 0x55d3c738e930 2024-09-13T16:01:33.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.470+0000 7f5e4ea00640 10 client.4668 handle_command_reply: tid=0 2024-09-13T16:01:33.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.470+0000 7f5e731c9740 1 client.4668 shutdown 2024-09-13T16:01:33.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.470+0000 7f5e731c9740 1 -- 172.21.15.70:0/3810359107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 msgr2=0x55d3c73a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:33.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.470+0000 7f5e731c9740 1 --2- 172.21.15.70:0/3810359107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 0x55d3c73a3640 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5e540097d0 tx=0x7f5e54004730 comp rx=0 tx=0).stop 2024-09-13T16:01:33.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.470+0000 7f5e731c9740 1 -- 172.21.15.70:0/3810359107 shutdown_connections 2024-09-13T16:01:33.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.470+0000 7f5e731c9740 1 --2- 172.21.15.70:0/3810359107 >> [v2:172.21.15.107:6833/712016246,v1:172.21.15.107:6835/712016246] conn(0x55d3c738e930 0x55d3c738f690 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.470+0000 7f5e731c9740 1 --2- 172.21.15.70:0/3810359107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c73a3b80 0x55d3c73bc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.470+0000 7f5e731c9740 1 --2- 172.21.15.70:0/3810359107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 0x55d3c73a3640 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.470+0000 7f5e731c9740 1 --2- 172.21.15.70:0/3810359107 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c737a840 0x55d3c738c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.470+0000 7f5e731c9740 1 -- 172.21.15.70:0/3810359107 >> 172.21.15.70:0/3810359107 conn(0x55d3c7378000 msgr2=0x55d3c73bd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:33.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.470+0000 7f5e4ea00640 0 client.4668 ms_handle_reset on v2:172.21.15.107:6833/712016246 2024-09-13T16:01:33.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.470+0000 7f5e731c9740 1 -- 172.21.15.70:0/3810359107 shutdown_connections 2024-09-13T16:01:33.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.470+0000 7f5e731c9740 1 -- 172.21.15.70:0/3810359107 wait complete. 2024-09-13T16:01:33.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.470+0000 7f5e731c9740 20 client.4668 trim_cache size 0 max 16384 2024-09-13T16:01:33.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.485+0000 7f5e731c9740 1 Processor -- start 2024-09-13T16:01:33.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.485+0000 7f5e731c9740 1 -- start start 2024-09-13T16:01:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.486+0000 7f5e731c9740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c737a840 0x55d3c7375e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.486+0000 7f5e731c9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 0x55d3c7376380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.486+0000 7f5e731c9740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c73a3b80 0x55d3c738b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.486+0000 7f5e731c9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3c72a32f0 con 0x55d3c73a1cf0 2024-09-13T16:01:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.486+0000 7f5e731c9740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3c73c1800 con 0x55d3c737a840 2024-09-13T16:01:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.486+0000 7f5e731c9740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d3c738d6a0 con 0x55d3c73a3b80 2024-09-13T16:01:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.487+0000 7f5e6d000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 0x55d3c7376380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.487+0000 7f5e6d000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 0x55d3c7376380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50026/0 (socket says 172.21.15.70:50026) 2024-09-13T16:01:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.487+0000 7f5e6d000640 1 -- 172.21.15.70:0/3556770269 learned_addr learned my addr 172.21.15.70:0/3556770269 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.487+0000 7f5e6da00640 1 --2- 172.21.15.70:0/3556770269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c737a840 0x55d3c7375e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.487+0000 7f5e6e400640 1 --2- 172.21.15.70:0/3556770269 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c73a3b80 0x55d3c738b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.487+0000 7f5e6d000640 1 -- 172.21.15.70:0/3556770269 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c73a3b80 msgr2=0x55d3c738b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.487+0000 7f5e6d000640 1 --2- 172.21.15.70:0/3556770269 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c73a3b80 0x55d3c738b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.487+0000 7f5e6d000640 1 -- 172.21.15.70:0/3556770269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c737a840 msgr2=0x55d3c7375e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.487+0000 7f5e6d000640 1 --2- 172.21.15.70:0/3556770269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c737a840 0x55d3c7375e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.487+0000 7f5e6d000640 1 -- 172.21.15.70:0/3556770269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3c727d470 con 0x55d3c73a1cf0 2024-09-13T16:01:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.487+0000 7f5e6d000640 1 --2- 172.21.15.70:0/3556770269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 0x55d3c7376380 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5e54047bc0 tx=0x7f5e5403e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e61cca754014cec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.487+0000 7f5e5aa00640 1 -- 172.21.15.70:0/3556770269 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54006e10 con 0x55d3c73a1cf0 2024-09-13T16:01:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.487+0000 7f5e5aa00640 1 -- 172.21.15.70:0/3556770269 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e54040070 con 0x55d3c73a1cf0 2024-09-13T16:01:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.487+0000 7f5e5aa00640 1 -- 172.21.15.70:0/3556770269 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54032db0 con 0x55d3c73a1cf0 2024-09-13T16:01:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.488+0000 7f5e731c9740 1 -- 172.21.15.70:0/3556770269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 msgr2=0x55d3c7376380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.488+0000 7f5e731c9740 1 --2- 172.21.15.70:0/3556770269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 0x55d3c7376380 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5e54047bc0 tx=0x7f5e5403e070 comp rx=0 tx=0).stop 2024-09-13T16:01:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.488+0000 7f5e731c9740 1 -- 172.21.15.70:0/3556770269 shutdown_connections 2024-09-13T16:01:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.488+0000 7f5e731c9740 1 --2- 172.21.15.70:0/3556770269 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c73a3b80 0x55d3c738b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.488+0000 7f5e731c9740 1 --2- 172.21.15.70:0/3556770269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c73a1cf0 0x55d3c7376380 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.488+0000 7f5e731c9740 1 --2- 172.21.15.70:0/3556770269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c737a840 0x55d3c7375e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.488+0000 7f5e731c9740 1 -- 172.21.15.70:0/3556770269 >> 172.21.15.70:0/3556770269 conn(0x55d3c7378000 msgr2=0x55d3c7370550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:33.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.488+0000 7f5e731c9740 1 -- 172.21.15.70:0/3556770269 shutdown_connections 2024-09-13T16:01:33.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.488+0000 7f5e731c9740 1 -- 172.21.15.70:0/3556770269 wait complete. 2024-09-13T16:01:33.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.489+0000 7f5e731c9740 1 -- start start 2024-09-13T16:01:33.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.489+0000 7f5e731c9740 1 Processor -- start 2024-09-13T16:01:33.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.490+0000 7f5e731c9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c737a840 0x55d3c73a3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.490+0000 7f5e731c9740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c73a1cf0 0x55d3c7375e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.490+0000 7f5e731c9740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c73a3b80 0x55d3c7376380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.490+0000 7f5e731c9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3c73c07b0 con 0x55d3c737a840 2024-09-13T16:01:33.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.490+0000 7f5e731c9740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3c73baf10 con 0x55d3c73a1cf0 2024-09-13T16:01:33.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.490+0000 7f5e731c9740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d3c73a27e0 con 0x55d3c73a3b80 2024-09-13T16:01:33.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.490+0000 7f5e731c9740 10 client.0 _ll_register_callbacks cb 0x7f5e500036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:01:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.490+0000 7f5e6da00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c737a840 0x55d3c73a3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.490+0000 7f5e6da00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c737a840 0x55d3c73a3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50028/0 (socket says 172.21.15.70:50028) 2024-09-13T16:01:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.490+0000 7f5e6da00640 1 -- 172.21.15.70:0/2274268332 learned_addr learned my addr 172.21.15.70:0/2274268332 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.490+0000 7f5e6d000640 1 --2- 172.21.15.70:0/2274268332 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c73a1cf0 0x55d3c7375e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.490+0000 7f5e6e400640 1 --2- 172.21.15.70:0/2274268332 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c73a3b80 0x55d3c7376380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.491+0000 7f5e6da00640 1 -- 172.21.15.70:0/2274268332 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c73a3b80 msgr2=0x55d3c7376380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.491+0000 7f5e6da00640 1 --2- 172.21.15.70:0/2274268332 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c73a3b80 0x55d3c7376380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.491+0000 7f5e6da00640 1 -- 172.21.15.70:0/2274268332 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c73a1cf0 msgr2=0x55d3c7375e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.491+0000 7f5e6da00640 1 --2- 172.21.15.70:0/2274268332 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c73a1cf0 0x55d3c7375e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.491+0000 7f5e6da00640 1 -- 172.21.15.70:0/2274268332 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d3c72db1b0 con 0x55d3c737a840 2024-09-13T16:01:33.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.491+0000 7f5e6d000640 1 --2- 172.21.15.70:0/2274268332 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c73a1cf0 0x55d3c7375e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:33.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.491+0000 7f5e6e400640 1 --2- 172.21.15.70:0/2274268332 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c73a3b80 0x55d3c7376380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:33.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.491+0000 7f5e6da00640 1 --2- 172.21.15.70:0/2274268332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c737a840 0x55d3c73a3040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c005210 tx=0x7f5e5c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7311c97960b670 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:33.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.491+0000 7f5e4ea00640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-13T16:01:33.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.491+0000 7f5e4ea00640 1 -- 172.21.15.70:0/2274268332 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c025920 con 0x55d3c737a840 2024-09-13T16:01:33.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.491+0000 7f5e4ea00640 1 -- 172.21.15.70:0/2274268332 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e5c00ec30 con 0x55d3c737a840 2024-09-13T16:01:33.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.491+0000 7f5e731c9740 1 -- 172.21.15.70:0/2274268332 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e6005e070 con 0x55d3c737a840 2024-09-13T16:01:33.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.492+0000 7f5e4ea00640 1 -- 172.21.15.70:0/2274268332 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e5c00edf0 con 0x55d3c737a840 2024-09-13T16:01:33.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.492+0000 7f5e731c9740 10 client.4674 fetch_fsmap learned FSMap version 8 2024-09-13T16:01:33.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.492+0000 7f5e731c9740 1 -- 172.21.15.70:0/2274268332 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55d3c72a2980 con 0x55d3c737a840 2024-09-13T16:01:33.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.492+0000 7f5e4ea00640 1 -- 172.21.15.70:0/2274268332 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6005e070 con 0x55d3c737a840 2024-09-13T16:01:33.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.492+0000 7f5e4ea00640 1 -- 172.21.15.70:0/2274268332 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5e5c0035f0 con 0x55d3c737a840 2024-09-13T16:01:33.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.492+0000 7f5e731c9740 10 client.4674 fetch_fsmap finished waiting for FSMap version 8 2024-09-13T16:01:33.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.492+0000 7f5e731c9740 10 client.4674 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T16:01:33.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.492+0000 7f5e731c9740 20 client.4674 populate_metadata read hostname 'smithi070' 2024-09-13T16:01:33.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.492+0000 7f5e731c9740 1 --2- 172.21.15.70:0/2274268332 >> [v2:172.21.15.107:6833/712016246,v1:172.21.15.107:6835/712016246] conn(0x55d3c73bb360 0x55d3c73bb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:33.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.492+0000 7f5e731c9740 4 client.4674 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T16:01:33.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.492+0000 7f5e731c9740 1 -- 172.21.15.70:0/2274268332 --> [v2:172.21.15.107:6833/712016246,v1:172.21.15.107:6835/712016246] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d3c6fe16c0 con 0x55d3c73bb360 2024-09-13T16:01:33.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.492+0000 7f5e6d000640 1 --2- 172.21.15.70:0/2274268332 >> [v2:172.21.15.107:6833/712016246,v1:172.21.15.107:6835/712016246] conn(0x55d3c73bb360 0x55d3c73bb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:33.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.493+0000 7f5e6d000640 1 --2- 172.21.15.70:0/2274268332 >> [v2:172.21.15.107:6833/712016246,v1:172.21.15.107:6835/712016246] conn(0x55d3c73bb360 0x55d3c73bb740 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=276163a838267241 server_cookie=1e18102f033d1b1b in_seq=0 out_seq=0 2024-09-13T16:01:33.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.493+0000 7f5e4ea00640 10 client.4674 ms_handle_connect on v2:172.21.15.107:6833/712016246 2024-09-13T16:01:33.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.493+0000 7f5e4ea00640 1 -- 172.21.15.70:0/2274268332 <== mds.0 v2:172.21.15.107:6833/712016246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55d3c6fe16c0 con 0x55d3c73bb360 2024-09-13T16:01:33.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.493+0000 7f5e4ea00640 10 client.4674 handle_command_reply: tid=0 2024-09-13T16:01:33.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.493+0000 7f5e731c9740 1 client.4674 shutdown 2024-09-13T16:01:33.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.493+0000 7f5e731c9740 1 -- 172.21.15.70:0/2274268332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c737a840 msgr2=0x55d3c73a3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:33.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.493+0000 7f5e731c9740 1 --2- 172.21.15.70:0/2274268332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c737a840 0x55d3c73a3040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c005210 tx=0x7f5e5c000ed0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.493+0000 7f5e731c9740 1 -- 172.21.15.70:0/2274268332 shutdown_connections 2024-09-13T16:01:33.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.493+0000 7f5e731c9740 1 --2- 172.21.15.70:0/2274268332 >> [v2:172.21.15.107:6833/712016246,v1:172.21.15.107:6835/712016246] conn(0x55d3c73bb360 0x55d3c73bb740 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.494+0000 7f5e731c9740 1 --2- 172.21.15.70:0/2274268332 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d3c73a3b80 0x55d3c7376380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.494+0000 7f5e731c9740 1 --2- 172.21.15.70:0/2274268332 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d3c73a1cf0 0x55d3c7375e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.494+0000 7f5e731c9740 1 --2- 172.21.15.70:0/2274268332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c737a840 0x55d3c73a3040 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.494+0000 7f5e731c9740 1 -- 172.21.15.70:0/2274268332 >> 172.21.15.70:0/2274268332 conn(0x55d3c7378000 msgr2=0x55d3c738e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:33.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.494+0000 7f5e4ea00640 0 client.4674 ms_handle_reset on v2:172.21.15.107:6833/712016246 2024-09-13T16:01:33.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.494+0000 7f5e731c9740 1 -- 172.21.15.70:0/2274268332 shutdown_connections 2024-09-13T16:01:33.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.494+0000 7f5e731c9740 1 -- 172.21.15.70:0/2274268332 wait complete. 2024-09-13T16:01:33.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.494+0000 7f5e731c9740 20 client.4674 trim_cache size 0 max 16384 2024-09-13T16:01:33.500 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-13T16:01:33.500 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "f906ab4b-6171-41ec-a825-cd0f700d3930", 2024-09-13T16:01:33.500 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-09-13T16:01:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 4281, 2024-09-13T16:01:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-13T16:01:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-13T16:01:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-13T16:01:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 14.898270961, 2024-09-13T16:01:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 8, 2024-09-13T16:01:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 20, 2024-09-13T16:01:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 20, 2024-09-13T16:01:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 21.443282208999999 2024-09-13T16:01:33.501 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-13T16:01:33.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.494+0000 7f5e6ee00640 1 -- 172.21.15.70:0/1063437962 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5e4806ac00 msgr2=0x7f5e4806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:33.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.494+0000 7f5e6ee00640 1 --2- 172.21.15.70:0/1063437962 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5e4806ac00 0x7f5e4806d0c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c007fd0 tx=0x7f5e5c009040 comp rx=0 tx=0).stop 2024-09-13T16:01:33.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.494+0000 7f5e6ee00640 1 -- 172.21.15.70:0/1063437962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e681453d0 msgr2=0x7f5e680ae470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:33.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.494+0000 7f5e6ee00640 1 --2- 172.21.15.70:0/1063437962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e681453d0 0x7f5e680ae470 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000cb40 tx=0x7f5e6000a060 comp rx=0 tx=0).stop 2024-09-13T16:01:33.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.494+0000 7f5e6ee00640 1 -- 172.21.15.70:0/1063437962 shutdown_connections 2024-09-13T16:01:33.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.494+0000 7f5e6ee00640 1 --2- 172.21.15.70:0/1063437962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e681453d0 0x7f5e680ae470 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.494+0000 7f5e6ee00640 1 --2- 172.21.15.70:0/1063437962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e680cbd60 0x7f5e68071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.494+0000 7f5e6ee00640 1 --2- 172.21.15.70:0/1063437962 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5e4806ac00 0x7f5e4806d0c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.495+0000 7f5e6ee00640 1 --2- 172.21.15.70:0/1063437962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e6806a410 0x7f5e68152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:33.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.495+0000 7f5e6ee00640 1 -- 172.21.15.70:0/1063437962 >> 172.21.15.70:0/1063437962 conn(0x7f5e680affd0 msgr2=0x7f5e680ceb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:33.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.495+0000 7f5e6ee00640 1 -- 172.21.15.70:0/1063437962 shutdown_connections 2024-09-13T16:01:33.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:33.495+0000 7f5e6ee00640 1 -- 172.21.15.70:0/1063437962 wait complete. 2024-09-13T16:01:33.510 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T16:01:33.519 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T16:01:33.519 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T16:01:33.520 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T16:01:33.520 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T16:01:33.556 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T16:01:33.557 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-13T16:01:33.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:33.557 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-13T16:01:33.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:33.593 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2024-09-13T16:01:33.694 INFO:teuthology.orchestra.run.smithi070.stderr:Cannot find device "ceph-brx" 2024-09-13T16:01:33.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:01:33.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:33.697 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-13T16:01:33.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:33.732 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2024-09-13T16:01:33.831 INFO:teuthology.orchestra.run.smithi070.stderr:Cannot find device "ceph-brx" 2024-09-13T16:01:33.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:01:33.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:33.834 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-09-13T16:01:33.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:33.875 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-09-13T16:01:33.978 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-09-13T16:01:33.981 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:01:33.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:33.982 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-09-13T16:01:34.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:34.018 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-09-13T16:01:34.118 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-09-13T16:01:34.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:01:34.121 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-13T16:01:34.121 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T16:01:34.121 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T16:01:34.121 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T16:01:34.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.274+0000 7f44e1400640 1 Processor -- start 2024-09-13T16:01:34.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.274+0000 7f44e1400640 1 -- start start 2024-09-13T16:01:34.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.275+0000 7f44e1400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44dc15a520 0x7f44dc06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:34.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.275+0000 7f44e1400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f44dc0b1b00 0x7f44dc0cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:34.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.275+0000 7f44e1400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44dc06bc00 con 0x7f44dc0cde50 2024-09-13T16:01:34.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.275+0000 7f44e1400640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44dc06bea0 con 0x7f44dc0b1b00 2024-09-13T16:01:34.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.275+0000 7f44e1400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc06c180 con 0x7f44dc15a520 2024-09-13T16:01:34.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.275+0000 7f44d9e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f44dc0b1b00 0x7f44dc0cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:34.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.276+0000 7f44d9e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f44dc0b1b00 0x7f44dc0cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50040/0 (socket says 172.21.15.70:50040) 2024-09-13T16:01:34.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.276+0000 7f44d9e00640 1 -- 172.21.15.70:0/1149099905 learned_addr learned my addr 172.21.15.70:0/1149099905 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:34.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.276+0000 7f44da800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44dc15a520 0x7f44dc06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:34.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.276+0000 7f44db200640 1 --1- 172.21.15.70:0/1149099905 >> v1:172.21.15.107:6789/0 conn(0x7f44dc0cde50 0x7f44dc0b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:49200/0 (socket says 172.21.15.70:49200) 2024-09-13T16:01:34.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.276+0000 7f44d9e00640 1 -- 172.21.15.70:0/1149099905 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44dc15a520 msgr2=0x7f44dc06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:34.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.276+0000 7f44d9e00640 1 --2- 172.21.15.70:0/1149099905 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44dc15a520 0x7f44dc06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:34.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.276+0000 7f44d9e00640 1 -- 172.21.15.70:0/1149099905 >> v1:172.21.15.107:6789/0 conn(0x7f44dc0cde50 legacy=0x7f44dc0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:34.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.276+0000 7f44d9e00640 1 -- 172.21.15.70:0/1149099905 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44dc06c460 con 0x7f44dc0b1b00 2024-09-13T16:01:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.277+0000 7f44d9e00640 1 --2- 172.21.15.70:0/1149099905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44dc0b1b00 0x7f44dc0cd910 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f44c80098a0 tx=0x7f44c802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b1c6593be6e34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.277+0000 7f44d9400640 1 -- 172.21.15.70:0/1149099905 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8032440 con 0x7f44dc0b1b00 2024-09-13T16:01:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.277+0000 7f44d9400640 1 -- 172.21.15.70:0/1149099905 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c80325a0 con 0x7f44dc0b1b00 2024-09-13T16:01:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.277+0000 7f44d9400640 1 -- 172.21.15.70:0/1149099905 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8032930 con 0x7f44dc0b1b00 2024-09-13T16:01:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.278+0000 7f44e1400640 1 -- 172.21.15.70:0/1149099905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44dc0b1b00 msgr2=0x7f44dc0cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.278+0000 7f44e1400640 1 --2- 172.21.15.70:0/1149099905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44dc0b1b00 0x7f44dc0cd910 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f44c80098a0 tx=0x7f44c802a290 comp rx=0 tx=0).stop 2024-09-13T16:01:34.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.278+0000 7f44e1400640 1 -- 172.21.15.70:0/1149099905 shutdown_connections 2024-09-13T16:01:34.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.278+0000 7f44e1400640 1 --2- 172.21.15.70:0/1149099905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44dc0b1b00 0x7f44dc0cd910 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:34.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.278+0000 7f44e1400640 1 --2- 172.21.15.70:0/1149099905 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44dc15a520 0x7f44dc06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:34.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.278+0000 7f44e1400640 1 -- 172.21.15.70:0/1149099905 >> 172.21.15.70:0/1149099905 conn(0x7f44dc0b0510 msgr2=0x7f44dc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:34.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.278+0000 7f44e1400640 1 -- 172.21.15.70:0/1149099905 shutdown_connections 2024-09-13T16:01:34.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.278+0000 7f44e1400640 1 -- 172.21.15.70:0/1149099905 wait complete. 2024-09-13T16:01:34.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.280+0000 7f44e1400640 1 Processor -- start 2024-09-13T16:01:34.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.280+0000 7f44e1400640 1 -- start start 2024-09-13T16:01:34.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.281+0000 7f44e1400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44dc0b1b00 0x7f44dc0ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:34.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.281+0000 7f44e1400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44dc0cde50 0x7f44dc0aa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:34.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.281+0000 7f44e1400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44dc15a520 0x7f44dc0aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:34.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.281+0000 7f44e1400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc070dc0 con 0x7f44dc15a520 2024-09-13T16:01:34.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.281+0000 7f44e1400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc1f2330 con 0x7f44dc0b1b00 2024-09-13T16:01:34.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.281+0000 7f44e1400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc070140 con 0x7f44dc0cde50 2024-09-13T16:01:34.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.281+0000 7f44db200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44dc15a520 0x7f44dc0aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:34.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.281+0000 7f44da800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44dc0b1b00 0x7f44dc0ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:34.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.281+0000 7f44d9e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44dc0cde50 0x7f44dc0aa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:34.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.281+0000 7f44db200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44dc15a520 0x7f44dc0aaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50056/0 (socket says 172.21.15.70:50056) 2024-09-13T16:01:34.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.281+0000 7f44db200640 1 -- 172.21.15.70:0/3570341509 learned_addr learned my addr 172.21.15.70:0/3570341509 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:34.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.281+0000 7f44db200640 1 -- 172.21.15.70:0/3570341509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44dc0cde50 msgr2=0x7f44dc0aa070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:34.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.281+0000 7f44db200640 1 --2- 172.21.15.70:0/3570341509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44dc0cde50 0x7f44dc0aa070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:34.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.281+0000 7f44db200640 1 -- 172.21.15.70:0/3570341509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44dc0b1b00 msgr2=0x7f44dc0ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:34.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.281+0000 7f44db200640 1 --2- 172.21.15.70:0/3570341509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44dc0b1b00 0x7f44dc0ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:34.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.281+0000 7f44db200640 1 -- 172.21.15.70:0/3570341509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c80094d0 con 0x7f44dc15a520 2024-09-13T16:01:34.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.282+0000 7f44db200640 1 --2- 172.21.15.70:0/3570341509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44dc15a520 0x7f44dc0aaa10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f44d400c780 tx=0x7f44d400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:34.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.282+0000 7f44d2a00640 1 -- 172.21.15.70:0/3570341509 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400ce90 con 0x7f44dc15a520 2024-09-13T16:01:34.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.282+0000 7f44d2a00640 1 -- 172.21.15.70:0/3570341509 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d400a640 con 0x7f44dc15a520 2024-09-13T16:01:34.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.282+0000 7f44d2a00640 1 -- 172.21.15.70:0/3570341509 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400a9f0 con 0x7f44dc15a520 2024-09-13T16:01:34.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.282+0000 7f44e1400640 1 -- 172.21.15.70:0/3570341509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44dc070420 con 0x7f44dc15a520 2024-09-13T16:01:34.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.282+0000 7f44e1400640 1 -- 172.21.15.70:0/3570341509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44dc0709e0 con 0x7f44dc15a520 2024-09-13T16:01:34.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.283+0000 7f44e1400640 1 -- 172.21.15.70:0/3570341509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44dc0cd910 con 0x7f44dc15a520 2024-09-13T16:01:34.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.284+0000 7f44d2a00640 1 -- 172.21.15.70:0/3570341509 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f44d400ab50 con 0x7f44dc15a520 2024-09-13T16:01:34.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.285+0000 7f44d2a00640 1 --2- 172.21.15.70:0/3570341509 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f44bc06ac00 0x7f44bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:34.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.285+0000 7f44d2a00640 1 -- 172.21.15.70:0/3570341509 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44d4088ae0 con 0x7f44dc15a520 2024-09-13T16:01:34.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.285+0000 7f44da800640 1 --2- 172.21.15.70:0/3570341509 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f44bc06ac00 0x7f44bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:34.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.285+0000 7f44da800640 1 --2- 172.21.15.70:0/3570341509 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f44bc06ac00 0x7f44bc06d0c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009aa0 tx=0x7f44cc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:34.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.289+0000 7f44d2a00640 1 -- 172.21.15.70:0/3570341509 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f44d4053d60 con 0x7f44dc15a520 2024-09-13T16:01:34.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.489+0000 7f44e1400640 1 -- 172.21.15.70:0/3570341509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f44dc0af310 con 0x7f44dc15a520 2024-09-13T16:01:34.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.490+0000 7f44d2a00640 1 -- 172.21.15.70:0/3570341509 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f44d4057380 con 0x7f44dc15a520 2024-09-13T16:01:34.491 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T16:01:34.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.492+0000 7f44e1400640 1 -- 172.21.15.70:0/3570341509 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f44bc06ac00 msgr2=0x7f44bc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:34.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.492+0000 7f44e1400640 1 --2- 172.21.15.70:0/3570341509 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f44bc06ac00 0x7f44bc06d0c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009aa0 tx=0x7f44cc009190 comp rx=0 tx=0).stop 2024-09-13T16:01:34.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.492+0000 7f44e1400640 1 -- 172.21.15.70:0/3570341509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44dc15a520 msgr2=0x7f44dc0aaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:34.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.492+0000 7f44e1400640 1 --2- 172.21.15.70:0/3570341509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44dc15a520 0x7f44dc0aaa10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f44d400c780 tx=0x7f44d400cc40 comp rx=0 tx=0).stop 2024-09-13T16:01:34.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.492+0000 7f44e1400640 1 -- 172.21.15.70:0/3570341509 shutdown_connections 2024-09-13T16:01:34.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.492+0000 7f44e1400640 1 --2- 172.21.15.70:0/3570341509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44dc15a520 0x7f44dc0aaa10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:34.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.492+0000 7f44e1400640 1 --2- 172.21.15.70:0/3570341509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44dc0cde50 0x7f44dc0aa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:34.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.492+0000 7f44e1400640 1 --2- 172.21.15.70:0/3570341509 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f44bc06ac00 0x7f44bc06d0c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:34.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.492+0000 7f44e1400640 1 --2- 172.21.15.70:0/3570341509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44dc0b1b00 0x7f44dc0ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:34.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.492+0000 7f44e1400640 1 -- 172.21.15.70:0/3570341509 >> 172.21.15.70:0/3570341509 conn(0x7f44dc0b0510 msgr2=0x7f44dc0ae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:34.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.492+0000 7f44e1400640 1 -- 172.21.15.70:0/3570341509 shutdown_connections 2024-09-13T16:01:34.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:34.492+0000 7f44e1400640 1 -- 172.21.15.70:0/3570341509 wait complete. 2024-09-13T16:01:34.508 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T16:01:34.508 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T16:01:34.508 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2024-09-13T16:01:34.508 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T16:01:34.508 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T16:01:34.509 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T16:01:34.509 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T16:01:34.509 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T16:01:34.509 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T16:01:34.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:34.509 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2024-09-13T16:01:34.545 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T16:01:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T16:01:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T16:01:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2024-09-13T16:01:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:34.545 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:01:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:01:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f0 2024-09-13T16:01:34.546 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:01:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:01:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f1 2024-09-13T16:01:34.546 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:01:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:01:34.546 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T16:01:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:01:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T16:01:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 42721sec preferred_lft 42721sec 2024-09-13T16:01:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link noprefixroute 2024-09-13T16:01:34.547 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:34.547 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T16:01:34.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:34.548 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2024-09-13T16:01:34.548 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-13T16:01:34.548 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add name ceph-brx type bridge 2024-09-13T16:01:34.548 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr flush dev ceph-brx 2024-09-13T16:01:34.548 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set ceph-brx up 2024-09-13T16:01:34.548 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T16:01:34.548 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-13T16:01:34.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:34.919 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T16:01:34.976 INFO:teuthology.orchestra.run.smithi070.stdout:1 2024-09-13T16:01:34.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:34.980 DEBUG:teuthology.orchestra.run.smithi070:> route 2024-09-13T16:01:35.029 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2024-09-13T16:01:35.029 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T16:01:35.029 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T16:01:35.029 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T16:01:35.029 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T16:01:35.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:35.030 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2024-09-13T16:01:35.030 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-13T16:01:35.030 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T16:01:35.030 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T16:01:35.030 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T16:01:35.030 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-13T16:01:35.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:35.926 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-13T16:01:35.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:35.963 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list-id 2024-09-13T16:01:36.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:36.040 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2024-09-13T16:01:36.040 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-13T16:01:36.040 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T16:01:36.040 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T16:01:36.040 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-13T16:01:36.166 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T16:01:36.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:36.167 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2024-09-13T16:01:36.167 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-13T16:01:36.167 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T16:01:36.167 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T16:01:36.167 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T16:01:36.167 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T16:01:36.167 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T16:01:36.168 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-13T16:01:36.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:36.364 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2024-09-13T16:01:36.364 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-13T16:01:36.364 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.0 up 2024-09-13T16:01:36.364 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T16:01:36.364 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-13T16:01:36.479 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T16:01:36.479 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T16:01:36.514 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T16:01:36.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T16:01:36.515 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T16:01:36.589 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T16:01:36.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:36.589 DEBUG:teuthology.orchestra.run.smithi070:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T16:01:36.725 INFO:teuthology.orchestra.run.smithi070.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T16:01:36.725 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T16:01:36.725 INFO:teuthology.orchestra.run.smithi070.stdout:invalid new device string format 2024-09-13T16:01:37.389 INFO:teuthology.orchestra.run.smithi070.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T16:01:37.389 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T16:01:37.389 INFO:teuthology.orchestra.run.smithi070.stdout:invalid new device string format 2024-09-13T16:01:37.389 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: resolved to: "172.21.15.70:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-13T16:01:37.389 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T16:01:37.416 INFO:teuthology.orchestra.run.smithi070.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T16:01:37.416 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T16:01:37.416 INFO:teuthology.orchestra.run.smithi070.stdout:invalid new device string format 2024-09-13T16:01:37.416 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: resolved to: "172.21.15.70:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-13T16:01:37.416 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T16:01:37.416 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: resolved to: "172.21.15.70:6789,172.21.15.107:6789,172.21.15.107:6790" 2024-09-13T16:01:37.416 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.70:6789,172.21.15.107:6789,172.21.15.107:6790:/ 2024-09-13T16:01:37.416 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f906ab4b-6171-41ec-a825-cd0f700d3930" will pass to kernel 2024-09-13T16:01:37.418 INFO:teuthology.orchestra.run.smithi070.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T16:01:37.418 INFO:teuthology.orchestra.run.smithi070.stdout: You just mounted a file system that supports labels which does not 2024-09-13T16:01:37.418 INFO:teuthology.orchestra.run.smithi070.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T16:01:37.418 INFO:teuthology.orchestra.run.smithi070.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T16:01:37.418 INFO:teuthology.orchestra.run.smithi070.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T16:01:37.421 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T16:01:37.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:37.421 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T16:01:37.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:37.479 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:01:37.527 INFO:teuthology.orchestra.run.smithi070.stdout:client4526 2024-09-13T16:01:37.527 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:01:37.527 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:01:37.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:37.563 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:01:37.650 INFO:teuthology.orchestra.run.smithi070.stdout:client4526 2024-09-13T16:01:37.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:37.651 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:01:37.738 INFO:teuthology.orchestra.run.smithi070.stdout:client4526 2024-09-13T16:01:37.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:37.738 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f906ab4b-6171-41ec-a825-cd0f700d3930.client4526/status') 2024-09-13T16:01:37.839 INFO:teuthology.orchestra.run.smithi070.stdout:instance: client.4526 (3)172.21.15.70:0/2166672838 2024-09-13T16:01:37.840 INFO:teuthology.orchestra.run.smithi070.stdout:blocklisted: false 2024-09-13T16:01:37.840 INFO:teuthology.orchestra.run.smithi070.stderr:0+1 records in 2024-09-13T16:01:37.840 INFO:teuthology.orchestra.run.smithi070.stderr:0+1 records out 2024-09-13T16:01:37.840 INFO:teuthology.orchestra.run.smithi070.stderr:70 bytes copied, 7.0848e-05 s, 988 kB/s 2024-09-13T16:01:37.842 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-13T16:01:37.843 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T16:01:37.843 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T16:01:37.843 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T16:01:37.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.991+0000 7f8790e00640 1 Processor -- start 2024-09-13T16:01:37.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.992+0000 7f8790e00640 1 -- start start 2024-09-13T16:01:37.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.993+0000 7f8790e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c15a5c0 0x7f878c0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:37.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.993+0000 7f8790e00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c0cbfc0 con 0x7f878c15b9b0 2024-09-13T16:01:37.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.993+0000 7f8790e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c0707a0 con 0x7f878c0cbac0 2024-09-13T16:01:37.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.993+0000 7f8790e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0cce20 con 0x7f878c15a5c0 2024-09-13T16:01:37.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.993+0000 7f878b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c15a5c0 0x7f878c0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:37.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.993+0000 7f8782a00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f878c0cbac0 0x7f878c06f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:49202/0 (socket says 172.21.15.70:49202) 2024-09-13T16:01:37.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.993+0000 7f8782a00640 1 -- 172.21.15.70:0/2997910966 learned_addr learned my addr 172.21.15.70:0/2997910966 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:37.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.994+0000 7f878aa00640 1 -- 172.21.15.70:0/2997910966 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314795065 0 0) 0x7f878c0707a0 con 0x7f878c0cbac0 2024-09-13T16:01:37.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.994+0000 7f878aa00640 1 -- 172.21.15.70:0/2997910966 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8770003520 con 0x7f878c0cbac0 2024-09-13T16:01:37.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.994+0000 7f878b400640 1 -- 172.21.15.70:0/2997910966 >> v1:172.21.15.107:6789/0 conn(0x7f878c0cbac0 legacy=0x7f878c06f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:37.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.994+0000 7f878b400640 1 -- 172.21.15.70:0/2997910966 >> v1:172.21.15.70:6789/0 conn(0x7f878c15b9b0 legacy=0x7f878c06fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:37.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.994+0000 7f878aa00640 1 -- 172.21.15.70:0/2997910966 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604149743 0 0) 0x7f878c0cbfc0 con 0x7f878c15b9b0 2024-09-13T16:01:37.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.994+0000 7f878b400640 1 -- 172.21.15.70:0/2997910966 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c070a80 con 0x7f878c15a5c0 2024-09-13T16:01:37.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.995+0000 7f878b400640 1 --2- 172.21.15.70:0/2997910966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c15a5c0 0x7f878c0b39b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f877c0097d0 tx=0x7f877c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc8187b1c5e41e01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:37.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.995+0000 7f878aa00640 1 -- 172.21.15.70:0/2997910966 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c032440 con 0x7f878c15a5c0 2024-09-13T16:01:37.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.995+0000 7f878aa00640 1 -- 172.21.15.70:0/2997910966 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c0325a0 con 0x7f878c15a5c0 2024-09-13T16:01:37.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.995+0000 7f878aa00640 1 -- 172.21.15.70:0/2997910966 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c032910 con 0x7f878c15a5c0 2024-09-13T16:01:37.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.996+0000 7f8790e00640 1 -- 172.21.15.70:0/2997910966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c15a5c0 msgr2=0x7f878c0b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:37.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.996+0000 7f8790e00640 1 --2- 172.21.15.70:0/2997910966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c15a5c0 0x7f878c0b39b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f877c0097d0 tx=0x7f877c02a1a0 comp rx=0 tx=0).stop 2024-09-13T16:01:37.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.996+0000 7f8790e00640 1 -- 172.21.15.70:0/2997910966 shutdown_connections 2024-09-13T16:01:37.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.996+0000 7f8790e00640 1 --2- 172.21.15.70:0/2997910966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c15a5c0 0x7f878c0b39b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:37.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.996+0000 7f8790e00640 1 -- 172.21.15.70:0/2997910966 >> 172.21.15.70:0/2997910966 conn(0x7f878c0ae310 msgr2=0x7f878c0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:37.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.996+0000 7f8790e00640 1 -- 172.21.15.70:0/2997910966 shutdown_connections 2024-09-13T16:01:37.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.996+0000 7f8790e00640 1 -- 172.21.15.70:0/2997910966 wait complete. 2024-09-13T16:01:37.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.998+0000 7f8790e00640 1 Processor -- start 2024-09-13T16:01:38.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.998+0000 7f8790e00640 1 -- start start 2024-09-13T16:01:38.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.999+0000 7f8790e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f878c0cbac0 0x7f878c149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.999+0000 7f8790e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f878c15a5c0 0x7f878c0b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.999+0000 7f8790e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c15b9b0 0x7f878c0c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.999+0000 7f8790e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0b3610 con 0x7f878c15a5c0 2024-09-13T16:01:38.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.999+0000 7f8790e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0b3050 con 0x7f878c0cbac0 2024-09-13T16:01:38.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.999+0000 7f8790e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0b3330 con 0x7f878c15b9b0 2024-09-13T16:01:38.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.999+0000 7f8782a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f878c15a5c0 0x7f878c0b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.999+0000 7f8782a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f878c15a5c0 0x7f878c0b25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50072/0 (socket says 172.21.15.70:50072) 2024-09-13T16:01:38.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.999+0000 7f8782a00640 1 -- 172.21.15.70:0/2083619043 learned_addr learned my addr 172.21.15.70:0/2083619043 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:38.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.999+0000 7f878be00640 1 --2- 172.21.15.70:0/2083619043 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c15b9b0 0x7f878c0c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.999+0000 7f878b400640 1 --2- 172.21.15.70:0/2083619043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f878c0cbac0 0x7f878c149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.999+0000 7f8782a00640 1 -- 172.21.15.70:0/2083619043 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c15b9b0 msgr2=0x7f878c0c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:38.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.999+0000 7f8782a00640 1 --2- 172.21.15.70:0/2083619043 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c15b9b0 0x7f878c0c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.999+0000 7f8782a00640 1 -- 172.21.15.70:0/2083619043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f878c0cbac0 msgr2=0x7f878c149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:38.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.999+0000 7f8782a00640 1 --2- 172.21.15.70:0/2083619043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f878c0cbac0 0x7f878c149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:37.999+0000 7f8782a00640 1 -- 172.21.15.70:0/2083619043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c009400 con 0x7f878c15a5c0 2024-09-13T16:01:38.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.000+0000 7f8782a00640 1 --2- 172.21.15.70:0/2083619043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f878c15a5c0 0x7f878c0b25d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f877400c430 tx=0x7f877400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:38.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.000+0000 7f8783e00640 1 -- 172.21.15.70:0/2083619043 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774005ce0 con 0x7f878c15a5c0 2024-09-13T16:01:38.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.000+0000 7f8783e00640 1 -- 172.21.15.70:0/2083619043 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8774005e40 con 0x7f878c15a5c0 2024-09-13T16:01:38.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.000+0000 7f8790e00640 1 -- 172.21.15.70:0/2083619043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878c1580d0 con 0x7f878c15a5c0 2024-09-13T16:01:38.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.000+0000 7f8783e00640 1 -- 172.21.15.70:0/2083619043 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774007310 con 0x7f878c15a5c0 2024-09-13T16:01:38.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.000+0000 7f8790e00640 1 -- 172.21.15.70:0/2083619043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c14a460 con 0x7f878c15a5c0 2024-09-13T16:01:38.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.001+0000 7f8790e00640 1 -- 172.21.15.70:0/2083619043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878c067360 con 0x7f878c15a5c0 2024-09-13T16:01:38.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.002+0000 7f8783e00640 1 -- 172.21.15.70:0/2083619043 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8774007470 con 0x7f878c15a5c0 2024-09-13T16:01:38.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.003+0000 7f8783e00640 1 --2- 172.21.15.70:0/2083619043 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f876806ac00 0x7f876806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.003+0000 7f8783e00640 1 -- 172.21.15.70:0/2083619043 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87740889b0 con 0x7f878c15a5c0 2024-09-13T16:01:38.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.003+0000 7f878b400640 1 --2- 172.21.15.70:0/2083619043 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f876806ac00 0x7f876806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.003+0000 7f878b400640 1 --2- 172.21.15.70:0/2083619043 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f876806ac00 0x7f876806d0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f877c034000 tx=0x7f877c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:38.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.007+0000 7f8783e00640 1 -- 172.21.15.70:0/2083619043 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8774053ba0 con 0x7f878c15a5c0 2024-09-13T16:01:38.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.214+0000 7f8790e00640 1 -- 172.21.15.70:0/2083619043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f878c157f30 con 0x7f878c15a5c0 2024-09-13T16:01:38.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.214+0000 7f8783e00640 1 -- 172.21.15.70:0/2083619043 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f878c157f30 con 0x7f878c15a5c0 2024-09-13T16:01:38.217 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T16:01:38.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.216+0000 7f8790e00640 1 -- 172.21.15.70:0/2083619043 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f876806ac00 msgr2=0x7f876806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:38.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.216+0000 7f8790e00640 1 --2- 172.21.15.70:0/2083619043 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f876806ac00 0x7f876806d0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f877c034000 tx=0x7f877c02e000 comp rx=0 tx=0).stop 2024-09-13T16:01:38.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.216+0000 7f8790e00640 1 -- 172.21.15.70:0/2083619043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f878c15a5c0 msgr2=0x7f878c0b25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:38.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.216+0000 7f8790e00640 1 --2- 172.21.15.70:0/2083619043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f878c15a5c0 0x7f878c0b25d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f877400c430 tx=0x7f877400c8f0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.217+0000 7f8790e00640 1 -- 172.21.15.70:0/2083619043 shutdown_connections 2024-09-13T16:01:38.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.217+0000 7f8790e00640 1 --2- 172.21.15.70:0/2083619043 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f878c15b9b0 0x7f878c0c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.217+0000 7f8790e00640 1 --2- 172.21.15.70:0/2083619043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f878c15a5c0 0x7f878c0b25d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.217+0000 7f8790e00640 1 --2- 172.21.15.70:0/2083619043 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f876806ac00 0x7f876806d0c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.217+0000 7f8790e00640 1 --2- 172.21.15.70:0/2083619043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f878c0cbac0 0x7f878c149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.217+0000 7f8790e00640 1 -- 172.21.15.70:0/2083619043 >> 172.21.15.70:0/2083619043 conn(0x7f878c0ae310 msgr2=0x7f878c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:38.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.217+0000 7f8790e00640 1 -- 172.21.15.70:0/2083619043 shutdown_connections 2024-09-13T16:01:38.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:38.217+0000 7f8790e00640 1 -- 172.21.15.70:0/2083619043 wait complete. 2024-09-13T16:01:38.234 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T16:01:38.234 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T16:01:38.234 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2024-09-13T16:01:38.234 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-13T16:01:38.234 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T16:01:38.234 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T16:01:38.234 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T16:01:38.234 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T16:01:38.234 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-13T16:01:38.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:38.235 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2024-09-13T16:01:38.270 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T16:01:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T16:01:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T16:01:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2024-09-13T16:01:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:38.271 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:01:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:01:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f0 2024-09-13T16:01:38.271 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:01:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:01:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f1 2024-09-13T16:01:38.271 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:01:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:01:38.271 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T16:01:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:01:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T16:01:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 42717sec preferred_lft 42717sec 2024-09-13T16:01:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link noprefixroute 2024-09-13T16:01:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:38.272 INFO:teuthology.orchestra.run.smithi070.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T16:01:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 96:61:28:cd:31:ba brd ff:ff:ff:ff:ff:ff 2024-09-13T16:01:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T16:01:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::b4a8:e2ff:fec6:f583/64 scope link 2024-09-13T16:01:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:38.272 INFO:teuthology.orchestra.run.smithi070.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T16:01:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 96:61:28:cd:31:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T16:01:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::9461:28ff:fecd:31ba/64 scope link 2024-09-13T16:01:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:38.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:38.273 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T16:01:38.363 INFO:teuthology.orchestra.run.smithi070.stdout:1 2024-09-13T16:01:38.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:38.367 DEBUG:teuthology.orchestra.run.smithi070:> route 2024-09-13T16:01:38.404 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2024-09-13T16:01:38.404 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T16:01:38.404 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T16:01:38.404 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T16:01:38.404 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T16:01:38.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:38.404 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2024-09-13T16:01:38.405 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-13T16:01:38.405 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T16:01:38.405 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T16:01:38.405 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T16:01:38.405 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-13T16:01:38.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:38.549 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-13T16:01:38.585 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T16:01:38.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:38.586 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list-id 2024-09-13T16:01:38.661 INFO:teuthology.orchestra.run.smithi070.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-13T16:01:38.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:38.662 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2024-09-13T16:01:38.662 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-13T16:01:38.662 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T16:01:38.662 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-13T16:01:38.662 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-13T16:01:38.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:38.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T16:01:38.842 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T16:01:38.842 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T16:01:38.842 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T16:01:38.842 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2024-09-13T16:01:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:38.843 INFO:teuthology.orchestra.run.smithi070.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T16:01:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether ca:37:63:8b:3c:08 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T16:01:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T16:01:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::c837:63ff:fe8b:3c08/64 scope link 2024-09-13T16:01:38.843 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:38.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:38.845 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T16:01:38.901 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T16:01:38.901 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T16:01:38.901 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T16:01:38.901 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:38.901 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2024-09-13T16:01:38.901 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:38.901 INFO:teuthology.orchestra.run.smithi070.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T16:01:38.901 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether ca:37:63:8b:3c:08 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T16:01:38.902 INFO:teuthology.orchestra.run.smithi070.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T16:01:38.902 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:38.902 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::c837:63ff:fe8b:3c08/64 scope link 2024-09-13T16:01:38.902 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:38.903 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-13T16:01:38.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:38.904 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2024-09-13T16:01:38.904 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-13T16:01:38.904 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-13T16:01:38.904 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T16:01:38.904 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-13T16:01:38.904 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-13T16:01:38.904 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-13T16:01:38.905 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-13T16:01:39.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:39.070 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2024-09-13T16:01:39.070 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-13T16:01:39.070 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.1 up 2024-09-13T16:01:39.071 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T16:01:39.071 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-13T16:01:39.186 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T16:01:39.186 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-13T16:01:39.221 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-13T16:01:39.221 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T16:01:39.221 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-13T16:01:39.295 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T16:01:39.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:39.295 DEBUG:teuthology.orchestra.run.smithi070:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-13T16:01:39.424 INFO:teuthology.orchestra.run.smithi070.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-13T16:01:39.424 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-13T16:01:39.424 INFO:teuthology.orchestra.run.smithi070.stdout:invalid new device string format 2024-09-13T16:01:39.439 INFO:teuthology.orchestra.run.smithi070.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-13T16:01:39.439 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-13T16:01:39.439 INFO:teuthology.orchestra.run.smithi070.stdout:invalid new device string format 2024-09-13T16:01:39.439 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: resolved to: "172.21.15.70:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-13T16:01:39.439 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T16:01:39.462 INFO:teuthology.orchestra.run.smithi070.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-13T16:01:39.462 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-13T16:01:39.462 INFO:teuthology.orchestra.run.smithi070.stdout:invalid new device string format 2024-09-13T16:01:39.462 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: resolved to: "172.21.15.70:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-13T16:01:39.462 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T16:01:39.462 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: resolved to: "172.21.15.70:6789,172.21.15.107:6789,172.21.15.107:6790" 2024-09-13T16:01:39.463 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.70:6789,172.21.15.107:6789,172.21.15.107:6790:/ 2024-09-13T16:01:39.463 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=f906ab4b-6171-41ec-a825-cd0f700d3930" will pass to kernel 2024-09-13T16:01:39.464 INFO:teuthology.orchestra.run.smithi070.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-13T16:01:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: You just mounted a file system that supports labels which does not 2024-09-13T16:01:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T16:01:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T16:01:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T16:01:39.467 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T16:01:39.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:39.467 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-13T16:01:39.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:39.523 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:01:39.561 INFO:teuthology.orchestra.run.smithi070.stdout:client4535 2024-09-13T16:01:39.561 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:01:39.561 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:01:39.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:39.636 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:01:39.714 INFO:teuthology.orchestra.run.smithi070.stdout:client4535 2024-09-13T16:01:39.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:39.715 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:01:39.792 INFO:teuthology.orchestra.run.smithi070.stdout:client4535 2024-09-13T16:01:39.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:39.793 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f906ab4b-6171-41ec-a825-cd0f700d3930.client4535/status') 2024-09-13T16:01:39.887 INFO:teuthology.orchestra.run.smithi070.stdout:instance: client.4535 (3)172.21.15.70:0/2324342782 2024-09-13T16:01:39.888 INFO:teuthology.orchestra.run.smithi070.stdout:blocklisted: false 2024-09-13T16:01:39.888 INFO:teuthology.orchestra.run.smithi070.stderr:0+1 records in 2024-09-13T16:01:39.888 INFO:teuthology.orchestra.run.smithi070.stderr:0+1 records out 2024-09-13T16:01:39.888 INFO:teuthology.orchestra.run.smithi070.stderr:70 bytes copied, 7.4472e-05 s, 940 kB/s 2024-09-13T16:01:39.890 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-13T16:01:39.891 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T16:01:39.891 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T16:01:39.891 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T16:01:40.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.041+0000 7fa37ae00640 1 Processor -- start 2024-09-13T16:01:40.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.041+0000 7fa37ae00640 1 -- start start 2024-09-13T16:01:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.042+0000 7fa37ae00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa37415a520 0x7fa37406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.042+0000 7fa37ae00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa3740ce020 0x7fa37415a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.042+0000 7fa37ae00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37406bc00 con 0x7fa3740b1b00 2024-09-13T16:01:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.042+0000 7fa37ae00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa37406bea0 con 0x7fa3740ce020 2024-09-13T16:01:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.042+0000 7fa37ae00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa37406c180 con 0x7fa37415a520 2024-09-13T16:01:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.043+0000 7fa378e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa3740ce020 0x7fa37415a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.043+0000 7fa378e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa3740ce020 0x7fa37415a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48224/0 (socket says 172.21.15.70:48224) 2024-09-13T16:01:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.043+0000 7fa378e00640 1 -- 172.21.15.70:0/471075030 learned_addr learned my addr 172.21.15.70:0/471075030 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:40.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.043+0000 7fa373e00640 1 --2- 172.21.15.70:0/471075030 >> v2:172.21.15.107:3300/0 conn(0x7fa37415a520 0x7fa37406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:40.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.043+0000 7fa378e00640 1 -- 172.21.15.70:0/471075030 >> v2:172.21.15.107:3300/0 conn(0x7fa37415a520 msgr2=0x7fa37406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:40.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.043+0000 7fa378e00640 1 --2- 172.21.15.70:0/471075030 >> v2:172.21.15.107:3300/0 conn(0x7fa37415a520 0x7fa37406b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:40.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.043+0000 7fa378e00640 1 -- 172.21.15.70:0/471075030 >> v1:172.21.15.107:6789/0 conn(0x7fa3740b1b00 legacy=0x7fa3740cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:40.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.043+0000 7fa378e00640 1 -- 172.21.15.70:0/471075030 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37406c460 con 0x7fa3740ce020 2024-09-13T16:01:40.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.044+0000 7fa378e00640 1 --2- 172.21.15.70:0/471075030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3740ce020 0x7fa37415a900 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa3740b14f0 tx=0x7fa36c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e6c0d3f763a00d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:40.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.044+0000 7fa373400640 1 -- 172.21.15.70:0/471075030 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c031600 con 0x7fa3740ce020 2024-09-13T16:01:40.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.044+0000 7fa373400640 1 -- 172.21.15.70:0/471075030 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36c02d050 con 0x7fa3740ce020 2024-09-13T16:01:40.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.044+0000 7fa373400640 1 -- 172.21.15.70:0/471075030 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c031980 con 0x7fa3740ce020 2024-09-13T16:01:40.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.045+0000 7fa37ae00640 1 -- 172.21.15.70:0/471075030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3740ce020 msgr2=0x7fa37415a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:40.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.045+0000 7fa37ae00640 1 --2- 172.21.15.70:0/471075030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3740ce020 0x7fa37415a900 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa3740b14f0 tx=0x7fa36c02a6f0 comp rx=0 tx=0).stop 2024-09-13T16:01:40.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.045+0000 7fa37ae00640 1 -- 172.21.15.70:0/471075030 shutdown_connections 2024-09-13T16:01:40.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.045+0000 7fa37ae00640 1 --2- 172.21.15.70:0/471075030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3740ce020 0x7fa37415a900 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:40.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.045+0000 7fa37ae00640 1 --2- 172.21.15.70:0/471075030 >> v2:172.21.15.107:3300/0 conn(0x7fa37415a520 0x7fa37406b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:40.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.045+0000 7fa37ae00640 1 -- 172.21.15.70:0/471075030 >> 172.21.15.70:0/471075030 conn(0x7fa3740b0510 msgr2=0x7fa3740b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:40.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.045+0000 7fa37ae00640 1 -- 172.21.15.70:0/471075030 shutdown_connections 2024-09-13T16:01:40.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.045+0000 7fa37ae00640 1 -- 172.21.15.70:0/471075030 wait complete. 2024-09-13T16:01:40.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.047+0000 7fa37ae00640 1 Processor -- start 2024-09-13T16:01:40.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.047+0000 7fa37ae00640 1 -- start start 2024-09-13T16:01:40.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.048+0000 7fa37ae00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3740b1b00 0x7fa3741e3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:40.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.048+0000 7fa37ae00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3740ce020 0x7fa374157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:40.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.048+0000 7fa37ae00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa37415a520 0x7fa3741e4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:40.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.048+0000 7fa37ae00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3741e40b0 con 0x7fa3740b1b00 2024-09-13T16:01:40.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.048+0000 7fa37ae00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3741e2dd0 con 0x7fa3740ce020 2024-09-13T16:01:40.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.048+0000 7fa37ae00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3741e4ef0 con 0x7fa37415a520 2024-09-13T16:01:40.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.048+0000 7fa373e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3740b1b00 0x7fa3741e3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:40.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.048+0000 7fa373e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3740b1b00 0x7fa3741e3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48226/0 (socket says 172.21.15.70:48226) 2024-09-13T16:01:40.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.048+0000 7fa373e00640 1 -- 172.21.15.70:0/4291350412 learned_addr learned my addr 172.21.15.70:0/4291350412 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:40.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.048+0000 7fa36b400640 1 --2- 172.21.15.70:0/4291350412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3740ce020 0x7fa374157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:40.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.048+0000 7fa378e00640 1 --2- 172.21.15.70:0/4291350412 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa37415a520 0x7fa3741e4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:40.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.048+0000 7fa373e00640 1 -- 172.21.15.70:0/4291350412 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa37415a520 msgr2=0x7fa3741e4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:40.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.048+0000 7fa373e00640 1 --2- 172.21.15.70:0/4291350412 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa37415a520 0x7fa3741e4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:40.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.048+0000 7fa373e00640 1 -- 172.21.15.70:0/4291350412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3740ce020 msgr2=0x7fa374157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:40.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.048+0000 7fa373e00640 1 --2- 172.21.15.70:0/4291350412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3740ce020 0x7fa374157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:40.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.048+0000 7fa373e00640 1 -- 172.21.15.70:0/4291350412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c009b30 con 0x7fa3740b1b00 2024-09-13T16:01:40.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.048+0000 7fa36b400640 1 --2- 172.21.15.70:0/4291350412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3740ce020 0x7fa374157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:40.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.049+0000 7fa373e00640 1 --2- 172.21.15.70:0/4291350412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3740b1b00 0x7fa3741e3b70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa36400d5f0 tx=0x7fa36400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:40.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.049+0000 7fa370c00640 1 -- 172.21.15.70:0/4291350412 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3640125f0 con 0x7fa3740b1b00 2024-09-13T16:01:40.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.049+0000 7fa370c00640 1 -- 172.21.15.70:0/4291350412 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa364012750 con 0x7fa3740b1b00 2024-09-13T16:01:40.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.049+0000 7fa370c00640 1 -- 172.21.15.70:0/4291350412 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa364012b00 con 0x7fa3740b1b00 2024-09-13T16:01:40.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.049+0000 7fa37ae00640 1 -- 172.21.15.70:0/4291350412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3741e3090 con 0x7fa3740b1b00 2024-09-13T16:01:40.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.049+0000 7fa37ae00640 1 -- 172.21.15.70:0/4291350412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3741e3650 con 0x7fa3740b1b00 2024-09-13T16:01:40.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.050+0000 7fa37ae00640 1 -- 172.21.15.70:0/4291350412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3741e37e0 con 0x7fa3740b1b00 2024-09-13T16:01:40.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.051+0000 7fa370c00640 1 -- 172.21.15.70:0/4291350412 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa364012c60 con 0x7fa3740b1b00 2024-09-13T16:01:40.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.052+0000 7fa370c00640 1 --2- 172.21.15.70:0/4291350412 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa35006ac00 0x7fa35006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:40.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.052+0000 7fa370c00640 1 -- 172.21.15.70:0/4291350412 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3640898e0 con 0x7fa3740b1b00 2024-09-13T16:01:40.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.052+0000 7fa36b400640 1 --2- 172.21.15.70:0/4291350412 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa35006ac00 0x7fa35006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:40.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.053+0000 7fa36b400640 1 --2- 172.21.15.70:0/4291350412 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa35006ac00 0x7fa35006d0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa3740b0440 tx=0x7fa35c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:40.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.056+0000 7fa370c00640 1 -- 172.21.15.70:0/4291350412 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa364054a20 con 0x7fa3740b1b00 2024-09-13T16:01:40.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.260+0000 7fa37ae00640 1 -- 172.21.15.70:0/4291350412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa37415a900 con 0x7fa3740b1b00 2024-09-13T16:01:40.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.260+0000 7fa370c00640 1 -- 172.21.15.70:0/4291350412 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa364058040 con 0x7fa3740b1b00 2024-09-13T16:01:40.263 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T16:01:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.262+0000 7fa37ae00640 1 -- 172.21.15.70:0/4291350412 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa35006ac00 msgr2=0x7fa35006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.262+0000 7fa37ae00640 1 --2- 172.21.15.70:0/4291350412 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa35006ac00 0x7fa35006d0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa3740b0440 tx=0x7fa35c009040 comp rx=0 tx=0).stop 2024-09-13T16:01:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.262+0000 7fa37ae00640 1 -- 172.21.15.70:0/4291350412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3740b1b00 msgr2=0x7fa3741e3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.262+0000 7fa37ae00640 1 --2- 172.21.15.70:0/4291350412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3740b1b00 0x7fa3741e3b70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa36400d5f0 tx=0x7fa36400dab0 comp rx=0 tx=0).stop 2024-09-13T16:01:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.262+0000 7fa37ae00640 1 -- 172.21.15.70:0/4291350412 shutdown_connections 2024-09-13T16:01:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.262+0000 7fa37ae00640 1 --2- 172.21.15.70:0/4291350412 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa37415a520 0x7fa3741e4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.262+0000 7fa37ae00640 1 --2- 172.21.15.70:0/4291350412 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa35006ac00 0x7fa35006d0c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.262+0000 7fa37ae00640 1 --2- 172.21.15.70:0/4291350412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3740ce020 0x7fa374157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.262+0000 7fa37ae00640 1 --2- 172.21.15.70:0/4291350412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3740b1b00 0x7fa3741e3b70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.262+0000 7fa37ae00640 1 -- 172.21.15.70:0/4291350412 >> 172.21.15.70:0/4291350412 conn(0x7fa3740b0510 msgr2=0x7fa3740b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.263+0000 7fa37ae00640 1 -- 172.21.15.70:0/4291350412 shutdown_connections 2024-09-13T16:01:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:40.263+0000 7fa37ae00640 1 -- 172.21.15.70:0/4291350412 wait complete. 2024-09-13T16:01:40.280 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T16:01:40.280 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T16:01:40.280 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2024-09-13T16:01:40.280 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T16:01:40.281 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T16:01:40.281 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T16:01:40.281 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T16:01:40.281 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T16:01:40.281 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T16:01:40.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:40.281 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2024-09-13T16:01:40.321 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T16:01:40.321 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T16:01:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T16:01:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-09-13T16:01:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:40.322 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:01:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2024-09-13T16:01:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2024-09-13T16:01:40.322 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:01:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2024-09-13T16:01:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2024-09-13T16:01:40.322 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:01:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2024-09-13T16:01:40.322 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T16:01:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2024-09-13T16:01:40.323 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T16:01:40.323 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42718sec preferred_lft 42718sec 2024-09-13T16:01:40.323 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link noprefixroute 2024-09-13T16:01:40.323 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:40.323 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T16:01:40.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:40.323 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-09-13T16:01:40.324 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-13T16:01:40.324 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add name ceph-brx type bridge 2024-09-13T16:01:40.324 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr flush dev ceph-brx 2024-09-13T16:01:40.324 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set ceph-brx up 2024-09-13T16:01:40.324 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T16:01:40.324 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-13T16:01:40.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:40.683 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T16:01:40.743 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-09-13T16:01:40.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:40.746 DEBUG:teuthology.orchestra.run.smithi107:> route 2024-09-13T16:01:40.799 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2024-09-13T16:01:40.799 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T16:01:40.799 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T16:01:40.799 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T16:01:40.800 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T16:01:40.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:40.801 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-09-13T16:01:40.801 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-13T16:01:40.801 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T16:01:40.801 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T16:01:40.801 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T16:01:40.801 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-13T16:01:41.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:41.326 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-09-13T16:01:41.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:41.362 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2024-09-13T16:01:41.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:41.437 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-09-13T16:01:41.437 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-13T16:01:41.438 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T16:01:41.438 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T16:01:41.438 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-13T16:01:41.562 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T16:01:41.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:41.563 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-09-13T16:01:41.563 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-13T16:01:41.563 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T16:01:41.563 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T16:01:41.563 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T16:01:41.563 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T16:01:41.563 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T16:01:41.563 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-13T16:01:41.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:41.749 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-09-13T16:01:41.749 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-13T16:01:41.750 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.0 up 2024-09-13T16:01:41.750 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T16:01:41.750 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-13T16:01:41.864 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T16:01:41.864 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T16:01:41.900 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T16:01:41.900 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T16:01:41.900 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T16:01:41.975 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T16:01:41.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:41.975 DEBUG:teuthology.orchestra.run.smithi107:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T16:01:42.117 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T16:01:42.117 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T16:01:42.117 INFO:teuthology.orchestra.run.smithi107.stdout:invalid new device string format 2024-09-13T16:01:42.728 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T16:01:42.729 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T16:01:42.729 INFO:teuthology.orchestra.run.smithi107.stdout:invalid new device string format 2024-09-13T16:01:42.729 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.70:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-13T16:01:42.729 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T16:01:42.754 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T16:01:42.754 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T16:01:42.754 INFO:teuthology.orchestra.run.smithi107.stdout:invalid new device string format 2024-09-13T16:01:42.754 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.70:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-13T16:01:42.754 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T16:01:42.755 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.70:6789,172.21.15.107:6789,172.21.15.107:6790" 2024-09-13T16:01:42.755 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.70:6789,172.21.15.107:6789,172.21.15.107:6790:/ 2024-09-13T16:01:42.755 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f906ab4b-6171-41ec-a825-cd0f700d3930" will pass to kernel 2024-09-13T16:01:42.757 INFO:teuthology.orchestra.run.smithi107.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T16:01:42.757 INFO:teuthology.orchestra.run.smithi107.stdout: You just mounted a file system that supports labels which does not 2024-09-13T16:01:42.758 INFO:teuthology.orchestra.run.smithi107.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T16:01:42.758 INFO:teuthology.orchestra.run.smithi107.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T16:01:42.758 INFO:teuthology.orchestra.run.smithi107.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T16:01:42.760 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T16:01:42.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:42.761 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T16:01:42.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:42.817 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:01:42.855 INFO:teuthology.orchestra.run.smithi107.stdout:client4541 2024-09-13T16:01:42.855 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:01:42.855 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:01:42.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:42.932 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:01:43.009 INFO:teuthology.orchestra.run.smithi107.stdout:client4541 2024-09-13T16:01:43.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:43.010 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:01:43.086 INFO:teuthology.orchestra.run.smithi107.stdout:client4541 2024-09-13T16:01:43.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:43.087 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f906ab4b-6171-41ec-a825-cd0f700d3930.client4541/status') 2024-09-13T16:01:43.182 INFO:teuthology.orchestra.run.smithi107.stdout:instance: client.4541 (3)192.168.0.1:0/3490206352 2024-09-13T16:01:43.182 INFO:teuthology.orchestra.run.smithi107.stdout:blocklisted: false 2024-09-13T16:01:43.183 INFO:teuthology.orchestra.run.smithi107.stderr:0+1 records in 2024-09-13T16:01:43.183 INFO:teuthology.orchestra.run.smithi107.stderr:0+1 records out 2024-09-13T16:01:43.183 INFO:teuthology.orchestra.run.smithi107.stderr:69 bytes copied, 5.3065e-05 s, 1.3 MB/s 2024-09-13T16:01:43.186 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-13T16:01:43.186 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T16:01:43.186 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T16:01:43.186 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T16:01:43.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.342+0000 7f903be00640 1 Processor -- start 2024-09-13T16:01:43.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.342+0000 7f903be00640 1 -- start start 2024-09-13T16:01:43.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.344+0000 7f903be00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9034160370 0x7f90340b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:43.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.344+0000 7f903be00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903413fbc0 con 0x7f90340b2e90 2024-09-13T16:01:43.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.344+0000 7f903be00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903415ce80 con 0x7f90340b3a40 2024-09-13T16:01:43.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.344+0000 7f903be00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903406cca0 con 0x7f9034160370 2024-09-13T16:01:43.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.344+0000 7f9038a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9034160370 0x7f90340b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:43.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.344+0000 7f9039e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f90340b2e90 0x7f90340ac870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35802/0 (socket says 172.21.15.70:35802) 2024-09-13T16:01:43.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.344+0000 7f9039e00640 1 -- 172.21.15.70:0/4133017320 learned_addr learned my addr 172.21.15.70:0/4133017320 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:43.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.344+0000 7f9038a00640 1 -- 172.21.15.70:0/4133017320 >> v1:172.21.15.107:6789/0 conn(0x7f90340b3a40 legacy=0x7f90341428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:43.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.344+0000 7f9038a00640 1 -- 172.21.15.70:0/4133017320 >> v1:172.21.15.70:6789/0 conn(0x7f90340b2e90 legacy=0x7f90340ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:43.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.344+0000 7f9033e00640 1 -- 172.21.15.70:0/4133017320 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581445212 0 0) 0x7f903413fbc0 con 0x7f90340b2e90 2024-09-13T16:01:43.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.344+0000 7f9038a00640 1 -- 172.21.15.70:0/4133017320 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9034160910 con 0x7f9034160370 2024-09-13T16:01:43.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.345+0000 7f9038a00640 1 --2- 172.21.15.70:0/4133017320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9034160370 0x7f90340b2950 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f90200097a0 tx=0x7f902002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f84a7be9e50c15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:43.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.346+0000 7f9033e00640 1 -- 172.21.15.70:0/4133017320 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020032440 con 0x7f9034160370 2024-09-13T16:01:43.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.346+0000 7f9033e00640 1 -- 172.21.15.70:0/4133017320 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90200325a0 con 0x7f9034160370 2024-09-13T16:01:43.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.346+0000 7f9033e00640 1 -- 172.21.15.70:0/4133017320 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020032930 con 0x7f9034160370 2024-09-13T16:01:43.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.346+0000 7f903be00640 1 -- 172.21.15.70:0/4133017320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9034160370 msgr2=0x7f90340b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:43.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.346+0000 7f903be00640 1 --2- 172.21.15.70:0/4133017320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9034160370 0x7f90340b2950 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f90200097a0 tx=0x7f902002a1a0 comp rx=0 tx=0).stop 2024-09-13T16:01:43.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.346+0000 7f903be00640 1 -- 172.21.15.70:0/4133017320 shutdown_connections 2024-09-13T16:01:43.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.346+0000 7f903be00640 1 --2- 172.21.15.70:0/4133017320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9034160370 0x7f90340b2950 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:43.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.346+0000 7f903be00640 1 -- 172.21.15.70:0/4133017320 >> 172.21.15.70:0/4133017320 conn(0x7f90340b0510 msgr2=0x7f90340b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:43.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.346+0000 7f903be00640 1 -- 172.21.15.70:0/4133017320 shutdown_connections 2024-09-13T16:01:43.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.346+0000 7f903be00640 1 -- 172.21.15.70:0/4133017320 wait complete. 2024-09-13T16:01:43.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.348+0000 7f903be00640 1 Processor -- start 2024-09-13T16:01:43.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.348+0000 7f903be00640 1 -- start start 2024-09-13T16:01:43.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.349+0000 7f903be00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90340b2e90 0x7f903413c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:43.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.349+0000 7f903be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90340b3a40 0x7f903413f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:43.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.349+0000 7f903be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9034160370 0x7f9034145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:43.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.349+0000 7f903be00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9034145080 con 0x7f90340b2e90 2024-09-13T16:01:43.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.349+0000 7f903be00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9034143db0 con 0x7f9034160370 2024-09-13T16:01:43.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.349+0000 7f903be00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9034144a30 con 0x7f90340b3a40 2024-09-13T16:01:43.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.349+0000 7f9039400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90340b2e90 0x7f903413c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:43.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.349+0000 7f9039400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90340b2e90 0x7f903413c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48236/0 (socket says 172.21.15.70:48236) 2024-09-13T16:01:43.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.349+0000 7f9039400640 1 -- 172.21.15.70:0/3637475363 learned_addr learned my addr 172.21.15.70:0/3637475363 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:43.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.349+0000 7f9038a00640 1 --2- 172.21.15.70:0/3637475363 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90340b3a40 0x7f903413f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:43.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.349+0000 7f9039e00640 1 --2- 172.21.15.70:0/3637475363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9034160370 0x7f9034145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:43.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.350+0000 7f9039400640 1 -- 172.21.15.70:0/3637475363 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90340b3a40 msgr2=0x7f903413f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:43.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.350+0000 7f9039400640 1 --2- 172.21.15.70:0/3637475363 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90340b3a40 0x7f903413f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:43.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.350+0000 7f9039400640 1 -- 172.21.15.70:0/3637475363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9034160370 msgr2=0x7f9034145510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:43.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.350+0000 7f9039400640 1 --2- 172.21.15.70:0/3637475363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9034160370 0x7f9034145510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:43.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.350+0000 7f9039400640 1 -- 172.21.15.70:0/3637475363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9020009400 con 0x7f90340b2e90 2024-09-13T16:01:43.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.350+0000 7f9039400640 1 --2- 172.21.15.70:0/3637475363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90340b2e90 0x7f903413c3d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f902800c450 tx=0x7f902800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:43.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.350+0000 7f9031600640 1 -- 172.21.15.70:0/3637475363 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90280052d0 con 0x7f90340b2e90 2024-09-13T16:01:43.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.350+0000 7f9031600640 1 -- 172.21.15.70:0/3637475363 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9028005430 con 0x7f90340b2e90 2024-09-13T16:01:43.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.350+0000 7f903be00640 1 -- 172.21.15.70:0/3637475363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9034144d10 con 0x7f90340b2e90 2024-09-13T16:01:43.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.350+0000 7f9031600640 1 -- 172.21.15.70:0/3637475363 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9028012870 con 0x7f90340b2e90 2024-09-13T16:01:43.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.350+0000 7f903be00640 1 -- 172.21.15.70:0/3637475363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903413fed0 con 0x7f90340b2e90 2024-09-13T16:01:43.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.351+0000 7f903be00640 1 -- 172.21.15.70:0/3637475363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9034144890 con 0x7f90340b2e90 2024-09-13T16:01:43.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.352+0000 7f9031600640 1 -- 172.21.15.70:0/3637475363 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f90280129d0 con 0x7f90340b2e90 2024-09-13T16:01:43.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.353+0000 7f9031600640 1 --2- 172.21.15.70:0/3637475363 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f901406ac00 0x7f901406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:43.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.353+0000 7f9031600640 1 -- 172.21.15.70:0/3637475363 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9028088e80 con 0x7f90340b2e90 2024-09-13T16:01:43.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.353+0000 7f9038a00640 1 --2- 172.21.15.70:0/3637475363 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f901406ac00 0x7f901406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:43.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.354+0000 7f9038a00640 1 --2- 172.21.15.70:0/3637475363 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f901406ac00 0x7f901406d0c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9020034000 tx=0x7f902002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:43.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.357+0000 7f9031600640 1 -- 172.21.15.70:0/3637475363 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9034144890 con 0x7f90340b2e90 2024-09-13T16:01:43.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.563+0000 7f903be00640 1 -- 172.21.15.70:0/3637475363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9034144890 con 0x7f90340b2e90 2024-09-13T16:01:43.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.563+0000 7f9031600640 1 -- 172.21.15.70:0/3637475363 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9034144890 con 0x7f90340b2e90 2024-09-13T16:01:43.565 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T16:01:43.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.565+0000 7f903be00640 1 -- 172.21.15.70:0/3637475363 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f901406ac00 msgr2=0x7f901406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:43.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.565+0000 7f903be00640 1 --2- 172.21.15.70:0/3637475363 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f901406ac00 0x7f901406d0c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9020034000 tx=0x7f902002e000 comp rx=0 tx=0).stop 2024-09-13T16:01:43.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.565+0000 7f903be00640 1 -- 172.21.15.70:0/3637475363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90340b2e90 msgr2=0x7f903413c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:43.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.565+0000 7f903be00640 1 --2- 172.21.15.70:0/3637475363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90340b2e90 0x7f903413c3d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f902800c450 tx=0x7f902800c910 comp rx=0 tx=0).stop 2024-09-13T16:01:43.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.565+0000 7f903be00640 1 -- 172.21.15.70:0/3637475363 shutdown_connections 2024-09-13T16:01:43.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.565+0000 7f903be00640 1 --2- 172.21.15.70:0/3637475363 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f901406ac00 0x7f901406d0c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:43.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.565+0000 7f903be00640 1 --2- 172.21.15.70:0/3637475363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9034160370 0x7f9034145510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:43.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.565+0000 7f903be00640 1 --2- 172.21.15.70:0/3637475363 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90340b3a40 0x7f903413f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:43.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.565+0000 7f903be00640 1 --2- 172.21.15.70:0/3637475363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90340b2e90 0x7f903413c3d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:43.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.565+0000 7f903be00640 1 -- 172.21.15.70:0/3637475363 >> 172.21.15.70:0/3637475363 conn(0x7f90340b0510 msgr2=0x7f903406a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:43.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.566+0000 7f903be00640 1 -- 172.21.15.70:0/3637475363 shutdown_connections 2024-09-13T16:01:43.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:43.566+0000 7f903be00640 1 -- 172.21.15.70:0/3637475363 wait complete. 2024-09-13T16:01:43.583 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T16:01:43.583 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T16:01:43.584 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2024-09-13T16:01:43.584 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-13T16:01:43.584 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T16:01:43.584 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T16:01:43.584 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T16:01:43.584 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T16:01:43.584 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-13T16:01:43.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:43.584 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2024-09-13T16:01:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T16:01:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T16:01:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T16:01:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-09-13T16:01:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:01:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2024-09-13T16:01:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2024-09-13T16:01:43.622 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:01:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2024-09-13T16:01:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2024-09-13T16:01:43.622 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:01:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2024-09-13T16:01:43.622 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T16:01:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2024-09-13T16:01:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T16:01:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42715sec preferred_lft 42715sec 2024-09-13T16:01:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link noprefixroute 2024-09-13T16:01:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:43.623 INFO:teuthology.orchestra.run.smithi107.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T16:01:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 5e:ef:b6:c3:1a:16 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:01:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T16:01:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::80d2:4bff:fef3:b56f/64 scope link 2024-09-13T16:01:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:43.623 INFO:teuthology.orchestra.run.smithi107.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T16:01:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 5e:ef:b6:c3:1a:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T16:01:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::5cef:b6ff:fec3:1a16/64 scope link 2024-09-13T16:01:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:43.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:43.624 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T16:01:43.714 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-09-13T16:01:43.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:43.717 DEBUG:teuthology.orchestra.run.smithi107:> route 2024-09-13T16:01:43.753 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2024-09-13T16:01:43.753 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T16:01:43.753 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T16:01:43.753 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T16:01:43.754 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T16:01:43.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:43.754 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-09-13T16:01:43.754 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-13T16:01:43.754 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T16:01:43.754 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T16:01:43.754 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T16:01:43.754 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-13T16:01:43.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:43.898 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-09-13T16:01:43.933 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T16:01:43.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:43.934 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2024-09-13T16:01:44.009 INFO:teuthology.orchestra.run.smithi107.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-13T16:01:44.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:44.009 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-09-13T16:01:44.010 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-13T16:01:44.010 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T16:01:44.010 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-13T16:01:44.010 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-13T16:01:44.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:44.134 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T16:01:44.188 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T16:01:44.188 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T16:01:44.189 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T16:01:44.189 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:44.189 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-09-13T16:01:44.189 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:44.189 INFO:teuthology.orchestra.run.smithi107.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T16:01:44.189 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 06:e7:2c:15:8f:70 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T16:01:44.189 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T16:01:44.189 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:44.189 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::4e7:2cff:fe15:8f70/64 scope link 2024-09-13T16:01:44.189 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:44.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:44.191 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T16:01:44.246 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T16:01:44.246 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T16:01:44.246 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T16:01:44.246 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:44.246 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-09-13T16:01:44.246 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:44.247 INFO:teuthology.orchestra.run.smithi107.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T16:01:44.247 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 06:e7:2c:15:8f:70 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T16:01:44.247 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T16:01:44.247 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:44.247 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::4e7:2cff:fe15:8f70/64 scope link 2024-09-13T16:01:44.247 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:01:44.249 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-13T16:01:44.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:44.249 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-09-13T16:01:44.249 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-13T16:01:44.249 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-13T16:01:44.249 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T16:01:44.250 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-13T16:01:44.250 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-13T16:01:44.250 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-13T16:01:44.250 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-13T16:01:44.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:44.415 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-09-13T16:01:44.415 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-13T16:01:44.415 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.1 up 2024-09-13T16:01:44.415 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T16:01:44.415 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-13T16:01:44.529 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T16:01:44.530 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-13T16:01:44.565 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-13T16:01:44.565 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T16:01:44.565 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-13T16:01:44.640 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T16:01:44.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:44.641 DEBUG:teuthology.orchestra.run.smithi107:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-13T16:01:44.769 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-13T16:01:44.769 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-13T16:01:44.769 INFO:teuthology.orchestra.run.smithi107.stdout:invalid new device string format 2024-09-13T16:01:44.785 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-13T16:01:44.785 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-13T16:01:44.785 INFO:teuthology.orchestra.run.smithi107.stdout:invalid new device string format 2024-09-13T16:01:44.785 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.70:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-13T16:01:44.785 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T16:01:44.808 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-13T16:01:44.808 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-13T16:01:44.808 INFO:teuthology.orchestra.run.smithi107.stdout:invalid new device string format 2024-09-13T16:01:44.808 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.70:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-13T16:01:44.808 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T16:01:44.808 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.70:6789,172.21.15.107:6789,172.21.15.107:6790" 2024-09-13T16:01:44.808 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.70:6789,172.21.15.107:6789,172.21.15.107:6790:/ 2024-09-13T16:01:44.808 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=f906ab4b-6171-41ec-a825-cd0f700d3930" will pass to kernel 2024-09-13T16:01:44.809 INFO:teuthology.orchestra.run.smithi107.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-13T16:01:44.809 INFO:teuthology.orchestra.run.smithi107.stdout: You just mounted a file system that supports labels which does not 2024-09-13T16:01:44.810 INFO:teuthology.orchestra.run.smithi107.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T16:01:44.810 INFO:teuthology.orchestra.run.smithi107.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T16:01:44.810 INFO:teuthology.orchestra.run.smithi107.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T16:01:44.812 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T16:01:44.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:44.813 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-13T16:01:44.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:44.868 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:01:44.905 INFO:teuthology.orchestra.run.smithi107.stdout:client4704 2024-09-13T16:01:44.906 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:01:44.906 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:01:44.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:44.981 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:01:45.058 INFO:teuthology.orchestra.run.smithi107.stdout:client4704 2024-09-13T16:01:45.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:45.059 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:01:45.135 INFO:teuthology.orchestra.run.smithi107.stdout:client4704 2024-09-13T16:01:45.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:45.136 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f906ab4b-6171-41ec-a825-cd0f700d3930.client4704/status') 2024-09-13T16:01:45.234 INFO:teuthology.orchestra.run.smithi107.stdout:instance: client.4704 (3)172.21.15.107:0/3868562524 2024-09-13T16:01:45.234 INFO:teuthology.orchestra.run.smithi107.stdout:blocklisted: false 2024-09-13T16:01:45.234 INFO:teuthology.orchestra.run.smithi107.stderr:0+1 records in 2024-09-13T16:01:45.234 INFO:teuthology.orchestra.run.smithi107.stderr:0+1 records out 2024-09-13T16:01:45.234 INFO:teuthology.orchestra.run.smithi107.stderr:71 bytes copied, 5.3193e-05 s, 1.3 MB/s 2024-09-13T16:01:45.237 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-13T16:01:45.254 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:45.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.415+0000 7fa0ab200640 1 Processor -- start 2024-09-13T16:01:45.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.415+0000 7fa0ab200640 1 -- start start 2024-09-13T16:01:45.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.416+0000 7fa0ab200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa0a41590e0 0x7fa0a4159570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:45.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.416+0000 7fa0ab200640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a406a920 con 0x7fa0a4158d00 2024-09-13T16:01:45.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.416+0000 7fa0ab200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a406ac00 con 0x7fa0a4159ab0 2024-09-13T16:01:45.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.416+0000 7fa0ab200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a406aee0 con 0x7fa0a41590e0 2024-09-13T16:01:45.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.416+0000 7fa0a3e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fa0a4158d00 0x7fa0a4069ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35804/0 (socket says 172.21.15.70:35804) 2024-09-13T16:01:45.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.416+0000 7fa0a3e00640 1 -- 172.21.15.70:0/1840670774 learned_addr learned my addr 172.21.15.70:0/1840670774 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:45.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.416+0000 7fa09be00640 1 --2- 172.21.15.70:0/1840670774 >> v2:172.21.15.70:3300/0 conn(0x7fa0a41590e0 0x7fa0a4159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:45.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.417+0000 7fa09be00640 1 -- 172.21.15.70:0/1840670774 >> v1:172.21.15.107:6789/0 conn(0x7fa0a4159ab0 legacy=0x7fa0a40b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:45.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.417+0000 7fa09be00640 1 -- 172.21.15.70:0/1840670774 >> v1:172.21.15.70:6789/0 conn(0x7fa0a4158d00 legacy=0x7fa0a4069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:45.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.417+0000 7fa09be00640 1 -- 172.21.15.70:0/1840670774 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a406b1c0 con 0x7fa0a41590e0 2024-09-13T16:01:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.417+0000 7fa0a3400640 1 -- 172.21.15.70:0/1840670774 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217283343 0 0) 0x7fa0a406a920 con 0x7fa0a4158d00 2024-09-13T16:01:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.418+0000 7fa09be00640 1 --2- 172.21.15.70:0/1840670774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0a41590e0 0x7fa0a4159570 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0097a0 tx=0x7fa08c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eecd1ff97eabb1b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.418+0000 7fa0a3400640 1 -- 172.21.15.70:0/1840670774 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c032440 con 0x7fa0a41590e0 2024-09-13T16:01:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.418+0000 7fa0a3400640 1 -- 172.21.15.70:0/1840670774 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c0325a0 con 0x7fa0a41590e0 2024-09-13T16:01:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.418+0000 7fa0a3400640 1 -- 172.21.15.70:0/1840670774 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c032930 con 0x7fa0a41590e0 2024-09-13T16:01:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.419+0000 7fa0ab200640 1 -- 172.21.15.70:0/1840670774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0a41590e0 msgr2=0x7fa0a4159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.419+0000 7fa0ab200640 1 --2- 172.21.15.70:0/1840670774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0a41590e0 0x7fa0a4159570 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0097a0 tx=0x7fa08c02a1e0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.419+0000 7fa0ab200640 1 -- 172.21.15.70:0/1840670774 shutdown_connections 2024-09-13T16:01:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.419+0000 7fa0ab200640 1 --2- 172.21.15.70:0/1840670774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0a41590e0 0x7fa0a4159570 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.419+0000 7fa0ab200640 1 -- 172.21.15.70:0/1840670774 >> 172.21.15.70:0/1840670774 conn(0x7fa0a40ae480 msgr2=0x7fa0a40b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.419+0000 7fa0ab200640 1 -- 172.21.15.70:0/1840670774 shutdown_connections 2024-09-13T16:01:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.419+0000 7fa0ab200640 1 -- 172.21.15.70:0/1840670774 wait complete. 2024-09-13T16:01:45.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.420+0000 7fa0ab200640 1 Processor -- start 2024-09-13T16:01:45.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.420+0000 7fa0ab200640 1 -- start start 2024-09-13T16:01:45.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.421+0000 7fa0ab200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0a4158d00 0x7fa0a4149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:45.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.421+0000 7fa0ab200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0a41590e0 0x7fa0a40cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:45.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.421+0000 7fa0ab200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0a4159ab0 0x7fa0a40ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:45.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.421+0000 7fa0ab200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a40cc550 con 0x7fa0a4158d00 2024-09-13T16:01:45.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.421+0000 7fa0ab200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4149f60 con 0x7fa0a4159ab0 2024-09-13T16:01:45.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.421+0000 7fa0ab200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a40cc270 con 0x7fa0a41590e0 2024-09-13T16:01:45.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.422+0000 7fa0a3e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0a4158d00 0x7fa0a4149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:45.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.422+0000 7fa0a3e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0a4158d00 0x7fa0a4149a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48258/0 (socket says 172.21.15.70:48258) 2024-09-13T16:01:45.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.422+0000 7fa0a3e00640 1 -- 172.21.15.70:0/3146545835 learned_addr learned my addr 172.21.15.70:0/3146545835 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:45.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.422+0000 7fa09be00640 1 --2- 172.21.15.70:0/3146545835 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0a41590e0 0x7fa0a40cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.422+0000 7fa0a9200640 1 --2- 172.21.15.70:0/3146545835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0a4159ab0 0x7fa0a40ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.422+0000 7fa0a3e00640 1 -- 172.21.15.70:0/3146545835 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0a41590e0 msgr2=0x7fa0a40cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.422+0000 7fa0a3e00640 1 --2- 172.21.15.70:0/3146545835 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0a41590e0 0x7fa0a40cdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.422+0000 7fa0a3e00640 1 -- 172.21.15.70:0/3146545835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0a4159ab0 msgr2=0x7fa0a40ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.422+0000 7fa0a3e00640 1 --2- 172.21.15.70:0/3146545835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0a4159ab0 0x7fa0a40ce170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.422+0000 7fa0a3e00640 1 -- 172.21.15.70:0/3146545835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c009400 con 0x7fa0a4158d00 2024-09-13T16:01:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.422+0000 7fa0a3e00640 1 --2- 172.21.15.70:0/3146545835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0a4158d00 0x7fa0a4149a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa09400c4d0 tx=0x7fa09400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.422+0000 7fa0a0c00640 1 -- 172.21.15.70:0/3146545835 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0940074e0 con 0x7fa0a4158d00 2024-09-13T16:01:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.423+0000 7fa0a0c00640 1 -- 172.21.15.70:0/3146545835 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa094007660 con 0x7fa0a4158d00 2024-09-13T16:01:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.423+0000 7fa0a0c00640 1 -- 172.21.15.70:0/3146545835 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094004a20 con 0x7fa0a4158d00 2024-09-13T16:01:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.423+0000 7fa0ab200640 1 -- 172.21.15.70:0/3146545835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a4152ea0 con 0x7fa0a4158d00 2024-09-13T16:01:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.423+0000 7fa0ab200640 1 -- 172.21.15.70:0/3146545835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a4153460 con 0x7fa0a4158d00 2024-09-13T16:01:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.424+0000 7fa0ab200640 1 -- 172.21.15.70:0/3146545835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a4071410 con 0x7fa0a4158d00 2024-09-13T16:01:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.425+0000 7fa0a0c00640 1 -- 172.21.15.70:0/3146545835 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa094004b80 con 0x7fa0a4158d00 2024-09-13T16:01:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.425+0000 7fa0a0c00640 1 --2- 172.21.15.70:0/3146545835 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa08006ac00 0x7fa08006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.426+0000 7fa0a0c00640 1 -- 172.21.15.70:0/3146545835 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa094088550 con 0x7fa0a4158d00 2024-09-13T16:01:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.426+0000 7fa09be00640 1 --2- 172.21.15.70:0/3146545835 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa08006ac00 0x7fa08006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.426+0000 7fa09be00640 1 --2- 172.21.15.70:0/3146545835 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa08006ac00 0x7fa08006d0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa08c034000 tx=0x7fa08c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:45.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.430+0000 7fa0a0c00640 1 -- 172.21.15.70:0/3146545835 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa094053720 con 0x7fa0a4158d00 2024-09-13T16:01:45.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.598+0000 7fa0ab200640 1 -- 172.21.15.70:0/3146545835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0a406a5b0 con 0x7fa0a4158d00 2024-09-13T16:01:45.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.599+0000 7fa0a0c00640 1 -- 172.21.15.70:0/3146545835 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7fa094056d40 con 0x7fa0a4158d00 2024-09-13T16:01:45.602 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:45.602 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:19.595458+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:45.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.601+0000 7fa0ab200640 1 -- 172.21.15.70:0/3146545835 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa08006ac00 msgr2=0x7fa08006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:45.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.601+0000 7fa0ab200640 1 --2- 172.21.15.70:0/3146545835 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa08006ac00 0x7fa08006d0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa08c034000 tx=0x7fa08c02e000 comp rx=0 tx=0).stop 2024-09-13T16:01:45.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.601+0000 7fa0ab200640 1 -- 172.21.15.70:0/3146545835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0a4158d00 msgr2=0x7fa0a4149a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:45.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.601+0000 7fa0ab200640 1 --2- 172.21.15.70:0/3146545835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0a4158d00 0x7fa0a4149a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa09400c4d0 tx=0x7fa09400c990 comp rx=0 tx=0).stop 2024-09-13T16:01:45.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.602+0000 7fa0ab200640 1 -- 172.21.15.70:0/3146545835 shutdown_connections 2024-09-13T16:01:45.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.602+0000 7fa0ab200640 1 --2- 172.21.15.70:0/3146545835 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa08006ac00 0x7fa08006d0c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.602+0000 7fa0ab200640 1 --2- 172.21.15.70:0/3146545835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0a4159ab0 0x7fa0a40ce170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.602+0000 7fa0ab200640 1 --2- 172.21.15.70:0/3146545835 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0a41590e0 0x7fa0a40cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.602+0000 7fa0ab200640 1 --2- 172.21.15.70:0/3146545835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0a4158d00 0x7fa0a4149a20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.602+0000 7fa0ab200640 1 -- 172.21.15.70:0/3146545835 >> 172.21.15.70:0/3146545835 conn(0x7fa0a40ae480 msgr2=0x7fa0a414a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:45.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.602+0000 7fa0ab200640 1 -- 172.21.15.70:0/3146545835 shutdown_connections 2024-09-13T16:01:45.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.602+0000 7fa0ab200640 1 -- 172.21.15.70:0/3146545835 wait complete. 2024-09-13T16:01:45.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:01:06.070694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:01:16.922043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:01:17.580304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:01:45.620 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:01:45.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.773+0000 7fcd87200640 1 Processor -- start 2024-09-13T16:01:45.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.773+0000 7fcd87200640 1 -- start start 2024-09-13T16:01:45.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.774+0000 7fcd87200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcd881594a0 0x7fcd880cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:45.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.774+0000 7fcd87200640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd880cc370 con 0x7fcd8815d980 2024-09-13T16:01:45.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.774+0000 7fcd87200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd880cd1b0 con 0x7fcd880b2e20 2024-09-13T16:01:45.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.774+0000 7fcd87200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd88159880 con 0x7fcd881594a0 2024-09-13T16:01:45.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.774+0000 7fcd7d400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fcd8815d980 0x7fcd880b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35812/0 (socket says 172.21.15.70:35812) 2024-09-13T16:01:45.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.774+0000 7fcd7d400640 1 -- 172.21.15.70:0/1732796989 learned_addr learned my addr 172.21.15.70:0/1732796989 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:45.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.774+0000 7fcd85e00640 1 --2- 172.21.15.70:0/1732796989 >> v2:172.21.15.107:3300/0 conn(0x7fcd881594a0 0x7fcd880cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:45.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.775+0000 7fcd85400640 1 -- 172.21.15.70:0/1732796989 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867505479 0 0) 0x7fcd880cc370 con 0x7fcd8815d980 2024-09-13T16:01:45.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.775+0000 7fcd85400640 1 -- 172.21.15.70:0/1732796989 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd6c003520 con 0x7fcd8815d980 2024-09-13T16:01:45.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.775+0000 7fcd85400640 1 -- 172.21.15.70:0/1732796989 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898989285 0 0) 0x7fcd880cd1b0 con 0x7fcd880b2e20 2024-09-13T16:01:45.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.775+0000 7fcd85400640 1 -- 172.21.15.70:0/1732796989 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd880cc370 con 0x7fcd880b2e20 2024-09-13T16:01:45.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.775+0000 7fcd85e00640 1 -- 172.21.15.70:0/1732796989 >> v1:172.21.15.107:6789/0 conn(0x7fcd880b2e20 legacy=0x7fcd8806f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:45.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.775+0000 7fcd85e00640 1 -- 172.21.15.70:0/1732796989 >> v1:172.21.15.70:6789/0 conn(0x7fcd8815d980 legacy=0x7fcd880b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:45.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.775+0000 7fcd85e00640 1 -- 172.21.15.70:0/1732796989 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd880cc5a0 con 0x7fcd881594a0 2024-09-13T16:01:45.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.776+0000 7fcd85e00640 1 --2- 172.21.15.70:0/1732796989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd881594a0 0x7fcd880cdf10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcd780097a0 tx=0x7fcd7802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a2638683deb3b30 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:45.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.776+0000 7fcd85400640 1 -- 172.21.15.70:0/1732796989 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78032440 con 0x7fcd881594a0 2024-09-13T16:01:45.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.776+0000 7fcd85400640 1 -- 172.21.15.70:0/1732796989 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd780325a0 con 0x7fcd881594a0 2024-09-13T16:01:45.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.776+0000 7fcd85400640 1 -- 172.21.15.70:0/1732796989 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78032930 con 0x7fcd881594a0 2024-09-13T16:01:45.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.777+0000 7fcd87200640 1 -- 172.21.15.70:0/1732796989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd881594a0 msgr2=0x7fcd880cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:45.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.777+0000 7fcd87200640 1 --2- 172.21.15.70:0/1732796989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd881594a0 0x7fcd880cdf10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcd780097a0 tx=0x7fcd7802a230 comp rx=0 tx=0).stop 2024-09-13T16:01:45.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.777+0000 7fcd87200640 1 -- 172.21.15.70:0/1732796989 shutdown_connections 2024-09-13T16:01:45.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.777+0000 7fcd87200640 1 --2- 172.21.15.70:0/1732796989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd881594a0 0x7fcd880cdf10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.777+0000 7fcd87200640 1 -- 172.21.15.70:0/1732796989 >> 172.21.15.70:0/1732796989 conn(0x7fcd880b0200 msgr2=0x7fcd880b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:45.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.777+0000 7fcd87200640 1 -- 172.21.15.70:0/1732796989 shutdown_connections 2024-09-13T16:01:45.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.777+0000 7fcd87200640 1 -- 172.21.15.70:0/1732796989 wait complete. 2024-09-13T16:01:45.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.779+0000 7fcd87200640 1 Processor -- start 2024-09-13T16:01:45.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.779+0000 7fcd87200640 1 -- start start 2024-09-13T16:01:45.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.780+0000 7fcd87200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd880b2e20 0x7fcd881e3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:45.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.780+0000 7fcd87200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd881594a0 0x7fcd88147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:45.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.780+0000 7fcd87200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd8815d980 0x7fcd8806fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:45.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.780+0000 7fcd87200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd881e3980 con 0x7fcd8815d980 2024-09-13T16:01:45.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.780+0000 7fcd87200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd881e2d90 con 0x7fcd881594a0 2024-09-13T16:01:45.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.780+0000 7fcd87200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd881e2fe0 con 0x7fcd880b2e20 2024-09-13T16:01:45.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.780+0000 7fcd86800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd8815d980 0x7fcd8806fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:45.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.780+0000 7fcd86800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd8815d980 0x7fcd8806fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48260/0 (socket says 172.21.15.70:48260) 2024-09-13T16:01:45.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.780+0000 7fcd86800640 1 -- 172.21.15.70:0/797748406 learned_addr learned my addr 172.21.15.70:0/797748406 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:45.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.780+0000 7fcd85e00640 1 --2- 172.21.15.70:0/797748406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd880b2e20 0x7fcd881e3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:45.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.780+0000 7fcd7d400640 1 --2- 172.21.15.70:0/797748406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd881594a0 0x7fcd88147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:45.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.780+0000 7fcd86800640 1 -- 172.21.15.70:0/797748406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd880b2e20 msgr2=0x7fcd881e3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:45.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.780+0000 7fcd86800640 1 --2- 172.21.15.70:0/797748406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd880b2e20 0x7fcd881e3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.780+0000 7fcd86800640 1 -- 172.21.15.70:0/797748406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd881594a0 msgr2=0x7fcd88147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:45.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.780+0000 7fcd86800640 1 --2- 172.21.15.70:0/797748406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd881594a0 0x7fcd88147ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.781+0000 7fcd86800640 1 -- 172.21.15.70:0/797748406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd78009400 con 0x7fcd8815d980 2024-09-13T16:01:45.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.781+0000 7fcd86800640 1 --2- 172.21.15.70:0/797748406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd8815d980 0x7fcd8806fe80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000c730 tx=0x7fcd8000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:45.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.781+0000 7fcd7ea00640 1 -- 172.21.15.70:0/797748406 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd80003b70 con 0x7fcd8815d980 2024-09-13T16:01:45.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.781+0000 7fcd7ea00640 1 -- 172.21.15.70:0/797748406 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd80003cd0 con 0x7fcd8815d980 2024-09-13T16:01:45.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.781+0000 7fcd7ea00640 1 -- 172.21.15.70:0/797748406 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8000aa90 con 0x7fcd8815d980 2024-09-13T16:01:45.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.781+0000 7fcd87200640 1 -- 172.21.15.70:0/797748406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd881e32c0 con 0x7fcd8815d980 2024-09-13T16:01:45.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.781+0000 7fcd87200640 1 -- 172.21.15.70:0/797748406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd881480e0 con 0x7fcd8815d980 2024-09-13T16:01:45.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.782+0000 7fcd87200640 1 -- 172.21.15.70:0/797748406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd881e3ac0 con 0x7fcd8815d980 2024-09-13T16:01:45.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.783+0000 7fcd7ea00640 1 -- 172.21.15.70:0/797748406 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcd8000abf0 con 0x7fcd8815d980 2024-09-13T16:01:45.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.784+0000 7fcd7ea00640 1 --2- 172.21.15.70:0/797748406 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fcd6406ac00 0x7fcd6406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:45.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.784+0000 7fcd7ea00640 1 -- 172.21.15.70:0/797748406 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd800890c0 con 0x7fcd8815d980 2024-09-13T16:01:45.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.784+0000 7fcd85e00640 1 --2- 172.21.15.70:0/797748406 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fcd6406ac00 0x7fcd6406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:45.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.785+0000 7fcd85e00640 1 --2- 172.21.15.70:0/797748406 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fcd6406ac00 0x7fcd6406d0c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcd78034000 tx=0x7fcd7802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:45.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.788+0000 7fcd7ea00640 1 -- 172.21.15.70:0/797748406 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcd881e3ac0 con 0x7fcd8815d980 2024-09-13T16:01:45.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.959+0000 7fcd87200640 1 -- 172.21.15.70:0/797748406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd881e3ac0 con 0x7fcd8815d980 2024-09-13T16:01:45.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.959+0000 7fcd7ea00640 1 -- 172.21.15.70:0/797748406 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd881e3ac0 con 0x7fcd8815d980 2024-09-13T16:01:45.962 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-13T16:01:45.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.961+0000 7fcd87200640 1 -- 172.21.15.70:0/797748406 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fcd6406ac00 msgr2=0x7fcd6406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:45.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.961+0000 7fcd87200640 1 --2- 172.21.15.70:0/797748406 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fcd6406ac00 0x7fcd6406d0c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcd78034000 tx=0x7fcd7802e000 comp rx=0 tx=0).stop 2024-09-13T16:01:45.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.961+0000 7fcd87200640 1 -- 172.21.15.70:0/797748406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd8815d980 msgr2=0x7fcd8806fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:45.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.961+0000 7fcd87200640 1 --2- 172.21.15.70:0/797748406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd8815d980 0x7fcd8806fe80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000c730 tx=0x7fcd8000cbf0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.961+0000 7fcd87200640 1 -- 172.21.15.70:0/797748406 shutdown_connections 2024-09-13T16:01:45.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.961+0000 7fcd87200640 1 --2- 172.21.15.70:0/797748406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd8815d980 0x7fcd8806fe80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.961+0000 7fcd87200640 1 --2- 172.21.15.70:0/797748406 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fcd6406ac00 0x7fcd6406d0c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.961+0000 7fcd87200640 1 --2- 172.21.15.70:0/797748406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd881594a0 0x7fcd88147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.961+0000 7fcd87200640 1 --2- 172.21.15.70:0/797748406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd880b2e20 0x7fcd881e3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.961+0000 7fcd87200640 1 -- 172.21.15.70:0/797748406 >> 172.21.15.70:0/797748406 conn(0x7fcd880b0200 msgr2=0x7fcd88070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:45.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.962+0000 7fcd87200640 1 -- 172.21.15.70:0/797748406 shutdown_connections 2024-09-13T16:01:45.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:45.962+0000 7fcd87200640 1 -- 172.21.15.70:0/797748406 wait complete. 2024-09-13T16:01:45.980 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:01:46.122 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T16:01:46.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T16:01:46.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.134+0000 7f9267000640 1 Processor -- start 2024-09-13T16:01:46.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.134+0000 7f9267000640 1 -- start start 2024-09-13T16:01:46.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.135+0000 7f9267000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f92600cbac0 0x7f92600cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:46.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.135+0000 7f9267000640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92600ce490 con 0x7f926006f830 2024-09-13T16:01:46.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.135+0000 7f9267000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926006b7c0 con 0x7f9260154ad0 2024-09-13T16:01:46.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.135+0000 7f9267000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92600cc4b0 con 0x7f92600cbac0 2024-09-13T16:01:46.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.135+0000 7f925f400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f926006f830 0x7f926006fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35824/0 (socket says 172.21.15.70:35824) 2024-09-13T16:01:46.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.135+0000 7f925f400640 1 -- 172.21.15.70:0/3434670303 learned_addr learned my addr 172.21.15.70:0/3434670303 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:46.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.136+0000 7f9265000640 1 --2- 172.21.15.70:0/3434670303 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f92600cbac0 0x7f92600cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:46.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.136+0000 7f925ea00640 1 -- 172.21.15.70:0/3434670303 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184106021 0 0) 0x7f92600ce490 con 0x7f926006f830 2024-09-13T16:01:46.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.136+0000 7f925ea00640 1 -- 172.21.15.70:0/3434670303 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9244003520 con 0x7f926006f830 2024-09-13T16:01:46.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.136+0000 7f925ea00640 1 -- 172.21.15.70:0/3434670303 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201090657 0 0) 0x7f926006b7c0 con 0x7f9260154ad0 2024-09-13T16:01:46.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.136+0000 7f925ea00640 1 -- 172.21.15.70:0/3434670303 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92600ce490 con 0x7f9260154ad0 2024-09-13T16:01:46.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.136+0000 7f9265000640 1 -- 172.21.15.70:0/3434670303 >> v1:172.21.15.107:6789/0 conn(0x7f9260154ad0 legacy=0x7f92600cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:46.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.136+0000 7f9265000640 1 -- 172.21.15.70:0/3434670303 >> v1:172.21.15.70:6789/0 conn(0x7f926006f830 legacy=0x7f926006fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:46.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.136+0000 7f9265000640 1 -- 172.21.15.70:0/3434670303 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926006baa0 con 0x7f92600cbac0 2024-09-13T16:01:46.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.137+0000 7f9265000640 1 --2- 172.21.15.70:0/3434670303 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f92600cbac0 0x7f92600cbf70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9258009dc0 tx=0x7f925802a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=948953bc358e0de5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:46.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.138+0000 7f925ea00640 1 -- 172.21.15.70:0/3434670303 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9258007740 con 0x7f92600cbac0 2024-09-13T16:01:46.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.138+0000 7f925ea00640 1 -- 172.21.15.70:0/3434670303 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925802d050 con 0x7f92600cbac0 2024-09-13T16:01:46.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.138+0000 7f925ea00640 1 -- 172.21.15.70:0/3434670303 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9258007ac0 con 0x7f92600cbac0 2024-09-13T16:01:46.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.138+0000 7f9267000640 1 -- 172.21.15.70:0/3434670303 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f92600cbac0 msgr2=0x7f92600cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:46.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.138+0000 7f9267000640 1 --2- 172.21.15.70:0/3434670303 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f92600cbac0 0x7f92600cbf70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9258009dc0 tx=0x7f925802a640 comp rx=0 tx=0).stop 2024-09-13T16:01:46.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.138+0000 7f9267000640 1 -- 172.21.15.70:0/3434670303 shutdown_connections 2024-09-13T16:01:46.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.138+0000 7f9267000640 1 --2- 172.21.15.70:0/3434670303 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f92600cbac0 0x7f92600cbf70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.138+0000 7f9267000640 1 -- 172.21.15.70:0/3434670303 >> 172.21.15.70:0/3434670303 conn(0x7f92600b0580 msgr2=0x7f92600b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:46.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.138+0000 7f9267000640 1 -- 172.21.15.70:0/3434670303 shutdown_connections 2024-09-13T16:01:46.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.138+0000 7f9267000640 1 -- 172.21.15.70:0/3434670303 wait complete. 2024-09-13T16:01:46.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.140+0000 7f9267000640 1 Processor -- start 2024-09-13T16:01:46.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.140+0000 7f9267000640 1 -- start start 2024-09-13T16:01:46.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.141+0000 7f9267000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92600cbac0 0x7f926015cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:46.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.141+0000 7f9267000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9260154ad0 0x7f9260149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:46.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.141+0000 7f9267000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f926014a3f0 0x7f9260151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:46.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.141+0000 7f9267000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926014c370 con 0x7f92600cbac0 2024-09-13T16:01:46.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.141+0000 7f9267000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926014c650 con 0x7f9260154ad0 2024-09-13T16:01:46.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.141+0000 7f9267000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926014c930 con 0x7f926014a3f0 2024-09-13T16:01:46.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.141+0000 7f925fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92600cbac0 0x7f926015cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:46.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.141+0000 7f925fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92600cbac0 0x7f926015cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48272/0 (socket says 172.21.15.70:48272) 2024-09-13T16:01:46.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.141+0000 7f925fe00640 1 -- 172.21.15.70:0/1284082632 learned_addr learned my addr 172.21.15.70:0/1284082632 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:46.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.141+0000 7f925f400640 1 --2- 172.21.15.70:0/1284082632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9260154ad0 0x7f9260149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:46.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.141+0000 7f9265000640 1 --2- 172.21.15.70:0/1284082632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f926014a3f0 0x7f9260151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:46.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.142+0000 7f925fe00640 1 -- 172.21.15.70:0/1284082632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f926014a3f0 msgr2=0x7f9260151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:46.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.142+0000 7f925fe00640 1 --2- 172.21.15.70:0/1284082632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f926014a3f0 0x7f9260151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.142+0000 7f925fe00640 1 -- 172.21.15.70:0/1284082632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9260154ad0 msgr2=0x7f9260149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:46.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.142+0000 7f925fe00640 1 --2- 172.21.15.70:0/1284082632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9260154ad0 0x7f9260149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.142+0000 7f925fe00640 1 -- 172.21.15.70:0/1284082632 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9258009a70 con 0x7f92600cbac0 2024-09-13T16:01:46.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.142+0000 7f925fe00640 1 --2- 172.21.15.70:0/1284082632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92600cbac0 0x7f926015cf70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f925000c430 tx=0x7f925000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:46.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.142+0000 7f9257e00640 1 -- 172.21.15.70:0/1284082632 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92500052d0 con 0x7f92600cbac0 2024-09-13T16:01:46.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.142+0000 7f9257e00640 1 -- 172.21.15.70:0/1284082632 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9250005450 con 0x7f92600cbac0 2024-09-13T16:01:46.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.142+0000 7f9257e00640 1 -- 172.21.15.70:0/1284082632 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250003830 con 0x7f92600cbac0 2024-09-13T16:01:46.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.142+0000 7f9267000640 1 -- 172.21.15.70:0/1284082632 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926014cc10 con 0x7f92600cbac0 2024-09-13T16:01:46.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.142+0000 7f9267000640 1 -- 172.21.15.70:0/1284082632 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926015d4b0 con 0x7f92600cbac0 2024-09-13T16:01:46.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.143+0000 7f9267000640 1 -- 172.21.15.70:0/1284082632 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926015d6d0 con 0x7f92600cbac0 2024-09-13T16:01:46.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.145+0000 7f9257e00640 1 -- 172.21.15.70:0/1284082632 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9250003990 con 0x7f92600cbac0 2024-09-13T16:01:46.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.146+0000 7f9257e00640 1 --2- 172.21.15.70:0/1284082632 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f924006ac00 0x7f924006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:46.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.146+0000 7f9257e00640 1 -- 172.21.15.70:0/1284082632 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92500888a0 con 0x7f92600cbac0 2024-09-13T16:01:46.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.146+0000 7f925f400640 1 --2- 172.21.15.70:0/1284082632 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f924006ac00 0x7f924006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:46.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.147+0000 7f925f400640 1 --2- 172.21.15.70:0/1284082632 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f924006ac00 0x7f924006d0c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f92600cadd0 tx=0x7f924c007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:46.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.150+0000 7f9257e00640 1 -- 172.21.15.70:0/1284082632 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9250053b20 con 0x7f92600cbac0 2024-09-13T16:01:46.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.322+0000 7f9267000640 1 -- 172.21.15.70:0/1284082632 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f92600cbf70 con 0x7f92600cbac0 2024-09-13T16:01:46.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.322+0000 7f9257e00640 1 -- 172.21.15.70:0/1284082632 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9250017020 con 0x7f92600cbac0 2024-09-13T16:01:46.325 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-13T16:01:46.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.324+0000 7f9267000640 1 -- 172.21.15.70:0/1284082632 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f924006ac00 msgr2=0x7f924006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:46.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.324+0000 7f9267000640 1 --2- 172.21.15.70:0/1284082632 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f924006ac00 0x7f924006d0c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f92600cadd0 tx=0x7f924c007d30 comp rx=0 tx=0).stop 2024-09-13T16:01:46.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.324+0000 7f9267000640 1 -- 172.21.15.70:0/1284082632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92600cbac0 msgr2=0x7f926015cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:46.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.324+0000 7f9267000640 1 --2- 172.21.15.70:0/1284082632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92600cbac0 0x7f926015cf70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f925000c430 tx=0x7f925000c8f0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.324+0000 7f9267000640 1 -- 172.21.15.70:0/1284082632 shutdown_connections 2024-09-13T16:01:46.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.325+0000 7f9267000640 1 --2- 172.21.15.70:0/1284082632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f926014a3f0 0x7f9260151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.325+0000 7f9267000640 1 --2- 172.21.15.70:0/1284082632 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f924006ac00 0x7f924006d0c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.325+0000 7f9267000640 1 --2- 172.21.15.70:0/1284082632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9260154ad0 0x7f9260149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.325+0000 7f9267000640 1 --2- 172.21.15.70:0/1284082632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92600cbac0 0x7f926015cf70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.325+0000 7f9267000640 1 -- 172.21.15.70:0/1284082632 >> 172.21.15.70:0/1284082632 conn(0x7f92600b0580 msgr2=0x7f92600cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:46.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.325+0000 7f9267000640 1 -- 172.21.15.70:0/1284082632 shutdown_connections 2024-09-13T16:01:46.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.325+0000 7f9267000640 1 -- 172.21.15.70:0/1284082632 wait complete. 2024-09-13T16:01:46.343 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:01:46.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.497+0000 7f5f86600640 1 Processor -- start 2024-09-13T16:01:46.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.497+0000 7f5f86600640 1 -- start start 2024-09-13T16:01:46.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.498+0000 7f5f86600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5f80154ad0 0x7f5f800cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:46.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.498+0000 7f5f86600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5f8006f830 0x7f5f8006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:46.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.499+0000 7f5f86600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8006b7c0 con 0x7f5f800ce2c0 2024-09-13T16:01:46.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.499+0000 7f5f86600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f8006b5b0 con 0x7f5f80154ad0 2024-09-13T16:01:46.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.499+0000 7f5f86600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8006baa0 con 0x7f5f8006f830 2024-09-13T16:01:46.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.499+0000 7f5f76a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5f8006f830 0x7f5f8006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:46.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.499+0000 7f5f76a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5f8006f830 0x7f5f8006fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:60986/0 (socket says 172.21.15.70:60986) 2024-09-13T16:01:46.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.499+0000 7f5f76a00640 1 -- 172.21.15.70:0/686383192 learned_addr learned my addr 172.21.15.70:0/686383192 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:46.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.499+0000 7f5f7f400640 1 --2- 172.21.15.70:0/686383192 >> v2:172.21.15.107:3300/0 conn(0x7f5f80154ad0 0x7f5f800cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:46.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.500+0000 7f5f76a00640 1 -- 172.21.15.70:0/686383192 >> v2:172.21.15.107:3300/0 conn(0x7f5f80154ad0 msgr2=0x7f5f800cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:46.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.500+0000 7f5f76a00640 1 --2- 172.21.15.70:0/686383192 >> v2:172.21.15.107:3300/0 conn(0x7f5f80154ad0 0x7f5f800cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.500+0000 7f5f76a00640 1 -- 172.21.15.70:0/686383192 >> v1:172.21.15.107:6789/0 conn(0x7f5f800ce2c0 legacy=0x7f5f800cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:46.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.500+0000 7f5f7ea00640 1 -- 172.21.15.70:0/686383192 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279122414 0 0) 0x7f5f8006b7c0 con 0x7f5f800ce2c0 2024-09-13T16:01:46.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.500+0000 7f5f76a00640 1 -- 172.21.15.70:0/686383192 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8006bd80 con 0x7f5f8006f830 2024-09-13T16:01:46.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.501+0000 7f5f76a00640 1 --2- 172.21.15.70:0/686383192 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5f8006f830 0x7f5f8006fee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009870 tx=0x7f5f6802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f6ffe31e573725a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:46.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.501+0000 7f5f7ea00640 1 -- 172.21.15.70:0/686383192 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68032440 con 0x7f5f8006f830 2024-09-13T16:01:46.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.501+0000 7f5f7ea00640 1 -- 172.21.15.70:0/686383192 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f680325a0 con 0x7f5f8006f830 2024-09-13T16:01:46.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.501+0000 7f5f7ea00640 1 -- 172.21.15.70:0/686383192 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68032930 con 0x7f5f8006f830 2024-09-13T16:01:46.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.501+0000 7f5f86600640 1 -- 172.21.15.70:0/686383192 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5f8006f830 msgr2=0x7f5f8006fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:46.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.501+0000 7f5f86600640 1 --2- 172.21.15.70:0/686383192 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5f8006f830 0x7f5f8006fee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009870 tx=0x7f5f6802a1c0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.502+0000 7f5f86600640 1 -- 172.21.15.70:0/686383192 shutdown_connections 2024-09-13T16:01:46.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.502+0000 7f5f86600640 1 --2- 172.21.15.70:0/686383192 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5f8006f830 0x7f5f8006fee0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.502+0000 7f5f86600640 1 --2- 172.21.15.70:0/686383192 >> v2:172.21.15.107:3300/0 conn(0x7f5f80154ad0 0x7f5f800cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.502+0000 7f5f86600640 1 -- 172.21.15.70:0/686383192 >> 172.21.15.70:0/686383192 conn(0x7f5f800b0580 msgr2=0x7f5f800b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:46.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.502+0000 7f5f86600640 1 -- 172.21.15.70:0/686383192 shutdown_connections 2024-09-13T16:01:46.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.502+0000 7f5f86600640 1 -- 172.21.15.70:0/686383192 wait complete. 2024-09-13T16:01:46.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.503+0000 7f5f86600640 1 Processor -- start 2024-09-13T16:01:46.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.503+0000 7f5f86600640 1 -- start start 2024-09-13T16:01:46.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.504+0000 7f5f86600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f80154ad0 0x7f5f8014de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:46.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.504+0000 7f5f86600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5f8013f0c0 0x7f5f80149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:46.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.504+0000 7f5f86600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f80149d40 0x7f5f801520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:46.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.504+0000 7f5f86600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8014b5c0 con 0x7f5f80149d40 2024-09-13T16:01:46.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.504+0000 7f5f86600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f801535b0 con 0x7f5f80154ad0 2024-09-13T16:01:46.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.504+0000 7f5f86600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f80153890 con 0x7f5f8013f0c0 2024-09-13T16:01:46.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.504+0000 7f5f7fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f80149d40 0x7f5f801520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:46.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.505+0000 7f5f76a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5f8013f0c0 0x7f5f80149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:46.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.505+0000 7f5f7fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f80149d40 0x7f5f801520c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48278/0 (socket says 172.21.15.70:48278) 2024-09-13T16:01:46.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.505+0000 7f5f7fe00640 1 -- 172.21.15.70:0/825411401 learned_addr learned my addr 172.21.15.70:0/825411401 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:46.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.505+0000 7f5f7f400640 1 --2- 172.21.15.70:0/825411401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f80154ad0 0x7f5f8014de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:46.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.505+0000 7f5f7fe00640 1 -- 172.21.15.70:0/825411401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5f8013f0c0 msgr2=0x7f5f80149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:46.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.505+0000 7f5f7fe00640 1 --2- 172.21.15.70:0/825411401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5f8013f0c0 0x7f5f80149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.505+0000 7f5f7fe00640 1 -- 172.21.15.70:0/825411401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f80154ad0 msgr2=0x7f5f8014de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:46.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.505+0000 7f5f7fe00640 1 --2- 172.21.15.70:0/825411401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f80154ad0 0x7f5f8014de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.505+0000 7f5f7fe00640 1 -- 172.21.15.70:0/825411401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f680094d0 con 0x7f5f80149d40 2024-09-13T16:01:46.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.505+0000 7f5f7fe00640 1 --2- 172.21.15.70:0/825411401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f80149d40 0x7f5f801520c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5f78001560 tx=0x7f5f7800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:46.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.505+0000 7f5f77e00640 1 -- 172.21.15.70:0/825411401 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f78003da0 con 0x7f5f80149d40 2024-09-13T16:01:46.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.505+0000 7f5f77e00640 1 -- 172.21.15.70:0/825411401 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f78005070 con 0x7f5f80149d40 2024-09-13T16:01:46.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.505+0000 7f5f77e00640 1 -- 172.21.15.70:0/825411401 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f78005420 con 0x7f5f80149d40 2024-09-13T16:01:46.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.505+0000 7f5f86600640 1 -- 172.21.15.70:0/825411401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8014b810 con 0x7f5f80149d40 2024-09-13T16:01:46.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.506+0000 7f5f86600640 1 -- 172.21.15.70:0/825411401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8014a1c0 con 0x7f5f80149d40 2024-09-13T16:01:46.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.507+0000 7f5f86600640 1 -- 172.21.15.70:0/825411401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8014bd30 con 0x7f5f80149d40 2024-09-13T16:01:46.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.508+0000 7f5f77e00640 1 -- 172.21.15.70:0/825411401 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5f78005580 con 0x7f5f80149d40 2024-09-13T16:01:46.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.508+0000 7f5f77e00640 1 --2- 172.21.15.70:0/825411401 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5f5c06ac00 0x7f5f5c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:46.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.508+0000 7f5f77e00640 1 -- 172.21.15.70:0/825411401 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f78088c30 con 0x7f5f80149d40 2024-09-13T16:01:46.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.509+0000 7f5f7f400640 1 --2- 172.21.15.70:0/825411401 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5f5c06ac00 0x7f5f5c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:46.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.509+0000 7f5f7f400640 1 --2- 172.21.15.70:0/825411401 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5f5c06ac00 0x7f5f5c06d0c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009aa0 tx=0x7f5f70009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:46.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.512+0000 7f5f77e00640 1 -- 172.21.15.70:0/825411401 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5f8014bd30 con 0x7f5f80149d40 2024-09-13T16:01:46.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.679+0000 7f5f86600640 1 -- 172.21.15.70:0/825411401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f8014bd30 con 0x7f5f80149d40 2024-09-13T16:01:46.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.680+0000 7f5f77e00640 1 -- 172.21.15.70:0/825411401 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f8014bd30 con 0x7f5f80149d40 2024-09-13T16:01:46.682 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-13T16:01:46.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.682+0000 7f5f86600640 1 -- 172.21.15.70:0/825411401 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5f5c06ac00 msgr2=0x7f5f5c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:46.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.682+0000 7f5f86600640 1 --2- 172.21.15.70:0/825411401 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5f5c06ac00 0x7f5f5c06d0c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009aa0 tx=0x7f5f70009190 comp rx=0 tx=0).stop 2024-09-13T16:01:46.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.682+0000 7f5f86600640 1 -- 172.21.15.70:0/825411401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f80149d40 msgr2=0x7f5f801520c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:46.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.682+0000 7f5f86600640 1 --2- 172.21.15.70:0/825411401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f80149d40 0x7f5f801520c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5f78001560 tx=0x7f5f7800cc70 comp rx=0 tx=0).stop 2024-09-13T16:01:46.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.682+0000 7f5f86600640 1 -- 172.21.15.70:0/825411401 shutdown_connections 2024-09-13T16:01:46.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.682+0000 7f5f86600640 1 --2- 172.21.15.70:0/825411401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f80149d40 0x7f5f801520c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.682+0000 7f5f86600640 1 --2- 172.21.15.70:0/825411401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5f8013f0c0 0x7f5f80149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.682+0000 7f5f86600640 1 --2- 172.21.15.70:0/825411401 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5f5c06ac00 0x7f5f5c06d0c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.682+0000 7f5f86600640 1 --2- 172.21.15.70:0/825411401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f80154ad0 0x7f5f8014de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.682+0000 7f5f86600640 1 -- 172.21.15.70:0/825411401 >> 172.21.15.70:0/825411401 conn(0x7f5f800b0580 msgr2=0x7f5f8015e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:46.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.682+0000 7f5f86600640 1 -- 172.21.15.70:0/825411401 shutdown_connections 2024-09-13T16:01:46.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.682+0000 7f5f86600640 1 -- 172.21.15.70:0/825411401 wait complete. 2024-09-13T16:01:46.700 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:46.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.850+0000 7fae88600640 1 Processor -- start 2024-09-13T16:01:46.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.850+0000 7fae88600640 1 -- start start 2024-09-13T16:01:46.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.852+0000 7fae88600640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fae800b3990 0x7fae80159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.852+0000 7fae88600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fae8006f660 0x7fae8006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.852+0000 7fae88600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae80159fc0 con 0x7fae80153b20 2024-09-13T16:01:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.852+0000 7fae88600640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae800ce600 con 0x7fae800b3990 2024-09-13T16:01:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.852+0000 7fae88600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae80070f90 con 0x7fae8006f660 2024-09-13T16:01:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.852+0000 7fae85200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fae800b3990 0x7fae80159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.852+0000 7fae85200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fae800b3990 0x7fae80159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48282/0 (socket says 172.21.15.70:48282) 2024-09-13T16:01:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.852+0000 7fae85200640 1 -- 172.21.15.70:0/954736965 learned_addr learned my addr 172.21.15.70:0/954736965 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.852+0000 7fae85c00640 1 --1- 172.21.15.70:0/954736965 >> v1:172.21.15.70:6789/0 conn(0x7fae80153b20 0x7fae800b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35834/0 (socket says 172.21.15.70:35834) 2024-09-13T16:01:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.852+0000 7fae86600640 1 --2- 172.21.15.70:0/954736965 >> v2:172.21.15.107:3300/0 conn(0x7fae8006f660 0x7fae8006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.852+0000 7fae85200640 1 -- 172.21.15.70:0/954736965 >> v2:172.21.15.107:3300/0 conn(0x7fae8006f660 msgr2=0x7fae8006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.852+0000 7fae85200640 1 --2- 172.21.15.70:0/954736965 >> v2:172.21.15.107:3300/0 conn(0x7fae8006f660 0x7fae8006fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.852+0000 7fae85200640 1 -- 172.21.15.70:0/954736965 >> v1:172.21.15.70:6789/0 conn(0x7fae80153b20 legacy=0x7fae800b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:46.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.852+0000 7fae85200640 1 -- 172.21.15.70:0/954736965 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae80153f00 con 0x7fae800b3990 2024-09-13T16:01:46.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.852+0000 7fae7fe00640 1 -- 172.21.15.70:0/954736965 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053619705 0 0) 0x7fae80159fc0 con 0x7fae80153b20 2024-09-13T16:01:46.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.854+0000 7fae85200640 1 --2- 172.21.15.70:0/954736965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae800b3990 0x7fae80159a80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fae800cb060 tx=0x7fae6c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e22aca0f471b15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:46.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.854+0000 7fae7fe00640 1 -- 172.21.15.70:0/954736965 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c032440 con 0x7fae800b3990 2024-09-13T16:01:46.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.854+0000 7fae7fe00640 1 -- 172.21.15.70:0/954736965 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c0325a0 con 0x7fae800b3990 2024-09-13T16:01:46.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.854+0000 7fae7fe00640 1 -- 172.21.15.70:0/954736965 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c032930 con 0x7fae800b3990 2024-09-13T16:01:46.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.854+0000 7fae88600640 1 -- 172.21.15.70:0/954736965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae800b3990 msgr2=0x7fae80159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:46.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.854+0000 7fae88600640 1 --2- 172.21.15.70:0/954736965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae800b3990 0x7fae80159a80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fae800cb060 tx=0x7fae6c02a2a0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.854+0000 7fae88600640 1 -- 172.21.15.70:0/954736965 shutdown_connections 2024-09-13T16:01:46.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.854+0000 7fae88600640 1 --2- 172.21.15.70:0/954736965 >> v2:172.21.15.107:3300/0 conn(0x7fae8006f660 0x7fae8006fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.854+0000 7fae88600640 1 --2- 172.21.15.70:0/954736965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae800b3990 0x7fae80159a80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.854+0000 7fae88600640 1 -- 172.21.15.70:0/954736965 >> 172.21.15.70:0/954736965 conn(0x7fae800b0510 msgr2=0x7fae800b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:46.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.854+0000 7fae88600640 1 -- 172.21.15.70:0/954736965 shutdown_connections 2024-09-13T16:01:46.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.855+0000 7fae88600640 1 -- 172.21.15.70:0/954736965 wait complete. 2024-09-13T16:01:46.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.856+0000 7fae88600640 1 Processor -- start 2024-09-13T16:01:46.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.856+0000 7fae88600640 1 -- start start 2024-09-13T16:01:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.857+0000 7fae88600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae8006f660 0x7fae80146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.857+0000 7fae88600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae800b3990 0x7fae800cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.857+0000 7fae88600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae80153b20 0x7fae800cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.857+0000 7fae88600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae80146690 con 0x7fae800b3990 2024-09-13T16:01:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.857+0000 7fae88600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae80159170 con 0x7fae80153b20 2024-09-13T16:01:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.857+0000 7fae88600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8015ba40 con 0x7fae8006f660 2024-09-13T16:01:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.857+0000 7fae85200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae800b3990 0x7fae800cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.858+0000 7fae85200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae800b3990 0x7fae800cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48290/0 (socket says 172.21.15.70:48290) 2024-09-13T16:01:46.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.858+0000 7fae85200640 1 -- 172.21.15.70:0/3257091092 learned_addr learned my addr 172.21.15.70:0/3257091092 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:46.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.858+0000 7fae86600640 1 --2- 172.21.15.70:0/3257091092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae80153b20 0x7fae800cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:46.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.858+0000 7fae85c00640 1 --2- 172.21.15.70:0/3257091092 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae8006f660 0x7fae80146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:46.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.858+0000 7fae85200640 1 -- 172.21.15.70:0/3257091092 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae8006f660 msgr2=0x7fae80146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:46.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.858+0000 7fae85200640 1 --2- 172.21.15.70:0/3257091092 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae8006f660 0x7fae80146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.858+0000 7fae85200640 1 -- 172.21.15.70:0/3257091092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae80153b20 msgr2=0x7fae800cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:46.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.858+0000 7fae85200640 1 --2- 172.21.15.70:0/3257091092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae80153b20 0x7fae800cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:46.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.858+0000 7fae85200640 1 -- 172.21.15.70:0/3257091092 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c0094d0 con 0x7fae800b3990 2024-09-13T16:01:46.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.858+0000 7fae85200640 1 --2- 172.21.15.70:0/3257091092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae800b3990 0x7fae800cd570 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fae6c000c00 tx=0x7fae6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:46.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.859+0000 7fae7d600640 1 -- 172.21.15.70:0/3257091092 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c032440 con 0x7fae800b3990 2024-09-13T16:01:46.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.859+0000 7fae7d600640 1 -- 172.21.15.70:0/3257091092 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c030980 con 0x7fae800b3990 2024-09-13T16:01:46.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.859+0000 7fae7d600640 1 -- 172.21.15.70:0/3257091092 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c030d30 con 0x7fae800b3990 2024-09-13T16:01:46.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.859+0000 7fae88600640 1 -- 172.21.15.70:0/3257091092 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8015bd20 con 0x7fae800b3990 2024-09-13T16:01:46.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.859+0000 7fae88600640 1 -- 172.21.15.70:0/3257091092 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8015c2e0 con 0x7fae800b3990 2024-09-13T16:01:46.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.860+0000 7fae88600640 1 -- 172.21.15.70:0/3257091092 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae8006fa90 con 0x7fae800b3990 2024-09-13T16:01:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.861+0000 7fae7d600640 1 -- 172.21.15.70:0/3257091092 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fae6c039040 con 0x7fae800b3990 2024-09-13T16:01:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.861+0000 7fae7d600640 1 --2- 172.21.15.70:0/3257091092 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fae6006ac00 0x7fae6006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.861+0000 7fae7d600640 1 -- 172.21.15.70:0/3257091092 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae6c0a9b70 con 0x7fae800b3990 2024-09-13T16:01:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.862+0000 7fae85c00640 1 --2- 172.21.15.70:0/3257091092 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fae6006ac00 0x7fae6006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:46.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.862+0000 7fae85c00640 1 --2- 172.21.15.70:0/3257091092 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fae6006ac00 0x7fae6006d0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fae74000f60 tx=0x7fae74007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:46.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:46.865+0000 7fae7d600640 1 -- 172.21.15.70:0/3257091092 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fae6c074df0 con 0x7fae800b3990 2024-09-13T16:01:47.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.035+0000 7fae88600640 1 -- 172.21.15.70:0/3257091092 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae800adec0 con 0x7fae800b3990 2024-09-13T16:01:47.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.036+0000 7fae7d600640 1 -- 172.21.15.70:0/3257091092 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7fae6c078410 con 0x7fae800b3990 2024-09-13T16:01:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:47.039 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:19.595458+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:47.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.038+0000 7fae88600640 1 -- 172.21.15.70:0/3257091092 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fae6006ac00 msgr2=0x7fae6006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:47.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.038+0000 7fae88600640 1 --2- 172.21.15.70:0/3257091092 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fae6006ac00 0x7fae6006d0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fae74000f60 tx=0x7fae74007d50 comp rx=0 tx=0).stop 2024-09-13T16:01:47.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.038+0000 7fae88600640 1 -- 172.21.15.70:0/3257091092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae800b3990 msgr2=0x7fae800cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:47.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.038+0000 7fae88600640 1 --2- 172.21.15.70:0/3257091092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae800b3990 0x7fae800cd570 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fae6c000c00 tx=0x7fae6c0046c0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.038+0000 7fae88600640 1 -- 172.21.15.70:0/3257091092 shutdown_connections 2024-09-13T16:01:47.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.038+0000 7fae88600640 1 --2- 172.21.15.70:0/3257091092 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fae6006ac00 0x7fae6006d0c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.038+0000 7fae88600640 1 --2- 172.21.15.70:0/3257091092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae80153b20 0x7fae800cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.038+0000 7fae88600640 1 --2- 172.21.15.70:0/3257091092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae800b3990 0x7fae800cd570 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.038+0000 7fae88600640 1 --2- 172.21.15.70:0/3257091092 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae8006f660 0x7fae80146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.038+0000 7fae88600640 1 -- 172.21.15.70:0/3257091092 >> 172.21.15.70:0/3257091092 conn(0x7fae800b0510 msgr2=0x7fae8015d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:47.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.038+0000 7fae88600640 1 -- 172.21.15.70:0/3257091092 shutdown_connections 2024-09-13T16:01:47.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.038+0000 7fae88600640 1 -- 172.21.15.70:0/3257091092 wait complete. 2024-09-13T16:01:47.056 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:01:06.070694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:01:16.922043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:01:17.580304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:01:47.056 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:01:47.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.212+0000 7f4662800640 1 Processor -- start 2024-09-13T16:01:47.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.212+0000 7f4662800640 1 -- start start 2024-09-13T16:01:47.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.213+0000 7f4662800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f465c156f60 0x7f465c15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.213+0000 7f4662800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f465c0cafa0 0x7f465c070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.213+0000 7f4662800640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465c06f5f0 con 0x7f465c0714c0 2024-09-13T16:01:47.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.213+0000 7f4662800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465c15aa30 con 0x7f465c0cafa0 2024-09-13T16:01:47.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.213+0000 7f4662800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465c071930 con 0x7f465c156f60 2024-09-13T16:01:47.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.214+0000 7f4652a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f465c0cafa0 0x7f465c070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:47.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.214+0000 7f4652a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f465c0cafa0 0x7f465c070f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48298/0 (socket says 172.21.15.70:48298) 2024-09-13T16:01:47.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.214+0000 7f465be00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f465c0714c0 0x7f465c15d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35840/0 (socket says 172.21.15.70:35840) 2024-09-13T16:01:47.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.214+0000 7f4652a00640 1 -- 172.21.15.70:0/907319795 learned_addr learned my addr 172.21.15.70:0/907319795 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:47.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.214+0000 7f465b400640 1 --2- 172.21.15.70:0/907319795 >> v2:172.21.15.107:3300/0 conn(0x7f465c156f60 0x7f465c15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:47.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.214+0000 7f4652a00640 1 -- 172.21.15.70:0/907319795 >> v2:172.21.15.107:3300/0 conn(0x7f465c156f60 msgr2=0x7f465c15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:47.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.214+0000 7f4652a00640 1 --2- 172.21.15.70:0/907319795 >> v2:172.21.15.107:3300/0 conn(0x7f465c156f60 0x7f465c15a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.214+0000 7f4652a00640 1 -- 172.21.15.70:0/907319795 >> v1:172.21.15.70:6789/0 conn(0x7f465c0714c0 legacy=0x7f465c15d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:47.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.214+0000 7f4652a00640 1 -- 172.21.15.70:0/907319795 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c070450 con 0x7f465c0cafa0 2024-09-13T16:01:47.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.215+0000 7f4652a00640 1 --2- 172.21.15.70:0/907319795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f465c0cafa0 0x7f465c070f80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f465c0cb560 tx=0x7f464402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4703f5ff8e42e35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:47.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.215+0000 7f465aa00640 1 -- 172.21.15.70:0/907319795 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644032440 con 0x7f465c0cafa0 2024-09-13T16:01:47.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.215+0000 7f465aa00640 1 -- 172.21.15.70:0/907319795 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46440325a0 con 0x7f465c0cafa0 2024-09-13T16:01:47.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.215+0000 7f465aa00640 1 -- 172.21.15.70:0/907319795 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644032930 con 0x7f465c0cafa0 2024-09-13T16:01:47.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.216+0000 7f4662800640 1 -- 172.21.15.70:0/907319795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f465c0cafa0 msgr2=0x7f465c070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:47.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.216+0000 7f4662800640 1 --2- 172.21.15.70:0/907319795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f465c0cafa0 0x7f465c070f80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f465c0cb560 tx=0x7f464402a270 comp rx=0 tx=0).stop 2024-09-13T16:01:47.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.216+0000 7f4662800640 1 -- 172.21.15.70:0/907319795 shutdown_connections 2024-09-13T16:01:47.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.216+0000 7f4662800640 1 --2- 172.21.15.70:0/907319795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f465c0cafa0 0x7f465c070f80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.216+0000 7f4662800640 1 --2- 172.21.15.70:0/907319795 >> v2:172.21.15.107:3300/0 conn(0x7f465c156f60 0x7f465c15a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.216+0000 7f4662800640 1 -- 172.21.15.70:0/907319795 >> 172.21.15.70:0/907319795 conn(0x7f465c0b0580 msgr2=0x7f465c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:47.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.216+0000 7f4662800640 1 -- 172.21.15.70:0/907319795 shutdown_connections 2024-09-13T16:01:47.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.216+0000 7f4662800640 1 -- 172.21.15.70:0/907319795 wait complete. 2024-09-13T16:01:47.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.218+0000 7f4662800640 1 Processor -- start 2024-09-13T16:01:47.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.218+0000 7f4662800640 1 -- start start 2024-09-13T16:01:47.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.219+0000 7f4662800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c0714c0 0x7f465c15d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.219+0000 7f4662800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f465c0cafa0 0x7f465c0c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.219+0000 7f4662800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f465c156f60 0x7f465c13b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.219+0000 7f4662800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c153090 con 0x7f465c156f60 2024-09-13T16:01:47.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.219+0000 7f4662800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c1532e0 con 0x7f465c0714c0 2024-09-13T16:01:47.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.219+0000 7f4662800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465c1535c0 con 0x7f465c0cafa0 2024-09-13T16:01:47.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.219+0000 7f465be00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f465c156f60 0x7f465c13b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:47.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.219+0000 7f465be00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f465c156f60 0x7f465c13b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48308/0 (socket says 172.21.15.70:48308) 2024-09-13T16:01:47.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.219+0000 7f465be00640 1 -- 172.21.15.70:0/3938296001 learned_addr learned my addr 172.21.15.70:0/3938296001 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:47.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.219+0000 7f4652a00640 1 --2- 172.21.15.70:0/3938296001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f465c0cafa0 0x7f465c0c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:47.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.219+0000 7f465b400640 1 --2- 172.21.15.70:0/3938296001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c0714c0 0x7f465c15d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:47.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.219+0000 7f465be00640 1 -- 172.21.15.70:0/3938296001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f465c0cafa0 msgr2=0x7f465c0c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:47.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.219+0000 7f465be00640 1 --2- 172.21.15.70:0/3938296001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f465c0cafa0 0x7f465c0c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.219+0000 7f465be00640 1 -- 172.21.15.70:0/3938296001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c0714c0 msgr2=0x7f465c15d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:47.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.219+0000 7f465be00640 1 --2- 172.21.15.70:0/3938296001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c0714c0 0x7f465c15d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.219+0000 7f465be00640 1 -- 172.21.15.70:0/3938296001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46440094d0 con 0x7f465c156f60 2024-09-13T16:01:47.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.220+0000 7f465be00640 1 --2- 172.21.15.70:0/3938296001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f465c156f60 0x7f465c13b070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f465400c780 tx=0x7f465400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:47.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.220+0000 7f4653e00640 1 -- 172.21.15.70:0/3938296001 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465400ce90 con 0x7f465c156f60 2024-09-13T16:01:47.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.220+0000 7f4653e00640 1 -- 172.21.15.70:0/3938296001 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465400a640 con 0x7f465c156f60 2024-09-13T16:01:47.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.220+0000 7f4653e00640 1 -- 172.21.15.70:0/3938296001 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465400a9f0 con 0x7f465c156f60 2024-09-13T16:01:47.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.220+0000 7f4662800640 1 -- 172.21.15.70:0/3938296001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465c0c8d60 con 0x7f465c156f60 2024-09-13T16:01:47.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.220+0000 7f4662800640 1 -- 172.21.15.70:0/3938296001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465c1538a0 con 0x7f465c156f60 2024-09-13T16:01:47.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.221+0000 7f4662800640 1 -- 172.21.15.70:0/3938296001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f465c0c9280 con 0x7f465c156f60 2024-09-13T16:01:47.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.222+0000 7f4653e00640 1 -- 172.21.15.70:0/3938296001 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f465400ab50 con 0x7f465c156f60 2024-09-13T16:01:47.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.223+0000 7f4653e00640 1 --2- 172.21.15.70:0/3938296001 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f463806ac30 0x7f463806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.223+0000 7f4653e00640 1 -- 172.21.15.70:0/3938296001 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4654088b40 con 0x7f465c156f60 2024-09-13T16:01:47.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.223+0000 7f465b400640 1 --2- 172.21.15.70:0/3938296001 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f463806ac30 0x7f463806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:47.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.224+0000 7f465b400640 1 --2- 172.21.15.70:0/3938296001 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f463806ac30 0x7f463806d0f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f464c0079a0 tx=0x7f464c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:47.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.227+0000 7f4653e00640 1 -- 172.21.15.70:0/3938296001 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f465c0c9280 con 0x7f465c156f60 2024-09-13T16:01:47.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.394+0000 7f4662800640 1 -- 172.21.15.70:0/3938296001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f465c0c9280 con 0x7f465c156f60 2024-09-13T16:01:47.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.395+0000 7f4653e00640 1 -- 172.21.15.70:0/3938296001 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f465c0c9280 con 0x7f465c156f60 2024-09-13T16:01:47.397 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-13T16:01:47.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.397+0000 7f4662800640 1 -- 172.21.15.70:0/3938296001 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f463806ac30 msgr2=0x7f463806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:47.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.397+0000 7f4662800640 1 --2- 172.21.15.70:0/3938296001 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f463806ac30 0x7f463806d0f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f464c0079a0 tx=0x7f464c008040 comp rx=0 tx=0).stop 2024-09-13T16:01:47.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.397+0000 7f4662800640 1 -- 172.21.15.70:0/3938296001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f465c156f60 msgr2=0x7f465c13b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:47.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.397+0000 7f4662800640 1 --2- 172.21.15.70:0/3938296001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f465c156f60 0x7f465c13b070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f465400c780 tx=0x7f465400cc40 comp rx=0 tx=0).stop 2024-09-13T16:01:47.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.397+0000 7f4662800640 1 -- 172.21.15.70:0/3938296001 shutdown_connections 2024-09-13T16:01:47.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.397+0000 7f4662800640 1 --2- 172.21.15.70:0/3938296001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f465c156f60 0x7f465c13b070 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.397+0000 7f4662800640 1 --2- 172.21.15.70:0/3938296001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f465c0cafa0 0x7f465c0c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.397+0000 7f4662800640 1 --2- 172.21.15.70:0/3938296001 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f463806ac30 0x7f463806d0f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.397+0000 7f4662800640 1 --2- 172.21.15.70:0/3938296001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c0714c0 0x7f465c15d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.397+0000 7f4662800640 1 -- 172.21.15.70:0/3938296001 >> 172.21.15.70:0/3938296001 conn(0x7f465c0b0580 msgr2=0x7f465c15a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:47.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.397+0000 7f4662800640 1 -- 172.21.15.70:0/3938296001 shutdown_connections 2024-09-13T16:01:47.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.397+0000 7f4662800640 1 -- 172.21.15.70:0/3938296001 wait complete. 2024-09-13T16:01:47.415 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:01:47.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.567+0000 7f79ae000640 1 Processor -- start 2024-09-13T16:01:47.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.567+0000 7f79ae000640 1 -- start start 2024-09-13T16:01:47.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.568+0000 7f79ae000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f79a8154ad0 0x7f79a80cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.569+0000 7f79ae000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f79a806f830 0x7f79a806fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.569+0000 7f79ae000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a80ce2c0 0x7f79a80cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.569+0000 7f79ae000640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a806b5b0 con 0x7f79a8154ad0 2024-09-13T16:01:47.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.569+0000 7f79ae000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a806b7c0 con 0x7f79a806f830 2024-09-13T16:01:47.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.569+0000 7f79ae000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a806baa0 con 0x7f79a80ce2c0 2024-09-13T16:01:47.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.569+0000 7f79a7400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f79a8154ad0 0x7f79a80cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:47.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.569+0000 7f79a7400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f79a8154ad0 0x7f79a80cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48312/0 (socket says 172.21.15.70:48312) 2024-09-13T16:01:47.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.569+0000 7f79a7400640 1 -- 172.21.15.70:0/3357579131 learned_addr learned my addr 172.21.15.70:0/3357579131 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:47.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.569+0000 7f79a7400640 1 -- 172.21.15.70:0/3357579131 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a80ce2c0 msgr2=0x7f79a80cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.569+0000 7f79a7400640 1 --2- 172.21.15.70:0/3357579131 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a80ce2c0 0x7f79a80cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.569+0000 7f79a7400640 1 -- 172.21.15.70:0/3357579131 >> v2:172.21.15.107:3300/0 conn(0x7f79a806f830 msgr2=0x7f79a806fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.569+0000 7f79a7400640 1 --2- 172.21.15.70:0/3357579131 >> v2:172.21.15.107:3300/0 conn(0x7f79a806f830 0x7f79a806fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.569+0000 7f79a7400640 1 -- 172.21.15.70:0/3357579131 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a806bd80 con 0x7f79a8154ad0 2024-09-13T16:01:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.570+0000 7f79a7400640 1 --2- 172.21.15.70:0/3357579131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8154ad0 0x7f79a80cdd80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f79a80ae4c0 tx=0x7f799802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b70930a4c5ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.570+0000 7f79a6000640 1 -- 172.21.15.70:0/3357579131 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799802ae90 con 0x7f79a8154ad0 2024-09-13T16:01:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.570+0000 7f79a6000640 1 -- 172.21.15.70:0/3357579131 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7998032440 con 0x7f79a8154ad0 2024-09-13T16:01:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.570+0000 7f79a6000640 1 -- 172.21.15.70:0/3357579131 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79980327d0 con 0x7f79a8154ad0 2024-09-13T16:01:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.571+0000 7f79ae000640 1 -- 172.21.15.70:0/3357579131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8154ad0 msgr2=0x7f79a80cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.571+0000 7f79ae000640 1 --2- 172.21.15.70:0/3357579131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8154ad0 0x7f79a80cdd80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f79a80ae4c0 tx=0x7f799802a140 comp rx=0 tx=0).stop 2024-09-13T16:01:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.571+0000 7f79ae000640 1 -- 172.21.15.70:0/3357579131 shutdown_connections 2024-09-13T16:01:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.571+0000 7f79ae000640 1 --2- 172.21.15.70:0/3357579131 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a80ce2c0 0x7f79a80cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.571+0000 7f79ae000640 1 --2- 172.21.15.70:0/3357579131 >> v2:172.21.15.107:3300/0 conn(0x7f79a806f830 0x7f79a806fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.571+0000 7f79ae000640 1 --2- 172.21.15.70:0/3357579131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8154ad0 0x7f79a80cdd80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.571+0000 7f79ae000640 1 -- 172.21.15.70:0/3357579131 >> 172.21.15.70:0/3357579131 conn(0x7f79a80b0580 msgr2=0x7f79a80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:47.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.571+0000 7f79ae000640 1 -- 172.21.15.70:0/3357579131 shutdown_connections 2024-09-13T16:01:47.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.571+0000 7f79ae000640 1 -- 172.21.15.70:0/3357579131 wait complete. 2024-09-13T16:01:47.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.573+0000 7f79ae000640 1 Processor -- start 2024-09-13T16:01:47.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.573+0000 7f79ae000640 1 -- start start 2024-09-13T16:01:47.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.574+0000 7f79ae000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8154ad0 0x7f79a8147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.574+0000 7f79ae000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a81f0130 0x7f79a815e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.574+0000 7f79ae000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a815ec40 0x7f79a8151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.574+0000 7f79ae000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a814efe0 con 0x7f79a8154ad0 2024-09-13T16:01:47.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.574+0000 7f79ae000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a81475d0 con 0x7f79a815ec40 2024-09-13T16:01:47.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.574+0000 7f79ae000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a814b660 con 0x7f79a81f0130 2024-09-13T16:01:47.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.574+0000 7f79a7400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8154ad0 0x7f79a8147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:47.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.574+0000 7f79a7400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8154ad0 0x7f79a8147090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48328/0 (socket says 172.21.15.70:48328) 2024-09-13T16:01:47.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.574+0000 7f79a7400640 1 -- 172.21.15.70:0/1638349930 learned_addr learned my addr 172.21.15.70:0/1638349930 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:47.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.574+0000 7f79a7400640 1 -- 172.21.15.70:0/1638349930 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a81f0130 msgr2=0x7f79a815e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:47.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.574+0000 7f79a7400640 1 --2- 172.21.15.70:0/1638349930 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a81f0130 0x7f79a815e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.574+0000 7f79a7400640 1 -- 172.21.15.70:0/1638349930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a815ec40 msgr2=0x7f79a8151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:47.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.574+0000 7f79a7e00640 1 --2- 172.21.15.70:0/1638349930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a815ec40 0x7f79a8151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:47.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.574+0000 7f79a7400640 1 --2- 172.21.15.70:0/1638349930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a815ec40 0x7f79a8151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.574+0000 7f79a7400640 1 -- 172.21.15.70:0/1638349930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79980094d0 con 0x7f79a8154ad0 2024-09-13T16:01:47.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.574+0000 7f79a7e00640 1 --2- 172.21.15.70:0/1638349930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a815ec40 0x7f79a8151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:47.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.575+0000 7f79a7400640 1 --2- 172.21.15.70:0/1638349930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8154ad0 0x7f79a8147090 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f799802a180 tx=0x7f79980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:47.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.575+0000 7f799f400640 1 -- 172.21.15.70:0/1638349930 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998030950 con 0x7f79a8154ad0 2024-09-13T16:01:47.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.575+0000 7f799f400640 1 -- 172.21.15.70:0/1638349930 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7998030ab0 con 0x7f79a8154ad0 2024-09-13T16:01:47.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.575+0000 7f799f400640 1 -- 172.21.15.70:0/1638349930 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998030e60 con 0x7f79a8154ad0 2024-09-13T16:01:47.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.575+0000 7f79ae000640 1 -- 172.21.15.70:0/1638349930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a814b940 con 0x7f79a8154ad0 2024-09-13T16:01:47.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.575+0000 7f79ae000640 1 -- 172.21.15.70:0/1638349930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a814bf00 con 0x7f79a8154ad0 2024-09-13T16:01:47.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.576+0000 7f79ae000640 1 -- 172.21.15.70:0/1638349930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a806fee0 con 0x7f79a8154ad0 2024-09-13T16:01:47.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.577+0000 7f799f400640 1 -- 172.21.15.70:0/1638349930 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7998039040 con 0x7f79a8154ad0 2024-09-13T16:01:47.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.578+0000 7f799f400640 1 --2- 172.21.15.70:0/1638349930 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f798806ac00 0x7f798806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.578+0000 7f799f400640 1 -- 172.21.15.70:0/1638349930 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79980a9c30 con 0x7f79a8154ad0 2024-09-13T16:01:47.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.579+0000 7f79a6a00640 1 --2- 172.21.15.70:0/1638349930 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f798806ac00 0x7f798806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:47.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.579+0000 7f79a6a00640 1 --2- 172.21.15.70:0/1638349930 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f798806ac00 0x7f798806d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f79a8149d50 tx=0x7f7994006bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:47.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.582+0000 7f799f400640 1 -- 172.21.15.70:0/1638349930 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7998074e10 con 0x7f79a8154ad0 2024-09-13T16:01:47.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.751+0000 7f79ae000640 1 -- 172.21.15.70:0/1638349930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f79a8073630 con 0x7f79a8154ad0 2024-09-13T16:01:47.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.751+0000 7f799f400640 1 -- 172.21.15.70:0/1638349930 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7998037020 con 0x7f79a8154ad0 2024-09-13T16:01:47.753 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-13T16:01:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.753+0000 7f79ae000640 1 -- 172.21.15.70:0/1638349930 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f798806ac00 msgr2=0x7f798806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.753+0000 7f79ae000640 1 --2- 172.21.15.70:0/1638349930 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f798806ac00 0x7f798806d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f79a8149d50 tx=0x7f7994006bf0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.753+0000 7f79ae000640 1 -- 172.21.15.70:0/1638349930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8154ad0 msgr2=0x7f79a8147090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.753+0000 7f79ae000640 1 --2- 172.21.15.70:0/1638349930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8154ad0 0x7f79a8147090 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f799802a180 tx=0x7f79980046c0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.753+0000 7f79ae000640 1 -- 172.21.15.70:0/1638349930 shutdown_connections 2024-09-13T16:01:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.753+0000 7f79ae000640 1 --2- 172.21.15.70:0/1638349930 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f798806ac00 0x7f798806d0c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.753+0000 7f79ae000640 1 --2- 172.21.15.70:0/1638349930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79a815ec40 0x7f79a8151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.753+0000 7f79ae000640 1 --2- 172.21.15.70:0/1638349930 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79a81f0130 0x7f79a815e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.753+0000 7f79ae000640 1 --2- 172.21.15.70:0/1638349930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8154ad0 0x7f79a8147090 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.753+0000 7f79ae000640 1 -- 172.21.15.70:0/1638349930 >> 172.21.15.70:0/1638349930 conn(0x7f79a80b0580 msgr2=0x7f79a815c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.753+0000 7f79ae000640 1 -- 172.21.15.70:0/1638349930 shutdown_connections 2024-09-13T16:01:47.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.753+0000 7f79ae000640 1 -- 172.21.15.70:0/1638349930 wait complete. 2024-09-13T16:01:47.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:01:47.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.923+0000 7f519f200640 1 Processor -- start 2024-09-13T16:01:47.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.923+0000 7f519f200640 1 -- start start 2024-09-13T16:01:47.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519f200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f519815a420 0x7f51980b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51980cbb00 0x7f51980cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519f200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f51980cbf40 0x7f51980cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519f200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51980b30e0 con 0x7f51980cbf40 2024-09-13T16:01:47.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519f200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51980ce020 con 0x7f519815a420 2024-09-13T16:01:47.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519815a800 con 0x7f51980cbb00 2024-09-13T16:01:47.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519e800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f51980cbf40 0x7f51980cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:47.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519e800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f51980cbf40 0x7f51980cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48334/0 (socket says 172.21.15.70:48334) 2024-09-13T16:01:47.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519e800640 1 -- 172.21.15.70:0/298171463 learned_addr learned my addr 172.21.15.70:0/298171463 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:47.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519d400640 1 --2- 172.21.15.70:0/298171463 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51980cbb00 0x7f51980cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:47.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519e800640 1 -- 172.21.15.70:0/298171463 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51980cbb00 msgr2=0x7f51980cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:47.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519de00640 1 --2- 172.21.15.70:0/298171463 >> v2:172.21.15.107:3300/0 conn(0x7f519815a420 0x7f51980b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:47.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519e800640 1 --2- 172.21.15.70:0/298171463 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51980cbb00 0x7f51980cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519e800640 1 -- 172.21.15.70:0/298171463 >> v2:172.21.15.107:3300/0 conn(0x7f519815a420 msgr2=0x7f51980b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:47.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519e800640 1 --2- 172.21.15.70:0/298171463 >> v2:172.21.15.107:3300/0 conn(0x7f519815a420 0x7f51980b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519e800640 1 -- 172.21.15.70:0/298171463 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51980b24d0 con 0x7f51980cbf40 2024-09-13T16:01:47.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519d400640 1 --2- 172.21.15.70:0/298171463 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51980cbb00 0x7f51980cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:47.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519de00640 1 --2- 172.21.15.70:0/298171463 >> v2:172.21.15.107:3300/0 conn(0x7f519815a420 0x7f51980b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:47.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.926+0000 7f519e800640 1 --2- 172.21.15.70:0/298171463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51980cbf40 0x7f51980cdae0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5198071820 tx=0x7f519402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2434d0617e1ad7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:47.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.927+0000 7f519ca00640 1 -- 172.21.15.70:0/298171463 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5194031600 con 0x7f51980cbf40 2024-09-13T16:01:47.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.927+0000 7f519ca00640 1 -- 172.21.15.70:0/298171463 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519402d050 con 0x7f51980cbf40 2024-09-13T16:01:47.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.927+0000 7f519ca00640 1 -- 172.21.15.70:0/298171463 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5194031980 con 0x7f51980cbf40 2024-09-13T16:01:47.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.927+0000 7f519f200640 1 -- 172.21.15.70:0/298171463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51980cbf40 msgr2=0x7f51980cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:47.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.927+0000 7f519f200640 1 --2- 172.21.15.70:0/298171463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51980cbf40 0x7f51980cdae0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5198071820 tx=0x7f519402a6a0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.927+0000 7f519f200640 1 -- 172.21.15.70:0/298171463 shutdown_connections 2024-09-13T16:01:47.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.927+0000 7f519f200640 1 --2- 172.21.15.70:0/298171463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51980cbf40 0x7f51980cdae0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.927+0000 7f519f200640 1 --2- 172.21.15.70:0/298171463 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51980cbb00 0x7f51980cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.927+0000 7f519f200640 1 --2- 172.21.15.70:0/298171463 >> v2:172.21.15.107:3300/0 conn(0x7f519815a420 0x7f51980b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.927+0000 7f519f200640 1 -- 172.21.15.70:0/298171463 >> 172.21.15.70:0/298171463 conn(0x7f5198069ed0 msgr2=0x7f519806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:47.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.927+0000 7f519f200640 1 -- 172.21.15.70:0/298171463 shutdown_connections 2024-09-13T16:01:47.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.927+0000 7f519f200640 1 -- 172.21.15.70:0/298171463 wait complete. 2024-09-13T16:01:47.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.929+0000 7f519f200640 1 Processor -- start 2024-09-13T16:01:47.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.929+0000 7f519f200640 1 -- start start 2024-09-13T16:01:47.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.930+0000 7f519f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51980cbb00 0x7f5198151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.930+0000 7f519f200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51980cbf40 0x7f519815bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.930+0000 7f519f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f519815a420 0x7f519814aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.930+0000 7f519f200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51981508d0 con 0x7f51980cbf40 2024-09-13T16:01:47.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.930+0000 7f519f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5198150bb0 con 0x7f519815a420 2024-09-13T16:01:47.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.930+0000 7f519f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5198150e90 con 0x7f51980cbb00 2024-09-13T16:01:47.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.930+0000 7f519d400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51980cbf40 0x7f519815bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:47.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.930+0000 7f519d400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51980cbf40 0x7f519815bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48342/0 (socket says 172.21.15.70:48342) 2024-09-13T16:01:47.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.930+0000 7f519d400640 1 -- 172.21.15.70:0/1221985913 learned_addr learned my addr 172.21.15.70:0/1221985913 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:47.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.930+0000 7f519de00640 1 --2- 172.21.15.70:0/1221985913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51980cbb00 0x7f5198151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:47.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.930+0000 7f519e800640 1 --2- 172.21.15.70:0/1221985913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f519815a420 0x7f519814aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:47.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.931+0000 7f519d400640 1 -- 172.21.15.70:0/1221985913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51980cbb00 msgr2=0x7f5198151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:47.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.931+0000 7f519d400640 1 --2- 172.21.15.70:0/1221985913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51980cbb00 0x7f5198151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.931+0000 7f519d400640 1 -- 172.21.15.70:0/1221985913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f519815a420 msgr2=0x7f519814aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:47.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.931+0000 7f519d400640 1 --2- 172.21.15.70:0/1221985913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f519815a420 0x7f519814aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:47.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.931+0000 7f519d400640 1 -- 172.21.15.70:0/1221985913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5194009b30 con 0x7f51980cbf40 2024-09-13T16:01:47.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.931+0000 7f519e800640 1 --2- 172.21.15.70:0/1221985913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f519815a420 0x7f519814aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:47.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.931+0000 7f519d400640 1 --2- 172.21.15.70:0/1221985913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51980cbf40 0x7f519815bf90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f518800c7f0 tx=0x7f518800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:47.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.931+0000 7f5192000640 1 -- 172.21.15.70:0/1221985913 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518800cea0 con 0x7f51980cbf40 2024-09-13T16:01:47.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.931+0000 7f5192000640 1 -- 172.21.15.70:0/1221985913 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5188004230 con 0x7f51980cbf40 2024-09-13T16:01:47.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.931+0000 7f5192000640 1 -- 172.21.15.70:0/1221985913 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188007830 con 0x7f51980cbf40 2024-09-13T16:01:47.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.931+0000 7f519f200640 1 -- 172.21.15.70:0/1221985913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5198151170 con 0x7f51980cbf40 2024-09-13T16:01:47.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.931+0000 7f519f200640 1 -- 172.21.15.70:0/1221985913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519815db00 con 0x7f51980cbf40 2024-09-13T16:01:47.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.932+0000 7f519f200640 1 -- 172.21.15.70:0/1221985913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5198159be0 con 0x7f51980cbf40 2024-09-13T16:01:47.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.933+0000 7f5192000640 1 -- 172.21.15.70:0/1221985913 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5188007990 con 0x7f51980cbf40 2024-09-13T16:01:47.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.934+0000 7f5192000640 1 --2- 172.21.15.70:0/1221985913 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f517c06ac00 0x7f517c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:47.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.934+0000 7f5192000640 1 -- 172.21.15.70:0/1221985913 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51880892c0 con 0x7f51980cbf40 2024-09-13T16:01:47.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.934+0000 7f519de00640 1 --2- 172.21.15.70:0/1221985913 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f517c06ac00 0x7f517c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:47.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.935+0000 7f519de00640 1 --2- 172.21.15.70:0/1221985913 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f517c06ac00 0x7f517c06d0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f518c00aa40 tx=0x7f518c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:47.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:47.938+0000 7f5192000640 1 -- 172.21.15.70:0/1221985913 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f51880544b0 con 0x7f51980cbf40 2024-09-13T16:01:48.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.108+0000 7f519f200640 1 -- 172.21.15.70:0/1221985913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f51980af080 con 0x7f51980cbf40 2024-09-13T16:01:48.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.109+0000 7f5192000640 1 -- 172.21.15.70:0/1221985913 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5188057ad0 con 0x7f51980cbf40 2024-09-13T16:01:48.112 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-13T16:01:48.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.111+0000 7f519f200640 1 -- 172.21.15.70:0/1221985913 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f517c06ac00 msgr2=0x7f517c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:48.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.111+0000 7f519f200640 1 --2- 172.21.15.70:0/1221985913 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f517c06ac00 0x7f517c06d0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f518c00aa40 tx=0x7f518c008040 comp rx=0 tx=0).stop 2024-09-13T16:01:48.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.111+0000 7f519f200640 1 -- 172.21.15.70:0/1221985913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51980cbf40 msgr2=0x7f519815bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:48.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.111+0000 7f519f200640 1 --2- 172.21.15.70:0/1221985913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51980cbf40 0x7f519815bf90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f518800c7f0 tx=0x7f518800ccb0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.111+0000 7f519f200640 1 -- 172.21.15.70:0/1221985913 shutdown_connections 2024-09-13T16:01:48.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.111+0000 7f519f200640 1 --2- 172.21.15.70:0/1221985913 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f517c06ac00 0x7f517c06d0c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.111+0000 7f519f200640 1 --2- 172.21.15.70:0/1221985913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f519815a420 0x7f519814aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.111+0000 7f519f200640 1 --2- 172.21.15.70:0/1221985913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51980cbf40 0x7f519815bf90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.111+0000 7f519f200640 1 --2- 172.21.15.70:0/1221985913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51980cbb00 0x7f5198151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.111+0000 7f519f200640 1 -- 172.21.15.70:0/1221985913 >> 172.21.15.70:0/1221985913 conn(0x7f5198069ed0 msgr2=0x7f51981567f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:48.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.111+0000 7f519f200640 1 -- 172.21.15.70:0/1221985913 shutdown_connections 2024-09-13T16:01:48.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.111+0000 7f519f200640 1 -- 172.21.15.70:0/1221985913 wait complete. 2024-09-13T16:01:48.130 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:48.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.280+0000 7f5468200640 1 Processor -- start 2024-09-13T16:01:48.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.280+0000 7f5468200640 1 -- start start 2024-09-13T16:01:48.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.280+0000 7f5468200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f54600b3990 0x7f5460159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:48.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.280+0000 7f5468200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f546006f660 0x7f546006fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:48.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.280+0000 7f5468200640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5460159fc0 con 0x7f5460153b20 2024-09-13T16:01:48.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.280+0000 7f5468200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54600ce600 con 0x7f54600b3990 2024-09-13T16:01:48.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.280+0000 7f5468200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5460070f90 con 0x7f546006f660 2024-09-13T16:01:48.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.280+0000 7f5465800640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5460153b20 0x7f54600b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35852/0 (socket says 172.21.15.70:35852) 2024-09-13T16:01:48.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.281+0000 7f5465800640 1 -- 172.21.15.70:0/668454131 learned_addr learned my addr 172.21.15.70:0/668454131 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:48.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.281+0000 7f5464e00640 1 --2- 172.21.15.70:0/668454131 >> v2:172.21.15.107:3300/0 conn(0x7f54600b3990 0x7f5460159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:48.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.281+0000 7f5466200640 1 --2- 172.21.15.70:0/668454131 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f546006f660 0x7f546006fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:48.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.281+0000 7f545fe00640 1 -- 172.21.15.70:0/668454131 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128108026 0 0) 0x7f5460159fc0 con 0x7f5460153b20 2024-09-13T16:01:48.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.281+0000 7f545fe00640 1 -- 172.21.15.70:0/668454131 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5448005730 con 0x7f5460153b20 2024-09-13T16:01:48.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.281+0000 7f5466200640 1 -- 172.21.15.70:0/668454131 >> v2:172.21.15.107:3300/0 conn(0x7f54600b3990 msgr2=0x7f5460159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:48.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.281+0000 7f5466200640 1 --2- 172.21.15.70:0/668454131 >> v2:172.21.15.107:3300/0 conn(0x7f54600b3990 0x7f5460159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.281+0000 7f5466200640 1 -- 172.21.15.70:0/668454131 >> v1:172.21.15.70:6789/0 conn(0x7f5460153b20 legacy=0x7f54600b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:48.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.281+0000 7f545fe00640 1 -- 172.21.15.70:0/668454131 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2499136207 0 0) 0x7f5448005730 con 0x7f5460153b20 2024-09-13T16:01:48.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.281+0000 7f5466200640 1 -- 172.21.15.70:0/668454131 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5460153f00 con 0x7f546006f660 2024-09-13T16:01:48.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.281+0000 7f5464e00640 1 --2- 172.21.15.70:0/668454131 >> v2:172.21.15.107:3300/0 conn(0x7f54600b3990 0x7f5460159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:48.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.283+0000 7f5466200640 1 --2- 172.21.15.70:0/668454131 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f546006f660 0x7f546006fad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5458009d90 tx=0x7f545802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbaa6ac733ea65fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.283+0000 7f545fe00640 1 -- 172.21.15.70:0/668454131 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458007740 con 0x7f546006f660 2024-09-13T16:01:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.283+0000 7f545fe00640 1 -- 172.21.15.70:0/668454131 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545802d050 con 0x7f546006f660 2024-09-13T16:01:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.283+0000 7f545fe00640 1 -- 172.21.15.70:0/668454131 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458007aa0 con 0x7f546006f660 2024-09-13T16:01:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.283+0000 7f5468200640 1 -- 172.21.15.70:0/668454131 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f546006f660 msgr2=0x7f546006fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.283+0000 7f5468200640 1 --2- 172.21.15.70:0/668454131 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f546006f660 0x7f546006fad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5458009d90 tx=0x7f545802a660 comp rx=0 tx=0).stop 2024-09-13T16:01:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.284+0000 7f5468200640 1 -- 172.21.15.70:0/668454131 shutdown_connections 2024-09-13T16:01:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.284+0000 7f5468200640 1 --2- 172.21.15.70:0/668454131 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f546006f660 0x7f546006fad0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.284+0000 7f5468200640 1 --2- 172.21.15.70:0/668454131 >> v2:172.21.15.107:3300/0 conn(0x7f54600b3990 0x7f5460159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.284+0000 7f5468200640 1 -- 172.21.15.70:0/668454131 >> 172.21.15.70:0/668454131 conn(0x7f54600b0510 msgr2=0x7f54600b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.284+0000 7f5468200640 1 -- 172.21.15.70:0/668454131 shutdown_connections 2024-09-13T16:01:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.284+0000 7f5468200640 1 -- 172.21.15.70:0/668454131 wait complete. 2024-09-13T16:01:48.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.285+0000 7f5468200640 1 Processor -- start 2024-09-13T16:01:48.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.285+0000 7f5468200640 1 -- start start 2024-09-13T16:01:48.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.286+0000 7f5468200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f546006f660 0x7f54601f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:48.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.286+0000 7f5468200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54600b3990 0x7f54601516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:48.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.286+0000 7f5468200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5460153b20 0x7f5460154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:48.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.286+0000 7f5468200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546014fc30 con 0x7f5460153b20 2024-09-13T16:01:48.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.286+0000 7f5468200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54601f3500 con 0x7f546006f660 2024-09-13T16:01:48.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.286+0000 7f5468200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546015bf90 con 0x7f54600b3990 2024-09-13T16:01:48.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.286+0000 7f5466200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5460153b20 0x7f5460154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:48.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.286+0000 7f5466200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5460153b20 0x7f5460154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48354/0 (socket says 172.21.15.70:48354) 2024-09-13T16:01:48.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.286+0000 7f5466200640 1 -- 172.21.15.70:0/3689621087 learned_addr learned my addr 172.21.15.70:0/3689621087 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:48.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.287+0000 7f5465800640 1 --2- 172.21.15.70:0/3689621087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f546006f660 0x7f54601f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:48.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.287+0000 7f5464e00640 1 --2- 172.21.15.70:0/3689621087 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54600b3990 0x7f54601516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:48.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.287+0000 7f5466200640 1 -- 172.21.15.70:0/3689621087 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54600b3990 msgr2=0x7f54601516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:48.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.287+0000 7f5466200640 1 --2- 172.21.15.70:0/3689621087 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54600b3990 0x7f54601516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.287+0000 7f5466200640 1 -- 172.21.15.70:0/3689621087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f546006f660 msgr2=0x7f54601f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:48.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.287+0000 7f5466200640 1 --2- 172.21.15.70:0/3689621087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f546006f660 0x7f54601f2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.287+0000 7f5466200640 1 -- 172.21.15.70:0/3689621087 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c009400 con 0x7f5460153b20 2024-09-13T16:01:48.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.287+0000 7f5466200640 1 --2- 172.21.15.70:0/3689621087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5460153b20 0x7f5460154f80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5458009eb0 tx=0x7f5458004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:48.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.288+0000 7f545d600640 1 -- 172.21.15.70:0/3689621087 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545803b820 con 0x7f5460153b20 2024-09-13T16:01:48.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.288+0000 7f545d600640 1 -- 172.21.15.70:0/3689621087 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545803b9a0 con 0x7f5460153b20 2024-09-13T16:01:48.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.288+0000 7f545d600640 1 -- 172.21.15.70:0/3689621087 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545803bd50 con 0x7f5460153b20 2024-09-13T16:01:48.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.288+0000 7f5468200640 1 -- 172.21.15.70:0/3689621087 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5458009a70 con 0x7f5460153b20 2024-09-13T16:01:48.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.288+0000 7f5468200640 1 -- 172.21.15.70:0/3689621087 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5460157070 con 0x7f5460153b20 2024-09-13T16:01:48.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.289+0000 7f5468200640 1 -- 172.21.15.70:0/3689621087 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546006fad0 con 0x7f5460153b20 2024-09-13T16:01:48.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.289+0000 7f545d600640 1 -- 172.21.15.70:0/3689621087 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5458031400 con 0x7f5460153b20 2024-09-13T16:01:48.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.290+0000 7f545d600640 1 --2- 172.21.15.70:0/3689621087 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f544006ac00 0x7f544006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:48.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.290+0000 7f545d600640 1 -- 172.21.15.70:0/3689621087 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54580aa400 con 0x7f5460153b20 2024-09-13T16:01:48.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.290+0000 7f5465800640 1 --2- 172.21.15.70:0/3689621087 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f544006ac00 0x7f544006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:48.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.291+0000 7f5465800640 1 --2- 172.21.15.70:0/3689621087 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f544006ac00 0x7f544006d0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5454007fd0 tx=0x7f5454009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:48.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.295+0000 7f545d600640 1 -- 172.21.15.70:0/3689621087 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f54580755d0 con 0x7f5460153b20 2024-09-13T16:01:48.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.468+0000 7f5468200640 1 -- 172.21.15.70:0/3689621087 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54601f5be0 con 0x7f5460153b20 2024-09-13T16:01:48.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.468+0000 7f545d600640 1 -- 172.21.15.70:0/3689621087 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f5458078bf0 con 0x7f5460153b20 2024-09-13T16:01:48.470 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:48.470 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:19.595458+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:48.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.470+0000 7f5468200640 1 -- 172.21.15.70:0/3689621087 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f544006ac00 msgr2=0x7f544006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:48.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.470+0000 7f5468200640 1 --2- 172.21.15.70:0/3689621087 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f544006ac00 0x7f544006d0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5454007fd0 tx=0x7f5454009040 comp rx=0 tx=0).stop 2024-09-13T16:01:48.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.470+0000 7f5468200640 1 -- 172.21.15.70:0/3689621087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5460153b20 msgr2=0x7f5460154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:48.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.470+0000 7f5468200640 1 --2- 172.21.15.70:0/3689621087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5460153b20 0x7f5460154f80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5458009eb0 tx=0x7f5458004a40 comp rx=0 tx=0).stop 2024-09-13T16:01:48.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.470+0000 7f5468200640 1 -- 172.21.15.70:0/3689621087 shutdown_connections 2024-09-13T16:01:48.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.470+0000 7f5468200640 1 --2- 172.21.15.70:0/3689621087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5460153b20 0x7f5460154f80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.470+0000 7f5468200640 1 --2- 172.21.15.70:0/3689621087 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54600b3990 0x7f54601516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.470+0000 7f5468200640 1 --2- 172.21.15.70:0/3689621087 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f544006ac00 0x7f544006d0c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.470+0000 7f5468200640 1 --2- 172.21.15.70:0/3689621087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f546006f660 0x7f54601f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.470+0000 7f5468200640 1 -- 172.21.15.70:0/3689621087 >> 172.21.15.70:0/3689621087 conn(0x7f54600b0510 msgr2=0x7f54600b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:48.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.470+0000 7f5468200640 1 -- 172.21.15.70:0/3689621087 shutdown_connections 2024-09-13T16:01:48.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.470+0000 7f5468200640 1 -- 172.21.15.70:0/3689621087 wait complete. 2024-09-13T16:01:48.488 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:01:06.070694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:01:16.922043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:01:17.580304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:01:48.488 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:01:48.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.642+0000 7f27dac00640 1 Processor -- start 2024-09-13T16:01:48.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.642+0000 7f27dac00640 1 -- start start 2024-09-13T16:01:48.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.643+0000 7f27dac00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27d41594a0 0x7f27d40cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:48.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.643+0000 7f27dac00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f27d40b2e20 0x7f27d406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:48.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.643+0000 7f27dac00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d40cc370 con 0x7f27d415d980 2024-09-13T16:01:48.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.643+0000 7f27dac00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d4159880 con 0x7f27d40b2e20 2024-09-13T16:01:48.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.643+0000 7f27dac00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d40cd1b0 con 0x7f27d41594a0 2024-09-13T16:01:48.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.643+0000 7f27d8e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f27d415d980 0x7f27d40b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35864/0 (socket says 172.21.15.70:35864) 2024-09-13T16:01:48.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.643+0000 7f27d8e00640 1 -- 172.21.15.70:0/2173171748 learned_addr learned my addr 172.21.15.70:0/2173171748 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:48.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.643+0000 7f27da200640 1 --2- 172.21.15.70:0/2173171748 >> v2:172.21.15.107:3300/0 conn(0x7f27d40b2e20 0x7f27d406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:48.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.643+0000 7f27d9800640 1 --2- 172.21.15.70:0/2173171748 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27d41594a0 0x7f27d40cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:48.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27d3e00640 1 -- 172.21.15.70:0/2173171748 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48680832 0 0) 0x7f27d40cc370 con 0x7f27d415d980 2024-09-13T16:01:48.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27d3e00640 1 -- 172.21.15.70:0/2173171748 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27bc003520 con 0x7f27d415d980 2024-09-13T16:01:48.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27d3e00640 1 -- 172.21.15.70:0/2173171748 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2445520346 0 0) 0x7f27bc003520 con 0x7f27d415d980 2024-09-13T16:01:48.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27d3e00640 1 -- 172.21.15.70:0/2173171748 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27d41594a0 msgr2=0x7f27d40cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:48.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27d3e00640 1 --2- 172.21.15.70:0/2173171748 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27d41594a0 0x7f27d40cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27d3e00640 1 -- 172.21.15.70:0/2173171748 >> v2:172.21.15.107:3300/0 conn(0x7f27d40b2e20 msgr2=0x7f27d406f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:48.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27d3e00640 1 --2- 172.21.15.70:0/2173171748 >> v2:172.21.15.107:3300/0 conn(0x7f27d40b2e20 0x7f27d406f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27d3e00640 1 -- 172.21.15.70:0/2173171748 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d40cc5a0 con 0x7f27d415d980 2024-09-13T16:01:48.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27d3e00640 1 -- 172.21.15.70:0/2173171748 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f27c0001670 con 0x7f27d415d980 2024-09-13T16:01:48.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27d3e00640 1 -- 172.21.15.70:0/2173171748 >> v1:172.21.15.70:6789/0 conn(0x7f27d415d980 legacy=0x7f27d40b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:48.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27d3e00640 1 --2- 172.21.15.70:0/2173171748 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27bc003970 0x7f27bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:48.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27d3e00640 1 --2- 172.21.15.70:0/2173171748 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27d41594a0 0x7f27bc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:48.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27d3e00640 1 --2- 172.21.15.70:0/2173171748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27bc004d00 0x7f27bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:48.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27d3e00640 1 -- 172.21.15.70:0/2173171748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4159880 con 0x7f27bc004d00 2024-09-13T16:01:48.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27d3e00640 1 -- 172.21.15.70:0/2173171748 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d40cd1b0 con 0x7f27bc003970 2024-09-13T16:01:48.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27d3e00640 1 -- 172.21.15.70:0/2173171748 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc00db90 con 0x7f27d41594a0 2024-09-13T16:01:48.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27da200640 1 --2- 172.21.15.70:0/2173171748 >> v2:172.21.15.107:3300/0 conn(0x7f27d40b2e20 0x7f27d406f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:48.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27d8e00640 1 --2- 172.21.15.70:0/2173171748 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27d41594a0 0x7f27bc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:48.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27d9800640 1 --2- 172.21.15.70:0/2173171748 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27bc003970 0x7f27bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:48.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.644+0000 7f27da200640 1 --2- 172.21.15.70:0/2173171748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27bc004d00 0x7f27bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:48.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.645+0000 7f27da200640 1 -- 172.21.15.70:0/2173171748 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27d41594a0 msgr2=0x7f27bc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:48.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.645+0000 7f27da200640 1 --2- 172.21.15.70:0/2173171748 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27d41594a0 0x7f27bc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.645+0000 7f27da200640 1 -- 172.21.15.70:0/2173171748 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27bc003970 msgr2=0x7f27bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:48.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.645+0000 7f27da200640 1 --2- 172.21.15.70:0/2173171748 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27bc003970 0x7f27bc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.645+0000 7f27da200640 1 -- 172.21.15.70:0/2173171748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc003520 con 0x7f27bc004d00 2024-09-13T16:01:48.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.645+0000 7f27d8e00640 1 --2- 172.21.15.70:0/2173171748 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27d41594a0 0x7f27bc0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:48.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.646+0000 7f27da200640 1 --2- 172.21.15.70:0/2173171748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27bc004d00 0x7f27bc005180 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f27d4071c70 tx=0x7f27bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d632b263dc1999d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:48.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.646+0000 7f27d3e00640 1 -- 172.21.15.70:0/2173171748 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc02e610 con 0x7f27bc004d00 2024-09-13T16:01:48.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.646+0000 7f27d3e00640 1 -- 172.21.15.70:0/2173171748 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc00f040 con 0x7f27bc004d00 2024-09-13T16:01:48.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.646+0000 7f27d3e00640 1 -- 172.21.15.70:0/2173171748 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc02e9b0 con 0x7f27bc004d00 2024-09-13T16:01:48.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.646+0000 7f27dac00640 1 -- 172.21.15.70:0/2173171748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27bc004d00 msgr2=0x7f27bc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:48.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.646+0000 7f27dac00640 1 --2- 172.21.15.70:0/2173171748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27bc004d00 0x7f27bc005180 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f27d4071c70 tx=0x7f27bc0057f0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.646+0000 7f27da200640 1 -- 172.21.15.70:0/2173171748 reap_dead start 2024-09-13T16:01:48.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.647+0000 7f27dac00640 1 -- 172.21.15.70:0/2173171748 shutdown_connections 2024-09-13T16:01:48.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.647+0000 7f27dac00640 1 -- 172.21.15.70:0/2173171748 >> 172.21.15.70:0/2173171748 conn(0x7f27d40b0200 msgr2=0x7f27d40b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:48.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.647+0000 7f27dac00640 1 -- 172.21.15.70:0/2173171748 shutdown_connections 2024-09-13T16:01:48.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.647+0000 7f27dac00640 1 -- 172.21.15.70:0/2173171748 wait complete. 2024-09-13T16:01:48.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.648+0000 7f27dac00640 1 Processor -- start 2024-09-13T16:01:48.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.648+0000 7f27dac00640 1 -- start start 2024-09-13T16:01:48.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.649+0000 7f27dac00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27bc004d00 0x7f27d40c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:48.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.649+0000 7f27dac00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27d40c7bf0 0x7f27d4151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:48.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.649+0000 7f27dac00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27d4153440 0x7f27d4156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:48.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.649+0000 7f27dac00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d40c3470 con 0x7f27d4153440 2024-09-13T16:01:48.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.649+0000 7f27dac00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d40c6270 con 0x7f27d40c7bf0 2024-09-13T16:01:48.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.649+0000 7f27dac00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d40c6550 con 0x7f27bc004d00 2024-09-13T16:01:48.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.650+0000 7f27da200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27d4153440 0x7f27d4156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:48.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.650+0000 7f27da200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27d4153440 0x7f27d4156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48374/0 (socket says 172.21.15.70:48374) 2024-09-13T16:01:48.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.650+0000 7f27da200640 1 -- 172.21.15.70:0/2789692117 learned_addr learned my addr 172.21.15.70:0/2789692117 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:48.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.650+0000 7f27d9800640 1 --2- 172.21.15.70:0/2789692117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27bc004d00 0x7f27d40c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:48.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.650+0000 7f27da200640 1 -- 172.21.15.70:0/2789692117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27bc004d00 msgr2=0x7f27d40c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:48.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.650+0000 7f27da200640 1 --2- 172.21.15.70:0/2789692117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27bc004d00 0x7f27d40c5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.650+0000 7f27d8e00640 1 --2- 172.21.15.70:0/2789692117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27d40c7bf0 0x7f27d4151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:48.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.650+0000 7f27da200640 1 -- 172.21.15.70:0/2789692117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27d40c7bf0 msgr2=0x7f27d4151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:48.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.650+0000 7f27da200640 1 --2- 172.21.15.70:0/2789692117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27d40c7bf0 0x7f27d4151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.650+0000 7f27da200640 1 -- 172.21.15.70:0/2789692117 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d40c36c0 con 0x7f27d4153440 2024-09-13T16:01:48.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.650+0000 7f27d8e00640 1 --2- 172.21.15.70:0/2789692117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27d40c7bf0 0x7f27d4151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:48.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.650+0000 7f27da200640 1 --2- 172.21.15.70:0/2789692117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27d4153440 0x7f27d4156e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00e410 tx=0x7f27cc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:48.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.651+0000 7f27d1600640 1 -- 172.21.15.70:0/2789692117 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc044070 con 0x7f27d4153440 2024-09-13T16:01:48.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.651+0000 7f27d1600640 1 -- 172.21.15.70:0/2789692117 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc03c040 con 0x7f27d4153440 2024-09-13T16:01:48.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.651+0000 7f27dac00640 1 -- 172.21.15.70:0/2789692117 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d40c39a0 con 0x7f27d4153440 2024-09-13T16:01:48.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.651+0000 7f27d1600640 1 -- 172.21.15.70:0/2789692117 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc003bd0 con 0x7f27d4153440 2024-09-13T16:01:48.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.651+0000 7f27dac00640 1 -- 172.21.15.70:0/2789692117 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d4152280 con 0x7f27d4153440 2024-09-13T16:01:48.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.652+0000 7f27dac00640 1 -- 172.21.15.70:0/2789692117 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d40c6710 con 0x7f27d4153440 2024-09-13T16:01:48.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.653+0000 7f27d1600640 1 -- 172.21.15.70:0/2789692117 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f27cc02c040 con 0x7f27d4153440 2024-09-13T16:01:48.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.653+0000 7f27d1600640 1 --2- 172.21.15.70:0/2789692117 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f27b406ac30 0x7f27b406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:48.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.654+0000 7f27d1600640 1 -- 172.21.15.70:0/2789692117 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27cc0a9960 con 0x7f27d4153440 2024-09-13T16:01:48.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.654+0000 7f27d9800640 1 --2- 172.21.15.70:0/2789692117 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f27b406ac30 0x7f27b406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:48.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.654+0000 7f27d9800640 1 --2- 172.21.15.70:0/2789692117 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f27b406ac30 0x7f27b406d0f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f27d41f1170 tx=0x7f27c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:48.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.657+0000 7f27d1600640 1 -- 172.21.15.70:0/2789692117 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f27cc074a20 con 0x7f27d4153440 2024-09-13T16:01:48.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.824+0000 7f27dac00640 1 -- 172.21.15.70:0/2789692117 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27d406eca0 con 0x7f27d4153440 2024-09-13T16:01:48.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.825+0000 7f27d1600640 1 -- 172.21.15.70:0/2789692117 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27cc009de0 con 0x7f27d4153440 2024-09-13T16:01:48.826 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-13T16:01:48.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.827+0000 7f27dac00640 1 -- 172.21.15.70:0/2789692117 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f27b406ac30 msgr2=0x7f27b406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:48.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.827+0000 7f27dac00640 1 --2- 172.21.15.70:0/2789692117 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f27b406ac30 0x7f27b406d0f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f27d41f1170 tx=0x7f27c8008040 comp rx=0 tx=0).stop 2024-09-13T16:01:48.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.827+0000 7f27dac00640 1 -- 172.21.15.70:0/2789692117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27d4153440 msgr2=0x7f27d4156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:48.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.827+0000 7f27dac00640 1 --2- 172.21.15.70:0/2789692117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27d4153440 0x7f27d4156e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00e410 tx=0x7f27cc009750 comp rx=0 tx=0).stop 2024-09-13T16:01:48.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.827+0000 7f27dac00640 1 -- 172.21.15.70:0/2789692117 shutdown_connections 2024-09-13T16:01:48.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.827+0000 7f27dac00640 1 --2- 172.21.15.70:0/2789692117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27d4153440 0x7f27d4156e10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.827+0000 7f27dac00640 1 --2- 172.21.15.70:0/2789692117 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f27b406ac30 0x7f27b406d0f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.827+0000 7f27dac00640 1 --2- 172.21.15.70:0/2789692117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27d40c7bf0 0x7f27d4151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.827+0000 7f27dac00640 1 --2- 172.21.15.70:0/2789692117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27bc004d00 0x7f27d40c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:48.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.827+0000 7f27dac00640 1 -- 172.21.15.70:0/2789692117 >> 172.21.15.70:0/2789692117 conn(0x7f27d40b0200 msgr2=0x7f27d406b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:48.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.827+0000 7f27dac00640 1 -- 172.21.15.70:0/2789692117 shutdown_connections 2024-09-13T16:01:48.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.827+0000 7f27dac00640 1 -- 172.21.15.70:0/2789692117 wait complete. 2024-09-13T16:01:48.843 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:01:48.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.996+0000 7f29ea600640 1 Processor -- start 2024-09-13T16:01:48.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.996+0000 7f29ea600640 1 -- start start 2024-09-13T16:01:48.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.998+0000 7f29ea600640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f29e40cafa0 0x7f29e415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:48.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.998+0000 7f29ea600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e406f5f0 con 0x7f29e4156f60 2024-09-13T16:01:48.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.998+0000 7f29ea600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e4070450 con 0x7f29e4071690 2024-09-13T16:01:48.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.998+0000 7f29ea600640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e415aa30 con 0x7f29e40cafa0 2024-09-13T16:01:48.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.998+0000 7f29e3400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f29e4156f60 0x7f29e4070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35868/0 (socket says 172.21.15.70:35868) 2024-09-13T16:01:48.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.998+0000 7f29e3400640 1 -- 172.21.15.70:0/813335032 learned_addr learned my addr 172.21.15.70:0/813335032 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:48.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.998+0000 7f29e3e00640 1 --2- 172.21.15.70:0/813335032 >> v2:172.21.15.70:3300/0 conn(0x7f29e40cafa0 0x7f29e415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:49.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.998+0000 7f29e3e00640 1 -- 172.21.15.70:0/813335032 >> v1:172.21.15.107:6789/0 conn(0x7f29e4071690 legacy=0x7f29e40cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:49.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.998+0000 7f29e3e00640 1 -- 172.21.15.70:0/813335032 >> v1:172.21.15.70:6789/0 conn(0x7f29e4156f60 legacy=0x7f29e4070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:49.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.998+0000 7f29e3e00640 1 -- 172.21.15.70:0/813335032 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e406f840 con 0x7f29e40cafa0 2024-09-13T16:01:49.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.998+0000 7f29e2000640 1 -- 172.21.15.70:0/813335032 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185228941 0 0) 0x7f29e406f5f0 con 0x7f29e4156f60 2024-09-13T16:01:49.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:48.999+0000 7f29e3e00640 1 --2- 172.21.15.70:0/813335032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29e40cafa0 0x7f29e415a4f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009d90 tx=0x7f29dc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ec3dc1840405 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:49.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.000+0000 7f29e2000640 1 -- 172.21.15.70:0/813335032 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc007740 con 0x7f29e40cafa0 2024-09-13T16:01:49.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.000+0000 7f29e2000640 1 -- 172.21.15.70:0/813335032 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc02d050 con 0x7f29e40cafa0 2024-09-13T16:01:49.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.000+0000 7f29e2000640 1 -- 172.21.15.70:0/813335032 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc007ac0 con 0x7f29e40cafa0 2024-09-13T16:01:49.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.000+0000 7f29ea600640 1 -- 172.21.15.70:0/813335032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29e40cafa0 msgr2=0x7f29e415a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:49.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.000+0000 7f29ea600640 1 --2- 172.21.15.70:0/813335032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29e40cafa0 0x7f29e415a4f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009d90 tx=0x7f29dc02a6a0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.000+0000 7f29ea600640 1 -- 172.21.15.70:0/813335032 shutdown_connections 2024-09-13T16:01:49.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.000+0000 7f29ea600640 1 --2- 172.21.15.70:0/813335032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29e40cafa0 0x7f29e415a4f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.000+0000 7f29ea600640 1 -- 172.21.15.70:0/813335032 >> 172.21.15.70:0/813335032 conn(0x7f29e40b0580 msgr2=0x7f29e40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:49.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.000+0000 7f29ea600640 1 -- 172.21.15.70:0/813335032 shutdown_connections 2024-09-13T16:01:49.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.000+0000 7f29ea600640 1 -- 172.21.15.70:0/813335032 wait complete. 2024-09-13T16:01:49.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.002+0000 7f29ea600640 1 Processor -- start 2024-09-13T16:01:49.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.002+0000 7f29ea600640 1 -- start start 2024-09-13T16:01:49.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.003+0000 7f29ea600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29e4071690 0x7f29e41400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.003+0000 7f29ea600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29e40cafa0 0x7f29e413ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.003+0000 7f29ea600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29e4156f60 0x7f29e40b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.003+0000 7f29ea600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e415b900 con 0x7f29e4156f60 2024-09-13T16:01:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.003+0000 7f29ea600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e415df50 con 0x7f29e4071690 2024-09-13T16:01:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.003+0000 7f29ea600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e413fc10 con 0x7f29e40cafa0 2024-09-13T16:01:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.003+0000 7f29e3e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29e4156f60 0x7f29e40b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.003+0000 7f29e3e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29e4156f60 0x7f29e40b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48386/0 (socket says 172.21.15.70:48386) 2024-09-13T16:01:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.003+0000 7f29e3e00640 1 -- 172.21.15.70:0/276684060 learned_addr learned my addr 172.21.15.70:0/276684060 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.003+0000 7f29e2a00640 1 --2- 172.21.15.70:0/276684060 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29e40cafa0 0x7f29e413ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.003+0000 7f29e3400640 1 --2- 172.21.15.70:0/276684060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29e4071690 0x7f29e41400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.003+0000 7f29e3e00640 1 -- 172.21.15.70:0/276684060 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29e40cafa0 msgr2=0x7f29e413ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.003+0000 7f29e3e00640 1 --2- 172.21.15.70:0/276684060 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29e40cafa0 0x7f29e413ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.003+0000 7f29e3e00640 1 -- 172.21.15.70:0/276684060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29e4071690 msgr2=0x7f29e41400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:49.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.003+0000 7f29e3e00640 1 --2- 172.21.15.70:0/276684060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29e4071690 0x7f29e41400a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.003+0000 7f29e3e00640 1 -- 172.21.15.70:0/276684060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc009a70 con 0x7f29e4156f60 2024-09-13T16:01:49.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.004+0000 7f29e3e00640 1 --2- 172.21.15.70:0/276684060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29e4156f60 0x7f29e40b1880 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009eb0 tx=0x7f29dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:49.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.004+0000 7f29db400640 1 -- 172.21.15.70:0/276684060 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc003b90 con 0x7f29e4156f60 2024-09-13T16:01:49.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.004+0000 7f29db400640 1 -- 172.21.15.70:0/276684060 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc003cf0 con 0x7f29e4156f60 2024-09-13T16:01:49.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.004+0000 7f29db400640 1 -- 172.21.15.70:0/276684060 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc031930 con 0x7f29e4156f60 2024-09-13T16:01:49.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.004+0000 7f29ea600640 1 -- 172.21.15.70:0/276684060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e415dc70 con 0x7f29e4156f60 2024-09-13T16:01:49.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.004+0000 7f29ea600640 1 -- 172.21.15.70:0/276684060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e413f8a0 con 0x7f29e4156f60 2024-09-13T16:01:49.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.005+0000 7f29ea600640 1 -- 172.21.15.70:0/276684060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e40708c0 con 0x7f29e4156f60 2024-09-13T16:01:49.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.006+0000 7f29db400640 1 -- 172.21.15.70:0/276684060 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f29dc031a90 con 0x7f29e4156f60 2024-09-13T16:01:49.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.007+0000 7f29db400640 1 --2- 172.21.15.70:0/276684060 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f29c406ac00 0x7f29c406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:49.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.007+0000 7f29db400640 1 -- 172.21.15.70:0/276684060 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29dc0aa780 con 0x7f29e4156f60 2024-09-13T16:01:49.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.007+0000 7f29e3400640 1 --2- 172.21.15.70:0/276684060 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f29c406ac00 0x7f29c406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:49.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.008+0000 7f29e3400640 1 --2- 172.21.15.70:0/276684060 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f29c406ac00 0x7f29c406d0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f29d4000f60 tx=0x7f29d4007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:49.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.011+0000 7f29db400640 1 -- 172.21.15.70:0/276684060 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f29e40708c0 con 0x7f29e4156f60 2024-09-13T16:01:49.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.181+0000 7f29ea600640 1 -- 172.21.15.70:0/276684060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29e40708c0 con 0x7f29e4156f60 2024-09-13T16:01:49.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.181+0000 7f29db400640 1 -- 172.21.15.70:0/276684060 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f29e40708c0 con 0x7f29e4156f60 2024-09-13T16:01:49.182 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-13T16:01:49.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.183+0000 7f29ea600640 1 -- 172.21.15.70:0/276684060 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f29c406ac00 msgr2=0x7f29c406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:49.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.183+0000 7f29ea600640 1 --2- 172.21.15.70:0/276684060 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f29c406ac00 0x7f29c406d0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f29d4000f60 tx=0x7f29d4007c00 comp rx=0 tx=0).stop 2024-09-13T16:01:49.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.183+0000 7f29ea600640 1 -- 172.21.15.70:0/276684060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29e4156f60 msgr2=0x7f29e40b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:49.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.183+0000 7f29ea600640 1 --2- 172.21.15.70:0/276684060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29e4156f60 0x7f29e40b1880 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009eb0 tx=0x7f29dc004a40 comp rx=0 tx=0).stop 2024-09-13T16:01:49.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.183+0000 7f29ea600640 1 -- 172.21.15.70:0/276684060 shutdown_connections 2024-09-13T16:01:49.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.183+0000 7f29ea600640 1 --2- 172.21.15.70:0/276684060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29e4156f60 0x7f29e40b1880 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.183+0000 7f29ea600640 1 --2- 172.21.15.70:0/276684060 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29e40cafa0 0x7f29e413ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.183+0000 7f29ea600640 1 --2- 172.21.15.70:0/276684060 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f29c406ac00 0x7f29c406d0c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.183+0000 7f29ea600640 1 --2- 172.21.15.70:0/276684060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29e4071690 0x7f29e41400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.183+0000 7f29ea600640 1 -- 172.21.15.70:0/276684060 >> 172.21.15.70:0/276684060 conn(0x7f29e40b0580 msgr2=0x7f29e406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:49.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.183+0000 7f29ea600640 1 -- 172.21.15.70:0/276684060 shutdown_connections 2024-09-13T16:01:49.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.183+0000 7f29ea600640 1 -- 172.21.15.70:0/276684060 wait complete. 2024-09-13T16:01:49.200 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:01:49.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.354+0000 7f4472400640 1 Processor -- start 2024-09-13T16:01:49.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.354+0000 7f4472400640 1 -- start start 2024-09-13T16:01:49.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.355+0000 7f4472400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f446c15ca40 0x7f446c0d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:49.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.355+0000 7f4472400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f446c0d1b90 0x7f446c0d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:49.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.355+0000 7f4472400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f446c0ccf20 0x7f446c0cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:49.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.355+0000 7f4472400640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c0b1ce0 con 0x7f446c0d1b90 2024-09-13T16:01:49.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.355+0000 7f4472400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c0cd910 con 0x7f446c15ca40 2024-09-13T16:01:49.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.355+0000 7f4472400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0d06e0 con 0x7f446c0ccf20 2024-09-13T16:01:49.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.355+0000 7f446be00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f446c0d1b90 0x7f446c0d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:49.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.355+0000 7f4471a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f446c0ccf20 0x7f446c0cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:49.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.355+0000 7f4471000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f446c15ca40 0x7f446c0d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:49.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.355+0000 7f446be00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f446c0d1b90 0x7f446c0d1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48398/0 (socket says 172.21.15.70:48398) 2024-09-13T16:01:49.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.355+0000 7f446be00640 1 -- 172.21.15.70:0/1772103825 learned_addr learned my addr 172.21.15.70:0/1772103825 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:49.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.356+0000 7f446be00640 1 -- 172.21.15.70:0/1772103825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f446c0ccf20 msgr2=0x7f446c0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:49.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.356+0000 7f446be00640 1 --2- 172.21.15.70:0/1772103825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f446c0ccf20 0x7f446c0cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.356+0000 7f446be00640 1 -- 172.21.15.70:0/1772103825 >> v2:172.21.15.107:3300/0 conn(0x7f446c15ca40 msgr2=0x7f446c0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:49.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.356+0000 7f446be00640 1 --2- 172.21.15.70:0/1772103825 >> v2:172.21.15.107:3300/0 conn(0x7f446c15ca40 0x7f446c0d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.356+0000 7f446be00640 1 -- 172.21.15.70:0/1772103825 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0d2510 con 0x7f446c0d1b90 2024-09-13T16:01:49.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.357+0000 7f446be00640 1 --2- 172.21.15.70:0/1772103825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f446c0d1b90 0x7f446c0d1fd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f446c0676e0 tx=0x7f445802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d0e46f7547bdbe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:49.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.357+0000 7f446b400640 1 -- 172.21.15.70:0/1772103825 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445802ae90 con 0x7f446c0d1b90 2024-09-13T16:01:49.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.357+0000 7f446b400640 1 -- 172.21.15.70:0/1772103825 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4458032440 con 0x7f446c0d1b90 2024-09-13T16:01:49.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.357+0000 7f446b400640 1 -- 172.21.15.70:0/1772103825 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44580327d0 con 0x7f446c0d1b90 2024-09-13T16:01:49.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.358+0000 7f4472400640 1 -- 172.21.15.70:0/1772103825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f446c0d1b90 msgr2=0x7f446c0d1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:49.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.358+0000 7f4472400640 1 --2- 172.21.15.70:0/1772103825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f446c0d1b90 0x7f446c0d1fd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f446c0676e0 tx=0x7f445802a180 comp rx=0 tx=0).stop 2024-09-13T16:01:49.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.358+0000 7f4472400640 1 -- 172.21.15.70:0/1772103825 shutdown_connections 2024-09-13T16:01:49.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.358+0000 7f4472400640 1 --2- 172.21.15.70:0/1772103825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f446c0ccf20 0x7f446c0cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.358+0000 7f4472400640 1 --2- 172.21.15.70:0/1772103825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f446c0d1b90 0x7f446c0d1fd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.358+0000 7f4472400640 1 --2- 172.21.15.70:0/1772103825 >> v2:172.21.15.107:3300/0 conn(0x7f446c15ca40 0x7f446c0d1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.358+0000 7f4472400640 1 -- 172.21.15.70:0/1772103825 >> 172.21.15.70:0/1772103825 conn(0x7f446c0cf560 msgr2=0x7f446c0cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:49.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.358+0000 7f4472400640 1 -- 172.21.15.70:0/1772103825 shutdown_connections 2024-09-13T16:01:49.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.358+0000 7f4472400640 1 -- 172.21.15.70:0/1772103825 wait complete. 2024-09-13T16:01:49.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.359+0000 7f4472400640 1 Processor -- start 2024-09-13T16:01:49.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.360+0000 7f4472400640 1 -- start start 2024-09-13T16:01:49.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.360+0000 7f4472400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f446c0ccf20 0x7f446c1e7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:49.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.360+0000 7f4472400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f446c0d1b90 0x7f446c0c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:49.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.360+0000 7f4472400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f446c15ca40 0x7f446c159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:49.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.360+0000 7f4472400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c1e7f70 con 0x7f446c15ca40 2024-09-13T16:01:49.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.360+0000 7f4472400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c1e8250 con 0x7f446c0d1b90 2024-09-13T16:01:49.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.360+0000 7f4472400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c1e8530 con 0x7f446c0ccf20 2024-09-13T16:01:49.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.361+0000 7f4471a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f446c15ca40 0x7f446c159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:49.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.361+0000 7f4471a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f446c15ca40 0x7f446c159ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48402/0 (socket says 172.21.15.70:48402) 2024-09-13T16:01:49.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.361+0000 7f4471a00640 1 -- 172.21.15.70:0/2878738840 learned_addr learned my addr 172.21.15.70:0/2878738840 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:49.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.361+0000 7f4471000640 1 --2- 172.21.15.70:0/2878738840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f446c0ccf20 0x7f446c1e7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:49.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.361+0000 7f446be00640 1 --2- 172.21.15.70:0/2878738840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f446c0d1b90 0x7f446c0c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:49.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.361+0000 7f4471a00640 1 -- 172.21.15.70:0/2878738840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f446c0ccf20 msgr2=0x7f446c1e7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:49.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.361+0000 7f4471a00640 1 --2- 172.21.15.70:0/2878738840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f446c0ccf20 0x7f446c1e7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.361+0000 7f4471a00640 1 -- 172.21.15.70:0/2878738840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f446c0d1b90 msgr2=0x7f446c0c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:49.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.361+0000 7f4471a00640 1 --2- 172.21.15.70:0/2878738840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f446c0d1b90 0x7f446c0c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.361+0000 7f4471a00640 1 -- 172.21.15.70:0/2878738840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44580094d0 con 0x7f446c15ca40 2024-09-13T16:01:49.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.361+0000 7f446be00640 1 --2- 172.21.15.70:0/2878738840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f446c0d1b90 0x7f446c0c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:49.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.361+0000 7f4471a00640 1 --2- 172.21.15.70:0/2878738840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f446c15ca40 0x7f446c159ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f446400eed0 tx=0x7f446400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:49.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.361+0000 7f4468c00640 1 -- 172.21.15.70:0/2878738840 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464010040 con 0x7f446c15ca40 2024-09-13T16:01:49.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.362+0000 7f4468c00640 1 -- 172.21.15.70:0/2878738840 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4464014400 con 0x7f446c15ca40 2024-09-13T16:01:49.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.362+0000 7f4468c00640 1 -- 172.21.15.70:0/2878738840 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464009ea0 con 0x7f446c15ca40 2024-09-13T16:01:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.362+0000 7f4472400640 1 -- 172.21.15.70:0/2878738840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c1e8810 con 0x7f446c15ca40 2024-09-13T16:01:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.362+0000 7f4472400640 1 -- 172.21.15.70:0/2878738840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c1e7bd0 con 0x7f446c15ca40 2024-09-13T16:01:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.363+0000 7f4472400640 1 -- 172.21.15.70:0/2878738840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c0d1fd0 con 0x7f446c15ca40 2024-09-13T16:01:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.363+0000 7f4468c00640 1 -- 172.21.15.70:0/2878738840 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f44640147b0 con 0x7f446c15ca40 2024-09-13T16:01:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.364+0000 7f4468c00640 1 --2- 172.21.15.70:0/2878738840 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f444c06ac00 0x7f444c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.364+0000 7f4468c00640 1 -- 172.21.15.70:0/2878738840 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4464089ac0 con 0x7f446c15ca40 2024-09-13T16:01:49.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.365+0000 7f4471000640 1 --2- 172.21.15.70:0/2878738840 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f444c06ac00 0x7f444c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:49.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.365+0000 7f4471000640 1 --2- 172.21.15.70:0/2878738840 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f444c06ac00 0x7f444c06d0c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4460009aa0 tx=0x7f4460009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.368+0000 7f4468c00640 1 -- 172.21.15.70:0/2878738840 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4464054c00 con 0x7f446c15ca40 2024-09-13T16:01:49.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.535+0000 7f4472400640 1 -- 172.21.15.70:0/2878738840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f446c1e8e10 con 0x7f446c15ca40 2024-09-13T16:01:49.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.536+0000 7f4468c00640 1 -- 172.21.15.70:0/2878738840 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44640180a0 con 0x7f446c15ca40 2024-09-13T16:01:49.537 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-13T16:01:49.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.538+0000 7f4472400640 1 -- 172.21.15.70:0/2878738840 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f444c06ac00 msgr2=0x7f444c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:49.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.538+0000 7f4472400640 1 --2- 172.21.15.70:0/2878738840 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f444c06ac00 0x7f444c06d0c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4460009aa0 tx=0x7f4460009190 comp rx=0 tx=0).stop 2024-09-13T16:01:49.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.538+0000 7f4472400640 1 -- 172.21.15.70:0/2878738840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f446c15ca40 msgr2=0x7f446c159ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:49.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.538+0000 7f4472400640 1 --2- 172.21.15.70:0/2878738840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f446c15ca40 0x7f446c159ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f446400eed0 tx=0x7f446400b480 comp rx=0 tx=0).stop 2024-09-13T16:01:49.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.538+0000 7f4472400640 1 -- 172.21.15.70:0/2878738840 shutdown_connections 2024-09-13T16:01:49.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.538+0000 7f4472400640 1 --2- 172.21.15.70:0/2878738840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f446c15ca40 0x7f446c159ae0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.538+0000 7f4472400640 1 --2- 172.21.15.70:0/2878738840 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f444c06ac00 0x7f444c06d0c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.538+0000 7f4472400640 1 --2- 172.21.15.70:0/2878738840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f446c0d1b90 0x7f446c0c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.538+0000 7f4472400640 1 --2- 172.21.15.70:0/2878738840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f446c0ccf20 0x7f446c1e7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.538+0000 7f4472400640 1 -- 172.21.15.70:0/2878738840 >> 172.21.15.70:0/2878738840 conn(0x7f446c0cf560 msgr2=0x7f446c0b76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:49.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.538+0000 7f4472400640 1 -- 172.21.15.70:0/2878738840 shutdown_connections 2024-09-13T16:01:49.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.538+0000 7f4472400640 1 -- 172.21.15.70:0/2878738840 wait complete. 2024-09-13T16:01:49.555 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:49.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.706+0000 7f07a2e00640 1 Processor -- start 2024-09-13T16:01:49.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.706+0000 7f07a2e00640 1 -- start start 2024-09-13T16:01:49.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.707+0000 7f07a2e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f079c0b3990 0x7f079c159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:49.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.707+0000 7f07a2e00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079c159fc0 con 0x7f079c153b20 2024-09-13T16:01:49.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.707+0000 7f07a2e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079c153f00 con 0x7f079c06f660 2024-09-13T16:01:49.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.707+0000 7f07a2e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079c0ce600 con 0x7f079c0b3990 2024-09-13T16:01:49.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.707+0000 7f079be00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f079c153b20 0x7f079c0b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35880/0 (socket says 172.21.15.70:35880) 2024-09-13T16:01:49.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.707+0000 7f079be00640 1 -- 172.21.15.70:0/2018507791 learned_addr learned my addr 172.21.15.70:0/2018507791 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:49.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.708+0000 7f079b400640 1 --2- 172.21.15.70:0/2018507791 >> v2:172.21.15.107:3300/0 conn(0x7f079c0b3990 0x7f079c159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:49.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.708+0000 7f079aa00640 1 -- 172.21.15.70:0/2018507791 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16841629 0 0) 0x7f079c159fc0 con 0x7f079c153b20 2024-09-13T16:01:49.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.708+0000 7f079aa00640 1 -- 172.21.15.70:0/2018507791 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0780003520 con 0x7f079c153b20 2024-09-13T16:01:49.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.708+0000 7f079aa00640 1 -- 172.21.15.70:0/2018507791 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757001313 0 0) 0x7f079c153f00 con 0x7f079c06f660 2024-09-13T16:01:49.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.708+0000 7f079aa00640 1 -- 172.21.15.70:0/2018507791 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f079c159fc0 con 0x7f079c06f660 2024-09-13T16:01:49.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.708+0000 7f079aa00640 1 -- 172.21.15.70:0/2018507791 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1937136308 0 0) 0x7f0780003520 con 0x7f079c153b20 2024-09-13T16:01:49.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.708+0000 7f079b400640 1 -- 172.21.15.70:0/2018507791 >> v1:172.21.15.107:6789/0 conn(0x7f079c06f660 legacy=0x7f079c06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:49.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.708+0000 7f079b400640 1 -- 172.21.15.70:0/2018507791 >> v1:172.21.15.70:6789/0 conn(0x7f079c153b20 legacy=0x7f079c0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:49.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.708+0000 7f079b400640 1 -- 172.21.15.70:0/2018507791 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c0b1a40 con 0x7f079c0b3990 2024-09-13T16:01:49.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.709+0000 7f079b400640 1 --2- 172.21.15.70:0/2018507791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f079c0b3990 0x7f079c159a80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f07880097a0 tx=0x7f078802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=898702bcd76f9899 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:49.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.710+0000 7f079aa00640 1 -- 172.21.15.70:0/2018507791 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c001670 con 0x7f079c0b3990 2024-09-13T16:01:49.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.710+0000 7f079aa00640 1 -- 172.21.15.70:0/2018507791 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078802ac50 con 0x7f079c0b3990 2024-09-13T16:01:49.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.710+0000 7f079aa00640 1 -- 172.21.15.70:0/2018507791 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0788032440 con 0x7f079c0b3990 2024-09-13T16:01:49.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.710+0000 7f07a2e00640 1 -- 172.21.15.70:0/2018507791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f079c0b3990 msgr2=0x7f079c159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:49.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.710+0000 7f07a2e00640 1 --2- 172.21.15.70:0/2018507791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f079c0b3990 0x7f079c159a80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f07880097a0 tx=0x7f078802a1c0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.710+0000 7f07a2e00640 1 -- 172.21.15.70:0/2018507791 shutdown_connections 2024-09-13T16:01:49.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.710+0000 7f07a2e00640 1 --2- 172.21.15.70:0/2018507791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f079c0b3990 0x7f079c159a80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.710+0000 7f07a2e00640 1 -- 172.21.15.70:0/2018507791 >> 172.21.15.70:0/2018507791 conn(0x7f079c0b0510 msgr2=0x7f079c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:49.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.711+0000 7f07a2e00640 1 -- 172.21.15.70:0/2018507791 shutdown_connections 2024-09-13T16:01:49.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.711+0000 7f07a2e00640 1 -- 172.21.15.70:0/2018507791 wait complete. 2024-09-13T16:01:49.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.712+0000 7f07a2e00640 1 Processor -- start 2024-09-13T16:01:49.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.712+0000 7f07a2e00640 1 -- start start 2024-09-13T16:01:49.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.713+0000 7f07a2e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f079c06f660 0x7f079c1589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:49.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.713+0000 7f07a2e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f079c0b3990 0x7f079c14b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:49.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.713+0000 7f07a2e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f079c153b20 0x7f079c147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:49.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.713+0000 7f07a2e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c159300 con 0x7f079c06f660 2024-09-13T16:01:49.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.713+0000 7f07a2e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c14b5b0 con 0x7f079c0b3990 2024-09-13T16:01:49.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.713+0000 7f07a2e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c1478c0 con 0x7f079c153b20 2024-09-13T16:01:49.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.713+0000 7f079be00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f079c06f660 0x7f079c1589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:49.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.713+0000 7f079be00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f079c06f660 0x7f079c1589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48404/0 (socket says 172.21.15.70:48404) 2024-09-13T16:01:49.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.713+0000 7f079be00640 1 -- 172.21.15.70:0/463183385 learned_addr learned my addr 172.21.15.70:0/463183385 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:49.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.714+0000 7f079b400640 1 --2- 172.21.15.70:0/463183385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f079c0b3990 0x7f079c14b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:49.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.714+0000 7f07a0e00640 1 --2- 172.21.15.70:0/463183385 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f079c153b20 0x7f079c147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:49.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.714+0000 7f079be00640 1 -- 172.21.15.70:0/463183385 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f079c153b20 msgr2=0x7f079c147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:49.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.714+0000 7f079be00640 1 --2- 172.21.15.70:0/463183385 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f079c153b20 0x7f079c147380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.714+0000 7f079be00640 1 -- 172.21.15.70:0/463183385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f079c0b3990 msgr2=0x7f079c14b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:49.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.714+0000 7f079be00640 1 --2- 172.21.15.70:0/463183385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f079c0b3990 0x7f079c14b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.714+0000 7f079be00640 1 -- 172.21.15.70:0/463183385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0788009400 con 0x7f079c06f660 2024-09-13T16:01:49.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.714+0000 7f079be00640 1 --2- 172.21.15.70:0/463183385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f079c06f660 0x7f079c1589a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f078c00c6e0 tx=0x7f078c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:49.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.714+0000 7f0793e00640 1 -- 172.21.15.70:0/463183385 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c005ad0 con 0x7f079c06f660 2024-09-13T16:01:49.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.714+0000 7f0793e00640 1 -- 172.21.15.70:0/463183385 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c005c30 con 0x7f079c06f660 2024-09-13T16:01:49.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.714+0000 7f07a2e00640 1 -- 172.21.15.70:0/463183385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079c14cb70 con 0x7f079c06f660 2024-09-13T16:01:49.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.714+0000 7f0793e00640 1 -- 172.21.15.70:0/463183385 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c007070 con 0x7f079c06f660 2024-09-13T16:01:49.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.715+0000 7f07a2e00640 1 -- 172.21.15.70:0/463183385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079c14d130 con 0x7f079c06f660 2024-09-13T16:01:49.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.716+0000 7f07a2e00640 1 -- 172.21.15.70:0/463183385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079c0714d0 con 0x7f079c06f660 2024-09-13T16:01:49.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.717+0000 7f0793e00640 1 -- 172.21.15.70:0/463183385 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f078c0071d0 con 0x7f079c06f660 2024-09-13T16:01:49.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.717+0000 7f0793e00640 1 --2- 172.21.15.70:0/463183385 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f077c06ac00 0x7f077c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:49.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.718+0000 7f0793e00640 1 -- 172.21.15.70:0/463183385 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f078c088910 con 0x7f079c06f660 2024-09-13T16:01:49.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.718+0000 7f079b400640 1 --2- 172.21.15.70:0/463183385 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f077c06ac00 0x7f077c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:49.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.718+0000 7f079b400640 1 --2- 172.21.15.70:0/463183385 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f077c06ac00 0x7f077c06d0c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0788034000 tx=0x7f078802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:49.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.721+0000 7f0793e00640 1 -- 172.21.15.70:0/463183385 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f078c053c10 con 0x7f079c06f660 2024-09-13T16:01:49.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.890+0000 7f07a2e00640 1 -- 172.21.15.70:0/463183385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f079c0cd900 con 0x7f079c06f660 2024-09-13T16:01:49.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.891+0000 7f0793e00640 1 -- 172.21.15.70:0/463183385 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f078c017070 con 0x7f079c06f660 2024-09-13T16:01:49.893 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:49.893 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:19.595458+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.893+0000 7f07a2e00640 1 -- 172.21.15.70:0/463183385 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f077c06ac00 msgr2=0x7f077c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.893+0000 7f07a2e00640 1 --2- 172.21.15.70:0/463183385 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f077c06ac00 0x7f077c06d0c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0788034000 tx=0x7f078802e000 comp rx=0 tx=0).stop 2024-09-13T16:01:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.893+0000 7f07a2e00640 1 -- 172.21.15.70:0/463183385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f079c06f660 msgr2=0x7f079c1589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.893+0000 7f07a2e00640 1 --2- 172.21.15.70:0/463183385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f079c06f660 0x7f079c1589a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f078c00c6e0 tx=0x7f078c00cba0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.894+0000 7f07a2e00640 1 -- 172.21.15.70:0/463183385 shutdown_connections 2024-09-13T16:01:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.894+0000 7f07a2e00640 1 --2- 172.21.15.70:0/463183385 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f079c153b20 0x7f079c147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.894+0000 7f07a2e00640 1 --2- 172.21.15.70:0/463183385 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f077c06ac00 0x7f077c06d0c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.894+0000 7f07a2e00640 1 --2- 172.21.15.70:0/463183385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f079c0b3990 0x7f079c14b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.894+0000 7f07a2e00640 1 --2- 172.21.15.70:0/463183385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f079c06f660 0x7f079c1589a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:49.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.894+0000 7f07a2e00640 1 -- 172.21.15.70:0/463183385 >> 172.21.15.70:0/463183385 conn(0x7f079c0b0510 msgr2=0x7f079c06bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:49.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.894+0000 7f07a2e00640 1 -- 172.21.15.70:0/463183385 shutdown_connections 2024-09-13T16:01:49.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:49.894+0000 7f07a2e00640 1 -- 172.21.15.70:0/463183385 wait complete. 2024-09-13T16:01:49.911 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:01:06.070694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:01:16.922043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:01:17.580304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:01:49.911 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:01:50.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.066+0000 7f76bee00640 1 Processor -- start 2024-09-13T16:01:50.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.066+0000 7f76bee00640 1 -- start start 2024-09-13T16:01:50.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.067+0000 7f76bee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76b8071690 0x7f76b815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.067+0000 7f76bee00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f76b80cafa0 0x7f76b80cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.067+0000 7f76bee00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b806f5f0 con 0x7f76b8156f60 2024-09-13T16:01:50.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.067+0000 7f76bee00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b815aa30 con 0x7f76b80cafa0 2024-09-13T16:01:50.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.067+0000 7f76bee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b8070450 con 0x7f76b8071690 2024-09-13T16:01:50.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.067+0000 7f76b7e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f76b8156f60 0x7f76b8070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49572/0 (socket says 172.21.15.70:49572) 2024-09-13T16:01:50.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.067+0000 7f76b7e00640 1 -- 172.21.15.70:0/3871786518 learned_addr learned my addr 172.21.15.70:0/3871786518 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:50.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.067+0000 7f76bce00640 1 --2- 172.21.15.70:0/3871786518 >> v2:172.21.15.70:3300/0 conn(0x7f76b80cafa0 0x7f76b80cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.068+0000 7f76b7400640 1 --2- 172.21.15.70:0/3871786518 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76b8071690 0x7f76b815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.068+0000 7f76b6a00640 1 -- 172.21.15.70:0/3871786518 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642565804 0 0) 0x7f76b806f5f0 con 0x7f76b8156f60 2024-09-13T16:01:50.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.068+0000 7f76b6a00640 1 -- 172.21.15.70:0/3871786518 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f769c003520 con 0x7f76b8156f60 2024-09-13T16:01:50.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.068+0000 7f76bce00640 1 -- 172.21.15.70:0/3871786518 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76b8071690 msgr2=0x7f76b815a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:50.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.068+0000 7f76bce00640 1 --2- 172.21.15.70:0/3871786518 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76b8071690 0x7f76b815a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.068+0000 7f76bce00640 1 -- 172.21.15.70:0/3871786518 >> v1:172.21.15.70:6789/0 conn(0x7f76b8156f60 legacy=0x7f76b8070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:50.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.068+0000 7f76bce00640 1 -- 172.21.15.70:0/3871786518 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b806f840 con 0x7f76b80cafa0 2024-09-13T16:01:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.069+0000 7f76bce00640 1 --2- 172.21.15.70:0/3871786518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76b80cafa0 0x7f76b80cc8b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009d90 tx=0x7f76b002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c7219789c29d5e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.069+0000 7f76b6a00640 1 -- 172.21.15.70:0/3871786518 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0007740 con 0x7f76b80cafa0 2024-09-13T16:01:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.069+0000 7f76b6a00640 1 -- 172.21.15.70:0/3871786518 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b002d050 con 0x7f76b80cafa0 2024-09-13T16:01:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.069+0000 7f76b6a00640 1 -- 172.21.15.70:0/3871786518 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0007ac0 con 0x7f76b80cafa0 2024-09-13T16:01:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.070+0000 7f76bee00640 1 -- 172.21.15.70:0/3871786518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76b80cafa0 msgr2=0x7f76b80cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.070+0000 7f76bee00640 1 --2- 172.21.15.70:0/3871786518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76b80cafa0 0x7f76b80cc8b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009d90 tx=0x7f76b002a660 comp rx=0 tx=0).stop 2024-09-13T16:01:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.070+0000 7f76bee00640 1 -- 172.21.15.70:0/3871786518 shutdown_connections 2024-09-13T16:01:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.070+0000 7f76bee00640 1 --2- 172.21.15.70:0/3871786518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76b80cafa0 0x7f76b80cc8b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.070+0000 7f76bee00640 1 --2- 172.21.15.70:0/3871786518 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76b8071690 0x7f76b815a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.070+0000 7f76bee00640 1 -- 172.21.15.70:0/3871786518 >> 172.21.15.70:0/3871786518 conn(0x7f76b80b0580 msgr2=0x7f76b80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.070+0000 7f76bee00640 1 -- 172.21.15.70:0/3871786518 shutdown_connections 2024-09-13T16:01:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.070+0000 7f76bee00640 1 -- 172.21.15.70:0/3871786518 wait complete. 2024-09-13T16:01:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.071+0000 7f76bee00640 1 Processor -- start 2024-09-13T16:01:50.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.072+0000 7f76bee00640 1 -- start start 2024-09-13T16:01:50.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.073+0000 7f76bee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76b8071690 0x7f76b81f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.073+0000 7f76bee00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76b80cafa0 0x7f76b8158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.073+0000 7f76bee00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76b8156f60 0x7f76b8159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.073+0000 7f76bee00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b8157e00 con 0x7f76b80cafa0 2024-09-13T16:01:50.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.073+0000 7f76bee00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b815de90 con 0x7f76b8156f60 2024-09-13T16:01:50.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.073+0000 7f76bee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b8158070 con 0x7f76b8071690 2024-09-13T16:01:50.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.073+0000 7f76b7400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76b80cafa0 0x7f76b8158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.073+0000 7f76b7400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76b80cafa0 0x7f76b8158e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44088/0 (socket says 172.21.15.70:44088) 2024-09-13T16:01:50.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.073+0000 7f76b7400640 1 -- 172.21.15.70:0/149670996 learned_addr learned my addr 172.21.15.70:0/149670996 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:50.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.073+0000 7f76b7e00640 1 --2- 172.21.15.70:0/149670996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76b8071690 0x7f76b81f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.073+0000 7f76bce00640 1 --2- 172.21.15.70:0/149670996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76b8156f60 0x7f76b8159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.073+0000 7f76b7400640 1 -- 172.21.15.70:0/149670996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76b8071690 msgr2=0x7f76b81f22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:50.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.073+0000 7f76b7400640 1 --2- 172.21.15.70:0/149670996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76b8071690 0x7f76b81f22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.073+0000 7f76b7400640 1 -- 172.21.15.70:0/149670996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76b8156f60 msgr2=0x7f76b8159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:50.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.073+0000 7f76b7400640 1 --2- 172.21.15.70:0/149670996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76b8156f60 0x7f76b8159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.073+0000 7f76b7400640 1 -- 172.21.15.70:0/149670996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b0009a70 con 0x7f76b80cafa0 2024-09-13T16:01:50.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.074+0000 7f76b7400640 1 --2- 172.21.15.70:0/149670996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76b80cafa0 0x7f76b8158e30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f76a400e980 tx=0x7f76a400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:50.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.074+0000 7f76afe00640 1 -- 172.21.15.70:0/149670996 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4009670 con 0x7f76b80cafa0 2024-09-13T16:01:50.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.074+0000 7f76afe00640 1 -- 172.21.15.70:0/149670996 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a400ca00 con 0x7f76b80cafa0 2024-09-13T16:01:50.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.074+0000 7f76afe00640 1 -- 172.21.15.70:0/149670996 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a400cd90 con 0x7f76b80cafa0 2024-09-13T16:01:50.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.074+0000 7f76bee00640 1 -- 172.21.15.70:0/149670996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b8158350 con 0x7f76b80cafa0 2024-09-13T16:01:50.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.074+0000 7f76bee00640 1 -- 172.21.15.70:0/149670996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b8158910 con 0x7f76b80cafa0 2024-09-13T16:01:50.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.075+0000 7f76bee00640 1 -- 172.21.15.70:0/149670996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b8158ad0 con 0x7f76b80cafa0 2024-09-13T16:01:50.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.076+0000 7f76afe00640 1 -- 172.21.15.70:0/149670996 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f76a4013470 con 0x7f76b80cafa0 2024-09-13T16:01:50.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.077+0000 7f76afe00640 1 --2- 172.21.15.70:0/149670996 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f769806ac00 0x7f769806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.077+0000 7f76afe00640 1 -- 172.21.15.70:0/149670996 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76a4089590 con 0x7f76b80cafa0 2024-09-13T16:01:50.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.077+0000 7f76b7e00640 1 --2- 172.21.15.70:0/149670996 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f769806ac00 0x7f769806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.077+0000 7f76b7e00640 1 --2- 172.21.15.70:0/149670996 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f769806ac00 0x7f769806d0c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f76a8005880 tx=0x7f76a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:50.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.080+0000 7f76afe00640 1 -- 172.21.15.70:0/149670996 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f76a4054780 con 0x7f76b80cafa0 2024-09-13T16:01:50.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.251+0000 7f76bee00640 1 -- 172.21.15.70:0/149670996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76b8157340 con 0x7f76b80cafa0 2024-09-13T16:01:50.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.252+0000 7f76afe00640 1 -- 172.21.15.70:0/149670996 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76a4057da0 con 0x7f76b80cafa0 2024-09-13T16:01:50.253 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-13T16:01:50.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.254+0000 7f76bee00640 1 -- 172.21.15.70:0/149670996 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f769806ac00 msgr2=0x7f769806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:50.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.254+0000 7f76bee00640 1 --2- 172.21.15.70:0/149670996 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f769806ac00 0x7f769806d0c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f76a8005880 tx=0x7f76a8009040 comp rx=0 tx=0).stop 2024-09-13T16:01:50.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.254+0000 7f76bee00640 1 -- 172.21.15.70:0/149670996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76b80cafa0 msgr2=0x7f76b8158e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:50.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.254+0000 7f76bee00640 1 --2- 172.21.15.70:0/149670996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76b80cafa0 0x7f76b8158e30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f76a400e980 tx=0x7f76a400ee40 comp rx=0 tx=0).stop 2024-09-13T16:01:50.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.254+0000 7f76bee00640 1 -- 172.21.15.70:0/149670996 shutdown_connections 2024-09-13T16:01:50.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.254+0000 7f76bee00640 1 --2- 172.21.15.70:0/149670996 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f769806ac00 0x7f769806d0c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.254+0000 7f76bee00640 1 --2- 172.21.15.70:0/149670996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76b8156f60 0x7f76b8159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.254+0000 7f76bee00640 1 --2- 172.21.15.70:0/149670996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76b80cafa0 0x7f76b8158e30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.254+0000 7f76bee00640 1 --2- 172.21.15.70:0/149670996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76b8071690 0x7f76b81f22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.254+0000 7f76bee00640 1 -- 172.21.15.70:0/149670996 >> 172.21.15.70:0/149670996 conn(0x7f76b80b0580 msgr2=0x7f76b80af780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:50.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.254+0000 7f76bee00640 1 -- 172.21.15.70:0/149670996 shutdown_connections 2024-09-13T16:01:50.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.254+0000 7f76bee00640 1 -- 172.21.15.70:0/149670996 wait complete. 2024-09-13T16:01:50.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:01:50.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.426+0000 7effc3a00640 1 Processor -- start 2024-09-13T16:01:50.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.426+0000 7effc3a00640 1 -- start start 2024-09-13T16:01:50.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.428+0000 7effc3a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7effbc071690 0x7effbc15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.428+0000 7effc3a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effbc0cafa0 0x7effbc0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.428+0000 7effc3a00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc06f5f0 con 0x7effbc156f60 2024-09-13T16:01:50.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.428+0000 7effc3a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc15aa30 con 0x7effbc071690 2024-09-13T16:01:50.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.428+0000 7effc3a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc070450 con 0x7effbc0cafa0 2024-09-13T16:01:50.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.428+0000 7effc1000640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7effbc156f60 0x7effbc070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49580/0 (socket says 172.21.15.70:49580) 2024-09-13T16:01:50.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.428+0000 7effc1000640 1 -- 172.21.15.70:0/3487024795 learned_addr learned my addr 172.21.15.70:0/3487024795 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:50.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.428+0000 7effc1a00640 1 --2- 172.21.15.70:0/3487024795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effbc0cafa0 0x7effbc0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.428+0000 7effb3e00640 1 --2- 172.21.15.70:0/3487024795 >> v2:172.21.15.107:3300/0 conn(0x7effbc071690 0x7effbc15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.428+0000 7effbbe00640 1 -- 172.21.15.70:0/3487024795 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809227460 0 0) 0x7effbc06f5f0 con 0x7effbc156f60 2024-09-13T16:01:50.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.428+0000 7effbbe00640 1 -- 172.21.15.70:0/3487024795 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effa0003520 con 0x7effbc156f60 2024-09-13T16:01:50.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effbbe00640 1 -- 172.21.15.70:0/3487024795 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1089135711 0 0) 0x7effa0003520 con 0x7effbc156f60 2024-09-13T16:01:50.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effbbe00640 1 -- 172.21.15.70:0/3487024795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effbc0cafa0 msgr2=0x7effbc0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:50.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effbbe00640 1 --2- 172.21.15.70:0/3487024795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effbc0cafa0 0x7effbc0cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effbbe00640 1 -- 172.21.15.70:0/3487024795 >> v2:172.21.15.107:3300/0 conn(0x7effbc071690 msgr2=0x7effbc15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:50.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effbbe00640 1 --2- 172.21.15.70:0/3487024795 >> v2:172.21.15.107:3300/0 conn(0x7effbc071690 0x7effbc15a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effbbe00640 1 -- 172.21.15.70:0/3487024795 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc06f840 con 0x7effbc156f60 2024-09-13T16:01:50.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effbbe00640 1 -- 172.21.15.70:0/3487024795 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7effac001670 con 0x7effbc156f60 2024-09-13T16:01:50.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effbbe00640 1 -- 172.21.15.70:0/3487024795 >> v1:172.21.15.70:6789/0 conn(0x7effbc156f60 legacy=0x7effbc070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:50.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effbbe00640 1 --2- 172.21.15.70:0/3487024795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effa0003970 0x7effa0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effbbe00640 1 --2- 172.21.15.70:0/3487024795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effbc0cafa0 0x7effa00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effbbe00640 1 --2- 172.21.15.70:0/3487024795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effa0004d00 0x7effa0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effbbe00640 1 -- 172.21.15.70:0/3487024795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc15aa30 con 0x7effa0004d00 2024-09-13T16:01:50.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effbbe00640 1 -- 172.21.15.70:0/3487024795 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc070450 con 0x7effa0003970 2024-09-13T16:01:50.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effbbe00640 1 -- 172.21.15.70:0/3487024795 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa000db90 con 0x7effbc0cafa0 2024-09-13T16:01:50.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effc1a00640 1 --2- 172.21.15.70:0/3487024795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effa0004d00 0x7effa0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effc1000640 1 --2- 172.21.15.70:0/3487024795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effa0003970 0x7effa0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effb3e00640 1 --2- 172.21.15.70:0/3487024795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effbc0cafa0 0x7effa00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effc1a00640 1 -- 172.21.15.70:0/3487024795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effbc0cafa0 msgr2=0x7effa00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:50.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effc1a00640 1 --2- 172.21.15.70:0/3487024795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effbc0cafa0 0x7effa00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effc1a00640 1 -- 172.21.15.70:0/3487024795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effa0003970 msgr2=0x7effa0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:50.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effc1a00640 1 --2- 172.21.15.70:0/3487024795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effa0003970 0x7effa0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effc1a00640 1 -- 172.21.15.70:0/3487024795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa0003520 con 0x7effa0004d00 2024-09-13T16:01:50.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effc1000640 1 --2- 172.21.15.70:0/3487024795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effa0003970 0x7effa0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:50.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.429+0000 7effb3e00640 1 --2- 172.21.15.70:0/3487024795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effbc0cafa0 0x7effa00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:50.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.430+0000 7effc1a00640 1 --2- 172.21.15.70:0/3487024795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effa0004d00 0x7effa0005180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7effb4009f90 tx=0x7effa00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a121eb696f4779d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:50.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.431+0000 7effbbe00640 1 -- 172.21.15.70:0/3487024795 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4031610 con 0x7effa0004d00 2024-09-13T16:01:50.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.431+0000 7effbbe00640 1 -- 172.21.15.70:0/3487024795 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb400f040 con 0x7effa0004d00 2024-09-13T16:01:50.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.431+0000 7effbbe00640 1 -- 172.21.15.70:0/3487024795 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4031970 con 0x7effa0004d00 2024-09-13T16:01:50.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.431+0000 7effc3a00640 1 -- 172.21.15.70:0/3487024795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effa0004d00 msgr2=0x7effa0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:50.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.431+0000 7effc3a00640 1 --2- 172.21.15.70:0/3487024795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effa0004d00 0x7effa0005180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7effb4009f90 tx=0x7effa00057f0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.431+0000 7effc1a00640 1 -- 172.21.15.70:0/3487024795 reap_dead start 2024-09-13T16:01:50.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.431+0000 7effc3a00640 1 -- 172.21.15.70:0/3487024795 shutdown_connections 2024-09-13T16:01:50.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.431+0000 7effc3a00640 1 -- 172.21.15.70:0/3487024795 >> 172.21.15.70:0/3487024795 conn(0x7effbc0b0580 msgr2=0x7effbc0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:50.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.431+0000 7effc3a00640 1 -- 172.21.15.70:0/3487024795 shutdown_connections 2024-09-13T16:01:50.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.431+0000 7effc3a00640 1 -- 172.21.15.70:0/3487024795 wait complete. 2024-09-13T16:01:50.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.433+0000 7effc3a00640 1 Processor -- start 2024-09-13T16:01:50.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.433+0000 7effc3a00640 1 -- start start 2024-09-13T16:01:50.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.434+0000 7effc3a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effa0004d00 0x7effbc15d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.434+0000 7effc3a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effbc14bbd0 0x7effbc155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.434+0000 7effc3a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effbc14c050 0x7effbc1563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.434+0000 7effc3a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc13abc0 con 0x7effa0004d00 2024-09-13T16:01:50.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.434+0000 7effc3a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc15bfb0 con 0x7effbc14c050 2024-09-13T16:01:50.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.434+0000 7effc3a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc15c200 con 0x7effbc14bbd0 2024-09-13T16:01:50.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.434+0000 7effc1000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effa0004d00 0x7effbc15d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.434+0000 7effc1000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effa0004d00 0x7effbc15d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44112/0 (socket says 172.21.15.70:44112) 2024-09-13T16:01:50.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.434+0000 7effc1000640 1 -- 172.21.15.70:0/990481141 learned_addr learned my addr 172.21.15.70:0/990481141 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:50.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.434+0000 7effc1a00640 1 --2- 172.21.15.70:0/990481141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effbc14c050 0x7effbc1563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.434+0000 7effb3e00640 1 --2- 172.21.15.70:0/990481141 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effbc14bbd0 0x7effbc155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.435+0000 7effc1000640 1 -- 172.21.15.70:0/990481141 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effbc14bbd0 msgr2=0x7effbc155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:50.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.435+0000 7effc1000640 1 --2- 172.21.15.70:0/990481141 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effbc14bbd0 0x7effbc155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.435+0000 7effc1000640 1 -- 172.21.15.70:0/990481141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effbc14c050 msgr2=0x7effbc1563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:50.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.435+0000 7effc1000640 1 --2- 172.21.15.70:0/990481141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effbc14c050 0x7effbc1563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.435+0000 7effc1000640 1 -- 172.21.15.70:0/990481141 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc15c4e0 con 0x7effa0004d00 2024-09-13T16:01:50.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.435+0000 7effc1a00640 1 --2- 172.21.15.70:0/990481141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effbc14c050 0x7effbc1563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:50.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.435+0000 7effc1000640 1 --2- 172.21.15.70:0/990481141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effa0004d00 0x7effbc15d2a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7effac000ff0 tx=0x7effac00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:50.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.435+0000 7effb9600640 1 -- 172.21.15.70:0/990481141 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac00c870 con 0x7effa0004d00 2024-09-13T16:01:50.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.435+0000 7effb9600640 1 -- 172.21.15.70:0/990481141 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac00c9d0 con 0x7effa0004d00 2024-09-13T16:01:50.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.435+0000 7effc3a00640 1 -- 172.21.15.70:0/990481141 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc15c7c0 con 0x7effa0004d00 2024-09-13T16:01:50.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.435+0000 7effb9600640 1 -- 172.21.15.70:0/990481141 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac00cd40 con 0x7effa0004d00 2024-09-13T16:01:50.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.435+0000 7effc3a00640 1 -- 172.21.15.70:0/990481141 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc15cd80 con 0x7effa0004d00 2024-09-13T16:01:50.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.436+0000 7effc3a00640 1 -- 172.21.15.70:0/990481141 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc157340 con 0x7effa0004d00 2024-09-13T16:01:50.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.437+0000 7effb9600640 1 -- 172.21.15.70:0/990481141 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7effac01d460 con 0x7effa0004d00 2024-09-13T16:01:50.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.438+0000 7effb9600640 1 --2- 172.21.15.70:0/990481141 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7eff9806ac00 0x7eff9806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.438+0000 7effb9600640 1 -- 172.21.15.70:0/990481141 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effac0893c0 con 0x7effa0004d00 2024-09-13T16:01:50.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.438+0000 7effb3e00640 1 --2- 172.21.15.70:0/990481141 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7eff9806ac00 0x7eff9806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.439+0000 7effb3e00640 1 --2- 172.21.15.70:0/990481141 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7eff9806ac00 0x7eff9806d0c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7effbc0cdff0 tx=0x7effa4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:50.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.442+0000 7effb9600640 1 -- 172.21.15.70:0/990481141 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7effac054500 con 0x7effa0004d00 2024-09-13T16:01:50.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.612+0000 7effc3a00640 1 -- 172.21.15.70:0/990481141 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7effbc071190 con 0x7effa0004d00 2024-09-13T16:01:50.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.613+0000 7effb9600640 1 -- 172.21.15.70:0/990481141 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7effac057b20 con 0x7effa0004d00 2024-09-13T16:01:50.614 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-13T16:01:50.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.615+0000 7effc3a00640 1 -- 172.21.15.70:0/990481141 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7eff9806ac00 msgr2=0x7eff9806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:50.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.615+0000 7effc3a00640 1 --2- 172.21.15.70:0/990481141 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7eff9806ac00 0x7eff9806d0c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7effbc0cdff0 tx=0x7effa4008040 comp rx=0 tx=0).stop 2024-09-13T16:01:50.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.615+0000 7effc3a00640 1 -- 172.21.15.70:0/990481141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effa0004d00 msgr2=0x7effbc15d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:50.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.615+0000 7effc3a00640 1 --2- 172.21.15.70:0/990481141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effa0004d00 0x7effbc15d2a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7effac000ff0 tx=0x7effac00ec80 comp rx=0 tx=0).stop 2024-09-13T16:01:50.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.615+0000 7effc3a00640 1 -- 172.21.15.70:0/990481141 shutdown_connections 2024-09-13T16:01:50.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.615+0000 7effc3a00640 1 --2- 172.21.15.70:0/990481141 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7eff9806ac00 0x7eff9806d0c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.615+0000 7effc3a00640 1 --2- 172.21.15.70:0/990481141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effbc14c050 0x7effbc1563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.615+0000 7effc3a00640 1 --2- 172.21.15.70:0/990481141 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effbc14bbd0 0x7effbc155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.615+0000 7effc3a00640 1 --2- 172.21.15.70:0/990481141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effa0004d00 0x7effbc15d2a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.615+0000 7effc3a00640 1 -- 172.21.15.70:0/990481141 >> 172.21.15.70:0/990481141 conn(0x7effbc0b0580 msgr2=0x7effbc15a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:50.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.615+0000 7effc3a00640 1 -- 172.21.15.70:0/990481141 shutdown_connections 2024-09-13T16:01:50.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.615+0000 7effc3a00640 1 -- 172.21.15.70:0/990481141 wait complete. 2024-09-13T16:01:50.632 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:01:50.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.786+0000 7f6b72800640 1 Processor -- start 2024-09-13T16:01:50.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.787+0000 7f6b72800640 1 -- start start 2024-09-13T16:01:50.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.788+0000 7f6b72800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b6c15a420 0x7f6b6c0b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.788+0000 7f6b72800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6b6c0cbb00 0x7f6b6c0cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.788+0000 7f6b72800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6c0b30e0 con 0x7f6b6c0cbf40 2024-09-13T16:01:50.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.788+0000 7f6b72800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6c15a800 con 0x7f6b6c0cbb00 2024-09-13T16:01:50.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.788+0000 7f6b72800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c0b24d0 con 0x7f6b6c15a420 2024-09-13T16:01:50.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.788+0000 7f6b71400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b6c15a420 0x7f6b6c0b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.788+0000 7f6b70a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6b6c0cbb00 0x7f6b6c0cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.788+0000 7f6b71e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f6b6c0cbf40 0x7f6b6c15df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:41394/0 (socket says 172.21.15.70:41394) 2024-09-13T16:01:50.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.788+0000 7f6b71400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b6c15a420 0x7f6b6c0b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:49906/0 (socket says 172.21.15.70:49906) 2024-09-13T16:01:50.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.788+0000 7f6b71e00640 1 -- 172.21.15.70:0/1403624945 learned_addr learned my addr 172.21.15.70:0/1403624945 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:50.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.789+0000 7f6b70a00640 1 -- 172.21.15.70:0/1403624945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b6c15a420 msgr2=0x7f6b6c0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:50.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.789+0000 7f6b70a00640 1 --2- 172.21.15.70:0/1403624945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b6c15a420 0x7f6b6c0b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.789+0000 7f6b70a00640 1 -- 172.21.15.70:0/1403624945 >> v1:172.21.15.107:6789/0 conn(0x7f6b6c0cbf40 legacy=0x7f6b6c15df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:50.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.789+0000 7f6b70a00640 1 -- 172.21.15.70:0/1403624945 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c0b27b0 con 0x7f6b6c0cbb00 2024-09-13T16:01:50.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.790+0000 7f6b70a00640 1 --2- 172.21.15.70:0/1403624945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6c0cbb00 0x7f6b6c0cd5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6b580097a0 tx=0x7f6b5802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=600cd682557dfdf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:50.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.790+0000 7f6b6be00640 1 -- 172.21.15.70:0/1403624945 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b58032440 con 0x7f6b6c0cbb00 2024-09-13T16:01:50.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.790+0000 7f6b6be00640 1 -- 172.21.15.70:0/1403624945 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b580325a0 con 0x7f6b6c0cbb00 2024-09-13T16:01:50.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.790+0000 7f6b6be00640 1 -- 172.21.15.70:0/1403624945 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b58032930 con 0x7f6b6c0cbb00 2024-09-13T16:01:50.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.791+0000 7f6b72800640 1 -- 172.21.15.70:0/1403624945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6c0cbb00 msgr2=0x7f6b6c0cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:50.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.791+0000 7f6b72800640 1 --2- 172.21.15.70:0/1403624945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6c0cbb00 0x7f6b6c0cd5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6b580097a0 tx=0x7f6b5802a180 comp rx=0 tx=0).stop 2024-09-13T16:01:50.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.791+0000 7f6b72800640 1 -- 172.21.15.70:0/1403624945 shutdown_connections 2024-09-13T16:01:50.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.791+0000 7f6b72800640 1 --2- 172.21.15.70:0/1403624945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6c0cbb00 0x7f6b6c0cd5a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.791+0000 7f6b72800640 1 --2- 172.21.15.70:0/1403624945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b6c15a420 0x7f6b6c0b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.791+0000 7f6b72800640 1 -- 172.21.15.70:0/1403624945 >> 172.21.15.70:0/1403624945 conn(0x7f6b6c069ed0 msgr2=0x7f6b6c06a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:50.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.791+0000 7f6b72800640 1 -- 172.21.15.70:0/1403624945 shutdown_connections 2024-09-13T16:01:50.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.791+0000 7f6b72800640 1 -- 172.21.15.70:0/1403624945 wait complete. 2024-09-13T16:01:50.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.793+0000 7f6b72800640 1 Processor -- start 2024-09-13T16:01:50.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.793+0000 7f6b72800640 1 -- start start 2024-09-13T16:01:50.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.793+0000 7f6b72800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b6c0cbb00 0x7f6b6c151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.794+0000 7f6b72800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6c0cbf40 0x7f6b6c152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.794+0000 7f6b72800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b6c15a420 0x7f6b6c06f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.794+0000 7f6b72800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c152a50 con 0x7f6b6c0cbb00 2024-09-13T16:01:50.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.794+0000 7f6b72800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c06fd00 con 0x7f6b6c0cbf40 2024-09-13T16:01:50.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.794+0000 7f6b72800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c06ffe0 con 0x7f6b6c15a420 2024-09-13T16:01:50.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.794+0000 7f6b71400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b6c0cbb00 0x7f6b6c151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.794+0000 7f6b71400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b6c0cbb00 0x7f6b6c151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44124/0 (socket says 172.21.15.70:44124) 2024-09-13T16:01:50.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.794+0000 7f6b71400640 1 -- 172.21.15.70:0/63746301 learned_addr learned my addr 172.21.15.70:0/63746301 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:50.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.794+0000 7f6b71e00640 1 --2- 172.21.15.70:0/63746301 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b6c15a420 0x7f6b6c06f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.794+0000 7f6b70a00640 1 --2- 172.21.15.70:0/63746301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6c0cbf40 0x7f6b6c152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.794+0000 7f6b71400640 1 -- 172.21.15.70:0/63746301 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b6c15a420 msgr2=0x7f6b6c06f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:50.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.794+0000 7f6b71400640 1 --2- 172.21.15.70:0/63746301 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b6c15a420 0x7f6b6c06f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.794+0000 7f6b71400640 1 -- 172.21.15.70:0/63746301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6c0cbf40 msgr2=0x7f6b6c152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:50.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.794+0000 7f6b71400640 1 --2- 172.21.15.70:0/63746301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6c0cbf40 0x7f6b6c152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.794+0000 7f6b71400640 1 -- 172.21.15.70:0/63746301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b58009400 con 0x7f6b6c0cbb00 2024-09-13T16:01:50.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.795+0000 7f6b71400640 1 --2- 172.21.15.70:0/63746301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b6c0cbb00 0x7f6b6c151850 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6b6000e870 tx=0x7f6b6000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:50.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.795+0000 7f6b69600640 1 -- 172.21.15.70:0/63746301 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b600094f0 con 0x7f6b6c0cbb00 2024-09-13T16:01:50.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.795+0000 7f6b69600640 1 -- 172.21.15.70:0/63746301 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6000c940 con 0x7f6b6c0cbb00 2024-09-13T16:01:50.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.795+0000 7f6b69600640 1 -- 172.21.15.70:0/63746301 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6000ccf0 con 0x7f6b6c0cbb00 2024-09-13T16:01:50.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.795+0000 7f6b72800640 1 -- 172.21.15.70:0/63746301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6c0702c0 con 0x7f6b6c0cbb00 2024-09-13T16:01:50.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.795+0000 7f6b72800640 1 -- 172.21.15.70:0/63746301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6c06f9f0 con 0x7f6b6c0cbb00 2024-09-13T16:01:50.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.796+0000 7f6b72800640 1 -- 172.21.15.70:0/63746301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6c0b1ed0 con 0x7f6b6c0cbb00 2024-09-13T16:01:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.797+0000 7f6b69600640 1 -- 172.21.15.70:0/63746301 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6b60013470 con 0x7f6b6c0cbb00 2024-09-13T16:01:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.798+0000 7f6b69600640 1 --2- 172.21.15.70:0/63746301 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6b4c06ac00 0x7f6b4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.798+0000 7f6b69600640 1 -- 172.21.15.70:0/63746301 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b600894a0 con 0x7f6b6c0cbb00 2024-09-13T16:01:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.798+0000 7f6b70a00640 1 --2- 172.21.15.70:0/63746301 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6b4c06ac00 0x7f6b4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.799+0000 7f6b70a00640 1 --2- 172.21.15.70:0/63746301 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6b4c06ac00 0x7f6b4c06d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6b58034000 tx=0x7f6b5802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:50.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.802+0000 7f6b69600640 1 -- 172.21.15.70:0/63746301 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6b60054670 con 0x7f6b6c0cbb00 2024-09-13T16:01:50.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.968+0000 7f6b72800640 1 -- 172.21.15.70:0/63746301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b6c067d80 con 0x7f6b6c0cbb00 2024-09-13T16:01:50.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.969+0000 7f6b69600640 1 -- 172.21.15.70:0/63746301 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b6c067d80 con 0x7f6b6c0cbb00 2024-09-13T16:01:50.970 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-13T16:01:50.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.971+0000 7f6b72800640 1 -- 172.21.15.70:0/63746301 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6b4c06ac00 msgr2=0x7f6b4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:50.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.971+0000 7f6b72800640 1 --2- 172.21.15.70:0/63746301 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6b4c06ac00 0x7f6b4c06d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6b58034000 tx=0x7f6b5802e000 comp rx=0 tx=0).stop 2024-09-13T16:01:50.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.971+0000 7f6b72800640 1 -- 172.21.15.70:0/63746301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b6c0cbb00 msgr2=0x7f6b6c151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:50.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.971+0000 7f6b72800640 1 --2- 172.21.15.70:0/63746301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b6c0cbb00 0x7f6b6c151850 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6b6000e870 tx=0x7f6b6000ed30 comp rx=0 tx=0).stop 2024-09-13T16:01:50.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.971+0000 7f6b72800640 1 -- 172.21.15.70:0/63746301 shutdown_connections 2024-09-13T16:01:50.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.971+0000 7f6b72800640 1 --2- 172.21.15.70:0/63746301 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b6c15a420 0x7f6b6c06f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.971+0000 7f6b72800640 1 --2- 172.21.15.70:0/63746301 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6b4c06ac00 0x7f6b4c06d0c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.971+0000 7f6b72800640 1 --2- 172.21.15.70:0/63746301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6c0cbf40 0x7f6b6c152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.971+0000 7f6b72800640 1 --2- 172.21.15.70:0/63746301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b6c0cbb00 0x7f6b6c151850 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:50.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.971+0000 7f6b72800640 1 -- 172.21.15.70:0/63746301 >> 172.21.15.70:0/63746301 conn(0x7f6b6c069ed0 msgr2=0x7f6b6c1567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:50.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.971+0000 7f6b72800640 1 -- 172.21.15.70:0/63746301 shutdown_connections 2024-09-13T16:01:50.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:50.971+0000 7f6b72800640 1 -- 172.21.15.70:0/63746301 wait complete. 2024-09-13T16:01:51.017 INFO:tasks.cephfs_test_runner:Starting test: test_replay_create (tasks.cephfs.test_cap_flush.TestCapFlush) MDS starts to handle client caps when it enters clientreplay stage. 2024-09-13T16:01:51.017 INFO:tasks.cephfs_test_runner:test_replay_create (tasks.cephfs.test_cap_flush.TestCapFlush) 2024-09-13T16:01:51.017 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:51.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.168+0000 7f3337a00640 1 Processor -- start 2024-09-13T16:01:51.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.168+0000 7f3337a00640 1 -- start start 2024-09-13T16:01:51.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.169+0000 7f3337a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3330153b20 0x7f33300b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:51.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.169+0000 7f3337a00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3330153f00 con 0x7f3330159a80 2024-09-13T16:01:51.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.169+0000 7f3337a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33300b1a40 con 0x7f333006f660 2024-09-13T16:01:51.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.169+0000 7f3337a00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33300ce600 con 0x7f3330153b20 2024-09-13T16:01:51.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.170+0000 7f3335000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3330153b20 0x7f33300b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:51.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.170+0000 7f3335000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3330153b20 0x7f33300b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44140/0 (socket says 172.21.15.70:44140) 2024-09-13T16:01:51.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.170+0000 7f3335000640 1 -- 172.21.15.70:0/3059029356 learned_addr learned my addr 172.21.15.70:0/3059029356 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:51.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.170+0000 7f3335000640 1 -- 172.21.15.70:0/3059029356 >> v1:172.21.15.107:6789/0 conn(0x7f333006f660 legacy=0x7f333006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:51.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.170+0000 7f3335000640 1 -- 172.21.15.70:0/3059029356 >> v1:172.21.15.70:6789/0 conn(0x7f3330159a80 legacy=0x7f33300b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:51.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.170+0000 7f3335000640 1 -- 172.21.15.70:0/3059029356 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333015a1f0 con 0x7f3330153b20 2024-09-13T16:01:51.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.171+0000 7f3335000640 1 --2- 172.21.15.70:0/3059029356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3330153b20 0x7f33300b3990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3324009870 tx=0x7f332402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c202a83670db991a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:51.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.171+0000 7f332f400640 1 -- 172.21.15.70:0/3059029356 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324032440 con 0x7f3330153b20 2024-09-13T16:01:51.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.171+0000 7f332f400640 1 -- 172.21.15.70:0/3059029356 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33240325a0 con 0x7f3330153b20 2024-09-13T16:01:51.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.171+0000 7f332f400640 1 -- 172.21.15.70:0/3059029356 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324032930 con 0x7f3330153b20 2024-09-13T16:01:51.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.172+0000 7f3337a00640 1 -- 172.21.15.70:0/3059029356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3330153b20 msgr2=0x7f33300b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:51.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.172+0000 7f3337a00640 1 --2- 172.21.15.70:0/3059029356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3330153b20 0x7f33300b3990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3324009870 tx=0x7f332402a2a0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.172+0000 7f3337a00640 1 -- 172.21.15.70:0/3059029356 shutdown_connections 2024-09-13T16:01:51.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.172+0000 7f3337a00640 1 --2- 172.21.15.70:0/3059029356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3330153b20 0x7f33300b3990 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.172+0000 7f3337a00640 1 -- 172.21.15.70:0/3059029356 >> 172.21.15.70:0/3059029356 conn(0x7f33300b0510 msgr2=0x7f33300b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:51.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.172+0000 7f3337a00640 1 -- 172.21.15.70:0/3059029356 shutdown_connections 2024-09-13T16:01:51.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.172+0000 7f3337a00640 1 -- 172.21.15.70:0/3059029356 wait complete. 2024-09-13T16:01:51.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.174+0000 7f3337a00640 1 Processor -- start 2024-09-13T16:01:51.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.174+0000 7f3337a00640 1 -- start start 2024-09-13T16:01:51.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.174+0000 7f3337a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f333006f660 0x7f33300ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:51.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.174+0000 7f3337a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3330153b20 0x7f33301676a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:51.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.175+0000 7f3337a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3330159a80 0x7f333014e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:51.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.175+0000 7f3337a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3330153520 con 0x7f3330153b20 2024-09-13T16:01:51.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.175+0000 7f3337a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3330152910 con 0x7f333006f660 2024-09-13T16:01:51.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.175+0000 7f3337a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3330152bf0 con 0x7f3330159a80 2024-09-13T16:01:51.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.175+0000 7f332fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3330153b20 0x7f33301676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:51.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.175+0000 7f332fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3330153b20 0x7f33301676a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44148/0 (socket says 172.21.15.70:44148) 2024-09-13T16:01:51.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.175+0000 7f332fe00640 1 -- 172.21.15.70:0/3887729597 learned_addr learned my addr 172.21.15.70:0/3887729597 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:51.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.175+0000 7f3335a00640 1 --2- 172.21.15.70:0/3887729597 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3330159a80 0x7f333014e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:51.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.175+0000 7f3335000640 1 --2- 172.21.15.70:0/3887729597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f333006f660 0x7f33300ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:51.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.175+0000 7f332fe00640 1 -- 172.21.15.70:0/3887729597 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3330159a80 msgr2=0x7f333014e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:51.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.175+0000 7f332fe00640 1 --2- 172.21.15.70:0/3887729597 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3330159a80 0x7f333014e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.175+0000 7f332fe00640 1 -- 172.21.15.70:0/3887729597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f333006f660 msgr2=0x7f33300ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:51.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.175+0000 7f332fe00640 1 --2- 172.21.15.70:0/3887729597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f333006f660 0x7f33300ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.175+0000 7f332fe00640 1 -- 172.21.15.70:0/3887729597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33240094d0 con 0x7f3330153b20 2024-09-13T16:01:51.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.175+0000 7f3335a00640 1 --2- 172.21.15.70:0/3887729597 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3330159a80 0x7f333014e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:51.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.175+0000 7f3335000640 1 --2- 172.21.15.70:0/3887729597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f333006f660 0x7f33300ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:51.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.175+0000 7f332fe00640 1 --2- 172.21.15.70:0/3887729597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3330153b20 0x7f33301676a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f331c00c400 tx=0x7f331c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:51.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.176+0000 7f332cc00640 1 -- 172.21.15.70:0/3887729597 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c0052d0 con 0x7f3330153b20 2024-09-13T16:01:51.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.176+0000 7f332cc00640 1 -- 172.21.15.70:0/3887729597 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331c005450 con 0x7f3330153b20 2024-09-13T16:01:51.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.176+0000 7f332cc00640 1 -- 172.21.15.70:0/3887729597 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c007260 con 0x7f3330153b20 2024-09-13T16:01:51.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.176+0000 7f3337a00640 1 -- 172.21.15.70:0/3887729597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3330152ed0 con 0x7f3330153b20 2024-09-13T16:01:51.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.176+0000 7f3337a00640 1 -- 172.21.15.70:0/3887729597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333006d870 con 0x7f3330153b20 2024-09-13T16:01:51.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.177+0000 7f3337a00640 1 -- 172.21.15.70:0/3887729597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3330153660 con 0x7f3330153b20 2024-09-13T16:01:51.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.178+0000 7f332cc00640 1 -- 172.21.15.70:0/3887729597 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f331c0073c0 con 0x7f3330153b20 2024-09-13T16:01:51.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.178+0000 7f332cc00640 1 --2- 172.21.15.70:0/3887729597 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f331006ac00 0x7f331006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:51.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.179+0000 7f332cc00640 1 -- 172.21.15.70:0/3887729597 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f331c088840 con 0x7f3330153b20 2024-09-13T16:01:51.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.179+0000 7f3335000640 1 --2- 172.21.15.70:0/3887729597 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f331006ac00 0x7f331006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:51.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.179+0000 7f3335000640 1 --2- 172.21.15.70:0/3887729597 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f331006ac00 0x7f331006d0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3324034000 tx=0x7f332402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:51.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.183+0000 7f332cc00640 1 -- 172.21.15.70:0/3887729597 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f331c053980 con 0x7f3330153b20 2024-09-13T16:01:51.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.353+0000 7f3337a00640 1 -- 172.21.15.70:0/3887729597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33300b3990 con 0x7f3330153b20 2024-09-13T16:01:51.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.354+0000 7f332cc00640 1 -- 172.21.15.70:0/3887729597 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f331c056fa0 con 0x7f3330153b20 2024-09-13T16:01:51.356 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:51.356 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:19.595458+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:51.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.356+0000 7f3337a00640 1 -- 172.21.15.70:0/3887729597 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f331006ac00 msgr2=0x7f331006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:51.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.356+0000 7f3337a00640 1 --2- 172.21.15.70:0/3887729597 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f331006ac00 0x7f331006d0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3324034000 tx=0x7f332402e000 comp rx=0 tx=0).stop 2024-09-13T16:01:51.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.356+0000 7f3337a00640 1 -- 172.21.15.70:0/3887729597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3330153b20 msgr2=0x7f33301676a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:51.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.356+0000 7f3337a00640 1 --2- 172.21.15.70:0/3887729597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3330153b20 0x7f33301676a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f331c00c400 tx=0x7f331c00c8c0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.356+0000 7f3337a00640 1 -- 172.21.15.70:0/3887729597 shutdown_connections 2024-09-13T16:01:51.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.356+0000 7f3337a00640 1 --2- 172.21.15.70:0/3887729597 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3330159a80 0x7f333014e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.356+0000 7f3337a00640 1 --2- 172.21.15.70:0/3887729597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3330153b20 0x7f33301676a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.356+0000 7f3337a00640 1 --2- 172.21.15.70:0/3887729597 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f331006ac00 0x7f331006d0c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.356+0000 7f3337a00640 1 --2- 172.21.15.70:0/3887729597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f333006f660 0x7f33300ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.356+0000 7f3337a00640 1 -- 172.21.15.70:0/3887729597 >> 172.21.15.70:0/3887729597 conn(0x7f33300b0510 msgr2=0x7f333006cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:51.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.356+0000 7f3337a00640 1 -- 172.21.15.70:0/3887729597 shutdown_connections 2024-09-13T16:01:51.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.356+0000 7f3337a00640 1 -- 172.21.15.70:0/3887729597 wait complete. 2024-09-13T16:01:51.374 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:01:06.070694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:01:16.922043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:01:17.580304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:01:51.375 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:01:51.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.527+0000 7fc2ab200640 1 Processor -- start 2024-09-13T16:01:51.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.527+0000 7fc2ab200640 1 -- start start 2024-09-13T16:01:51.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.529+0000 7fc2ab200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc2a4154ad0 0x7fc2a40cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:51.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.529+0000 7fc2ab200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc2a406f830 0x7fc2a406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:51.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.529+0000 7fc2ab200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc2a40ce2c0 0x7fc2a40cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:51.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.529+0000 7fc2ab200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a406b5b0 con 0x7fc2a4154ad0 2024-09-13T16:01:51.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.529+0000 7fc2ab200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a406b7c0 con 0x7fc2a406f830 2024-09-13T16:01:51.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.529+0000 7fc2ab200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a406baa0 con 0x7fc2a40ce2c0 2024-09-13T16:01:51.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.529+0000 7fc2a3e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc2a4154ad0 0x7fc2a40cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:51.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.529+0000 7fc2a3e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc2a4154ad0 0x7fc2a40cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44154/0 (socket says 172.21.15.70:44154) 2024-09-13T16:01:51.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.529+0000 7fc2a3e00640 1 -- 172.21.15.70:0/1842793401 learned_addr learned my addr 172.21.15.70:0/1842793401 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:51.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.529+0000 7fc2a9200640 1 --2- 172.21.15.70:0/1842793401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc2a40ce2c0 0x7fc2a40cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:51.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.529+0000 7fc2a3400640 1 --2- 172.21.15.70:0/1842793401 >> v2:172.21.15.107:3300/0 conn(0x7fc2a406f830 0x7fc2a406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:51.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.529+0000 7fc2a3e00640 1 -- 172.21.15.70:0/1842793401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc2a40ce2c0 msgr2=0x7fc2a40cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:51.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.529+0000 7fc2a3e00640 1 --2- 172.21.15.70:0/1842793401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc2a40ce2c0 0x7fc2a40cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.529+0000 7fc2a3e00640 1 -- 172.21.15.70:0/1842793401 >> v2:172.21.15.107:3300/0 conn(0x7fc2a406f830 msgr2=0x7fc2a406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:51.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.529+0000 7fc2a3e00640 1 --2- 172.21.15.70:0/1842793401 >> v2:172.21.15.107:3300/0 conn(0x7fc2a406f830 0x7fc2a406fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.529+0000 7fc2a3e00640 1 -- 172.21.15.70:0/1842793401 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a406bd80 con 0x7fc2a4154ad0 2024-09-13T16:01:51.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.529+0000 7fc2a9200640 1 --2- 172.21.15.70:0/1842793401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc2a40ce2c0 0x7fc2a40cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:51.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.529+0000 7fc2a3400640 1 --2- 172.21.15.70:0/1842793401 >> v2:172.21.15.107:3300/0 conn(0x7fc2a406f830 0x7fc2a406fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:51.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.530+0000 7fc2a3e00640 1 --2- 172.21.15.70:0/1842793401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2a4154ad0 0x7fc2a40cdd80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40ae4c0 tx=0x7fc29402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08751a9e5eaad78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:51.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.531+0000 7fc2a2a00640 1 -- 172.21.15.70:0/1842793401 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29402ae90 con 0x7fc2a4154ad0 2024-09-13T16:01:51.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.531+0000 7fc2a2a00640 1 -- 172.21.15.70:0/1842793401 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc294032440 con 0x7fc2a4154ad0 2024-09-13T16:01:51.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.531+0000 7fc2a2a00640 1 -- 172.21.15.70:0/1842793401 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2940327d0 con 0x7fc2a4154ad0 2024-09-13T16:01:51.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.531+0000 7fc2ab200640 1 -- 172.21.15.70:0/1842793401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2a4154ad0 msgr2=0x7fc2a40cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:51.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.531+0000 7fc2ab200640 1 --2- 172.21.15.70:0/1842793401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2a4154ad0 0x7fc2a40cdd80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40ae4c0 tx=0x7fc29402a140 comp rx=0 tx=0).stop 2024-09-13T16:01:51.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.531+0000 7fc2ab200640 1 -- 172.21.15.70:0/1842793401 shutdown_connections 2024-09-13T16:01:51.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.531+0000 7fc2ab200640 1 --2- 172.21.15.70:0/1842793401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc2a40ce2c0 0x7fc2a40cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.531+0000 7fc2ab200640 1 --2- 172.21.15.70:0/1842793401 >> v2:172.21.15.107:3300/0 conn(0x7fc2a406f830 0x7fc2a406fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.531+0000 7fc2ab200640 1 --2- 172.21.15.70:0/1842793401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2a4154ad0 0x7fc2a40cdd80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.531+0000 7fc2ab200640 1 -- 172.21.15.70:0/1842793401 >> 172.21.15.70:0/1842793401 conn(0x7fc2a40b0580 msgr2=0x7fc2a40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:51.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.531+0000 7fc2ab200640 1 -- 172.21.15.70:0/1842793401 shutdown_connections 2024-09-13T16:01:51.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.531+0000 7fc2ab200640 1 -- 172.21.15.70:0/1842793401 wait complete. 2024-09-13T16:01:51.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.533+0000 7fc2ab200640 1 Processor -- start 2024-09-13T16:01:51.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.533+0000 7fc2ab200640 1 -- start start 2024-09-13T16:01:51.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.534+0000 7fc2ab200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc2a4154ad0 0x7fc2a41500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:51.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.534+0000 7fc2ab200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2a40cbff0 0x7fc2a41f2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.534+0000 7fc2ab200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2a4152bb0 0x7fc2a4153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.534+0000 7fc2ab200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a4153570 con 0x7fc2a40cbff0 2024-09-13T16:01:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.534+0000 7fc2ab200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a41f2d90 con 0x7fc2a4152bb0 2024-09-13T16:01:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.534+0000 7fc2ab200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a41f3080 con 0x7fc2a4154ad0 2024-09-13T16:01:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.534+0000 7fc2a3400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2a40cbff0 0x7fc2a41f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.534+0000 7fc2a3400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2a40cbff0 0x7fc2a41f2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44158/0 (socket says 172.21.15.70:44158) 2024-09-13T16:01:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.534+0000 7fc2a3400640 1 -- 172.21.15.70:0/2126600285 learned_addr learned my addr 172.21.15.70:0/2126600285 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.534+0000 7fc2a3e00640 1 --2- 172.21.15.70:0/2126600285 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc2a4154ad0 0x7fc2a41500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.534+0000 7fc2a9200640 1 --2- 172.21.15.70:0/2126600285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2a4152bb0 0x7fc2a4153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.535+0000 7fc2a3400640 1 -- 172.21.15.70:0/2126600285 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc2a4154ad0 msgr2=0x7fc2a41500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.535+0000 7fc2a3400640 1 --2- 172.21.15.70:0/2126600285 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc2a4154ad0 0x7fc2a41500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.535+0000 7fc2a3400640 1 -- 172.21.15.70:0/2126600285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2a4152bb0 msgr2=0x7fc2a4153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.535+0000 7fc2a3400640 1 --2- 172.21.15.70:0/2126600285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2a4152bb0 0x7fc2a4153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.535+0000 7fc2a3400640 1 -- 172.21.15.70:0/2126600285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2940094d0 con 0x7fc2a40cbff0 2024-09-13T16:01:51.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.535+0000 7fc2a9200640 1 --2- 172.21.15.70:0/2126600285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2a4152bb0 0x7fc2a4153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:51.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.535+0000 7fc2a3400640 1 --2- 172.21.15.70:0/2126600285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2a40cbff0 0x7fc2a41f2850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc29000c7f0 tx=0x7fc29000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:51.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.535+0000 7fc29be00640 1 -- 172.21.15.70:0/2126600285 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29000cea0 con 0x7fc2a40cbff0 2024-09-13T16:01:51.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.535+0000 7fc29be00640 1 -- 172.21.15.70:0/2126600285 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc290007a30 con 0x7fc2a40cbff0 2024-09-13T16:01:51.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.535+0000 7fc2ab200640 1 -- 172.21.15.70:0/2126600285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a41f3360 con 0x7fc2a40cbff0 2024-09-13T16:01:51.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.535+0000 7fc29be00640 1 -- 172.21.15.70:0/2126600285 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290007dc0 con 0x7fc2a40cbff0 2024-09-13T16:01:51.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.535+0000 7fc2ab200640 1 -- 172.21.15.70:0/2126600285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a41f3920 con 0x7fc2a40cbff0 2024-09-13T16:01:51.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.536+0000 7fc2ab200640 1 -- 172.21.15.70:0/2126600285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a41f3e40 con 0x7fc2a40cbff0 2024-09-13T16:01:51.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.537+0000 7fc29be00640 1 -- 172.21.15.70:0/2126600285 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc2900113f0 con 0x7fc2a40cbff0 2024-09-13T16:01:51.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.538+0000 7fc29be00640 1 --2- 172.21.15.70:0/2126600285 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fc28406ac30 0x7fc28406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:51.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.538+0000 7fc29be00640 1 -- 172.21.15.70:0/2126600285 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2900893d0 con 0x7fc2a40cbff0 2024-09-13T16:01:51.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.538+0000 7fc2a3e00640 1 --2- 172.21.15.70:0/2126600285 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fc28406ac30 0x7fc28406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:51.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.539+0000 7fc2a3e00640 1 --2- 172.21.15.70:0/2126600285 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fc28406ac30 0x7fc28406d0f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc294034000 tx=0x7fc29402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.542+0000 7fc29be00640 1 -- 172.21.15.70:0/2126600285 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc2a41f3e40 con 0x7fc2a40cbff0 2024-09-13T16:01:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.709+0000 7fc2ab200640 1 -- 172.21.15.70:0/2126600285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc2a41f3e40 con 0x7fc2a40cbff0 2024-09-13T16:01:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.710+0000 7fc29be00640 1 -- 172.21.15.70:0/2126600285 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc2a41f3e40 con 0x7fc2a40cbff0 2024-09-13T16:01:51.711 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-13T16:01:51.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.712+0000 7fc2ab200640 1 -- 172.21.15.70:0/2126600285 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fc28406ac30 msgr2=0x7fc28406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:51.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.712+0000 7fc2ab200640 1 --2- 172.21.15.70:0/2126600285 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fc28406ac30 0x7fc28406d0f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc294034000 tx=0x7fc29402e000 comp rx=0 tx=0).stop 2024-09-13T16:01:51.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.712+0000 7fc2ab200640 1 -- 172.21.15.70:0/2126600285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2a40cbff0 msgr2=0x7fc2a41f2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.712+0000 7fc2ab200640 1 --2- 172.21.15.70:0/2126600285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2a40cbff0 0x7fc2a41f2850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc29000c7f0 tx=0x7fc29000ccb0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.712+0000 7fc2ab200640 1 -- 172.21.15.70:0/2126600285 shutdown_connections 2024-09-13T16:01:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.712+0000 7fc2ab200640 1 --2- 172.21.15.70:0/2126600285 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fc28406ac30 0x7fc28406d0f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.712+0000 7fc2ab200640 1 --2- 172.21.15.70:0/2126600285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2a4152bb0 0x7fc2a4153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.712+0000 7fc2ab200640 1 --2- 172.21.15.70:0/2126600285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2a40cbff0 0x7fc2a41f2850 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.712+0000 7fc2ab200640 1 --2- 172.21.15.70:0/2126600285 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc2a4154ad0 0x7fc2a41500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.712+0000 7fc2ab200640 1 -- 172.21.15.70:0/2126600285 >> 172.21.15.70:0/2126600285 conn(0x7fc2a40b0580 msgr2=0x7fc2a415c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.712+0000 7fc2ab200640 1 -- 172.21.15.70:0/2126600285 shutdown_connections 2024-09-13T16:01:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.712+0000 7fc2ab200640 1 -- 172.21.15.70:0/2126600285 wait complete. 2024-09-13T16:01:51.729 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:01:51.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.883+0000 7fef64a00640 1 Processor -- start 2024-09-13T16:01:51.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.883+0000 7fef64a00640 1 -- start start 2024-09-13T16:01:51.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.884+0000 7fef64a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef60156f30 0x7fef6015a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:51.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.884+0000 7fef64a00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef60157310 con 0x7fef600b1db0 2024-09-13T16:01:51.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.884+0000 7fef64a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef600b29c0 con 0x7fef6006b630 2024-09-13T16:01:51.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.884+0000 7fef64a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef600b2ca0 con 0x7fef60156f30 2024-09-13T16:01:51.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.884+0000 7fef5fe00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fef600b1db0 0x7fef600cc4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49602/0 (socket says 172.21.15.70:49602) 2024-09-13T16:01:51.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.884+0000 7fef5fe00640 1 -- 172.21.15.70:0/383005328 learned_addr learned my addr 172.21.15.70:0/383005328 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:51.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.885+0000 7fef5f400640 1 --2- 172.21.15.70:0/383005328 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef60156f30 0x7fef6015a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:51.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.885+0000 7fef5ea00640 1 -- 172.21.15.70:0/383005328 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197492460 0 0) 0x7fef60157310 con 0x7fef600b1db0 2024-09-13T16:01:51.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.885+0000 7fef5ea00640 1 -- 172.21.15.70:0/383005328 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef44003520 con 0x7fef600b1db0 2024-09-13T16:01:51.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.885+0000 7fef5ea00640 1 -- 172.21.15.70:0/383005328 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760533641 0 0) 0x7fef600b29c0 con 0x7fef6006b630 2024-09-13T16:01:51.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.885+0000 7fef5ea00640 1 -- 172.21.15.70:0/383005328 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef60157310 con 0x7fef6006b630 2024-09-13T16:01:51.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.885+0000 7fef5f400640 1 -- 172.21.15.70:0/383005328 >> v1:172.21.15.107:6789/0 conn(0x7fef6006b630 legacy=0x7fef600b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:51.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.885+0000 7fef5f400640 1 -- 172.21.15.70:0/383005328 >> v1:172.21.15.70:6789/0 conn(0x7fef600b1db0 legacy=0x7fef600cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:51.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.885+0000 7fef5f400640 1 -- 172.21.15.70:0/383005328 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef600b2f80 con 0x7fef60156f30 2024-09-13T16:01:51.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.886+0000 7fef5f400640 1 --2- 172.21.15.70:0/383005328 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef60156f30 0x7fef6015a460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fef500097d0 tx=0x7fef5002a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4670ad1c056117a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:51.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.886+0000 7fef5ea00640 1 -- 172.21.15.70:0/383005328 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50032440 con 0x7fef60156f30 2024-09-13T16:01:51.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.886+0000 7fef5ea00640 1 -- 172.21.15.70:0/383005328 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef500325a0 con 0x7fef60156f30 2024-09-13T16:01:51.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.886+0000 7fef5ea00640 1 -- 172.21.15.70:0/383005328 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50032910 con 0x7fef60156f30 2024-09-13T16:01:51.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.887+0000 7fef64a00640 1 -- 172.21.15.70:0/383005328 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef60156f30 msgr2=0x7fef6015a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:51.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.887+0000 7fef64a00640 1 --2- 172.21.15.70:0/383005328 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef60156f30 0x7fef6015a460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fef500097d0 tx=0x7fef5002a200 comp rx=0 tx=0).stop 2024-09-13T16:01:51.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.887+0000 7fef64a00640 1 -- 172.21.15.70:0/383005328 shutdown_connections 2024-09-13T16:01:51.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.887+0000 7fef64a00640 1 --2- 172.21.15.70:0/383005328 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef60156f30 0x7fef6015a460 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.887+0000 7fef64a00640 1 -- 172.21.15.70:0/383005328 >> 172.21.15.70:0/383005328 conn(0x7fef60069ed0 msgr2=0x7fef6006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:51.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.887+0000 7fef64a00640 1 -- 172.21.15.70:0/383005328 shutdown_connections 2024-09-13T16:01:51.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.887+0000 7fef64a00640 1 -- 172.21.15.70:0/383005328 wait complete. 2024-09-13T16:01:51.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.889+0000 7fef64a00640 1 Processor -- start 2024-09-13T16:01:51.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.889+0000 7fef64a00640 1 -- start start 2024-09-13T16:01:51.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.890+0000 7fef64a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6006b630 0x7fef600a8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:51.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.890+0000 7fef64a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef600b1db0 0x7fef601f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:51.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.890+0000 7fef64a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef60156f30 0x7fef60151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:51.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.890+0000 7fef64a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef601f0b00 con 0x7fef6006b630 2024-09-13T16:01:51.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.890+0000 7fef64a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef601518f0 con 0x7fef600b1db0 2024-09-13T16:01:51.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.890+0000 7fef64a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef60151690 con 0x7fef60156f30 2024-09-13T16:01:51.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.890+0000 7fef5f400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6006b630 0x7fef600a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:51.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.890+0000 7fef5f400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6006b630 0x7fef600a8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44160/0 (socket says 172.21.15.70:44160) 2024-09-13T16:01:51.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.890+0000 7fef5f400640 1 -- 172.21.15.70:0/2000970619 learned_addr learned my addr 172.21.15.70:0/2000970619 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:51.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.890+0000 7fef56a00640 1 --2- 172.21.15.70:0/2000970619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef600b1db0 0x7fef601f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:51.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.890+0000 7fef5fe00640 1 --2- 172.21.15.70:0/2000970619 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef60156f30 0x7fef60151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:51.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.890+0000 7fef5f400640 1 -- 172.21.15.70:0/2000970619 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef60156f30 msgr2=0x7fef60151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:51.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.890+0000 7fef5f400640 1 --2- 172.21.15.70:0/2000970619 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef60156f30 0x7fef60151150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.890+0000 7fef5f400640 1 -- 172.21.15.70:0/2000970619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef600b1db0 msgr2=0x7fef601f05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:51.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.890+0000 7fef5f400640 1 --2- 172.21.15.70:0/2000970619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef600b1db0 0x7fef601f05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:51.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.890+0000 7fef5f400640 1 -- 172.21.15.70:0/2000970619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef50009400 con 0x7fef6006b630 2024-09-13T16:01:51.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.891+0000 7fef5f400640 1 --2- 172.21.15.70:0/2000970619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6006b630 0x7fef600a8540 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fef50000c00 tx=0x7fef500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:51.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.891+0000 7fef57e00640 1 -- 172.21.15.70:0/2000970619 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5003e860 con 0x7fef6006b630 2024-09-13T16:01:51.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.891+0000 7fef57e00640 1 -- 172.21.15.70:0/2000970619 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5003e9c0 con 0x7fef6006b630 2024-09-13T16:01:51.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.891+0000 7fef57e00640 1 -- 172.21.15.70:0/2000970619 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5003ed30 con 0x7fef6006b630 2024-09-13T16:01:51.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.891+0000 7fef64a00640 1 -- 172.21.15.70:0/2000970619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef60153830 con 0x7fef6006b630 2024-09-13T16:01:51.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.891+0000 7fef64a00640 1 -- 172.21.15.70:0/2000970619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef600afd10 con 0x7fef6006b630 2024-09-13T16:01:51.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.892+0000 7fef64a00640 1 -- 172.21.15.70:0/2000970619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6015a460 con 0x7fef6006b630 2024-09-13T16:01:51.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.893+0000 7fef57e00640 1 -- 172.21.15.70:0/2000970619 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fef5002ad50 con 0x7fef6006b630 2024-09-13T16:01:51.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.894+0000 7fef57e00640 1 --2- 172.21.15.70:0/2000970619 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fef3c06ac00 0x7fef3c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:51.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.894+0000 7fef57e00640 1 -- 172.21.15.70:0/2000970619 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef500a9fe0 con 0x7fef6006b630 2024-09-13T16:01:51.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.894+0000 7fef56a00640 1 --2- 172.21.15.70:0/2000970619 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fef3c06ac00 0x7fef3c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:51.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.895+0000 7fef56a00640 1 --2- 172.21.15.70:0/2000970619 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fef3c06ac00 0x7fef3c06d0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fef600cd3e0 tx=0x7fef48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:51.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:51.898+0000 7fef57e00640 1 -- 172.21.15.70:0/2000970619 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fef500752d0 con 0x7fef6006b630 2024-09-13T16:01:52.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.066+0000 7fef64a00640 1 -- 172.21.15.70:0/2000970619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fef60071780 con 0x7fef6006b630 2024-09-13T16:01:52.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.066+0000 7fef57e00640 1 -- 172.21.15.70:0/2000970619 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fef500788f0 con 0x7fef6006b630 2024-09-13T16:01:52.067 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-13T16:01:52.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.068+0000 7fef64a00640 1 -- 172.21.15.70:0/2000970619 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fef3c06ac00 msgr2=0x7fef3c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.068+0000 7fef64a00640 1 --2- 172.21.15.70:0/2000970619 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fef3c06ac00 0x7fef3c06d0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fef600cd3e0 tx=0x7fef48009040 comp rx=0 tx=0).stop 2024-09-13T16:01:52.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.068+0000 7fef64a00640 1 -- 172.21.15.70:0/2000970619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6006b630 msgr2=0x7fef600a8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.068+0000 7fef64a00640 1 --2- 172.21.15.70:0/2000970619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6006b630 0x7fef600a8540 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fef50000c00 tx=0x7fef500046c0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.068+0000 7fef64a00640 1 -- 172.21.15.70:0/2000970619 shutdown_connections 2024-09-13T16:01:52.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.068+0000 7fef64a00640 1 --2- 172.21.15.70:0/2000970619 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef60156f30 0x7fef60151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.068+0000 7fef64a00640 1 --2- 172.21.15.70:0/2000970619 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fef3c06ac00 0x7fef3c06d0c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.068+0000 7fef64a00640 1 --2- 172.21.15.70:0/2000970619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef600b1db0 0x7fef601f05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.068+0000 7fef64a00640 1 --2- 172.21.15.70:0/2000970619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6006b630 0x7fef600a8540 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.068+0000 7fef64a00640 1 -- 172.21.15.70:0/2000970619 >> 172.21.15.70:0/2000970619 conn(0x7fef60069ed0 msgr2=0x7fef60159850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:52.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.069+0000 7fef64a00640 1 -- 172.21.15.70:0/2000970619 shutdown_connections 2024-09-13T16:01:52.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.069+0000 7fef64a00640 1 -- 172.21.15.70:0/2000970619 wait complete. 2024-09-13T16:01:52.085 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:01:52.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.240+0000 7f5067a00640 1 Processor -- start 2024-09-13T16:01:52.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.240+0000 7f5067a00640 1 -- start start 2024-09-13T16:01:52.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.241+0000 7f5067a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f506006f830 0x7f506006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.241+0000 7f5067a00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50600ce490 con 0x7f5060070420 2024-09-13T16:01:52.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.241+0000 7f5067a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506006b7c0 con 0x7f5060154ad0 2024-09-13T16:01:52.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.241+0000 7f5067a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506006b5b0 con 0x7f506006f830 2024-09-13T16:01:52.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.242+0000 7f5065a00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5060070420 0x7f50600cbac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49618/0 (socket says 172.21.15.70:49618) 2024-09-13T16:01:52.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.242+0000 7f5065a00640 1 -- 172.21.15.70:0/1433087774 learned_addr learned my addr 172.21.15.70:0/1433087774 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:52.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.242+0000 7f505fe00640 1 --2- 172.21.15.70:0/1433087774 >> v2:172.21.15.107:3300/0 conn(0x7f506006f830 0x7f506006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.242+0000 7f505f400640 1 -- 172.21.15.70:0/1433087774 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853847609 0 0) 0x7f50600ce490 con 0x7f5060070420 2024-09-13T16:01:52.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.242+0000 7f505f400640 1 -- 172.21.15.70:0/1433087774 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5044003520 con 0x7f5060070420 2024-09-13T16:01:52.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.242+0000 7f505f400640 1 -- 172.21.15.70:0/1433087774 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678575563 0 0) 0x7f506006b7c0 con 0x7f5060154ad0 2024-09-13T16:01:52.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.242+0000 7f505f400640 1 -- 172.21.15.70:0/1433087774 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50600ce490 con 0x7f5060154ad0 2024-09-13T16:01:52.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.242+0000 7f505f400640 1 -- 172.21.15.70:0/1433087774 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 539489542 0 0) 0x7f5044003520 con 0x7f5060070420 2024-09-13T16:01:52.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.242+0000 7f505f400640 1 -- 172.21.15.70:0/1433087774 >> v2:172.21.15.107:3300/0 conn(0x7f506006f830 msgr2=0x7f506006fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:52.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.242+0000 7f505f400640 1 --2- 172.21.15.70:0/1433087774 >> v2:172.21.15.107:3300/0 conn(0x7f506006f830 0x7f506006fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.242+0000 7f505f400640 1 -- 172.21.15.70:0/1433087774 >> v1:172.21.15.107:6789/0 conn(0x7f5060154ad0 legacy=0x7f50600cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f505f400640 1 -- 172.21.15.70:0/1433087774 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506006baa0 con 0x7f5060070420 2024-09-13T16:01:52.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f505f400640 1 -- 172.21.15.70:0/1433087774 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f50580019f0 con 0x7f5060070420 2024-09-13T16:01:52.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f505f400640 1 -- 172.21.15.70:0/1433087774 >> v1:172.21.15.70:6789/0 conn(0x7f5060070420 legacy=0x7f50600cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f505f400640 1 --2- 172.21.15.70:0/1433087774 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5044003b00 0x7f5044003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f505f400640 1 --2- 172.21.15.70:0/1433087774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50440047c0 0x7f5044004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f505f400640 1 --2- 172.21.15.70:0/1433087774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5044005180 0x7f504400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f505f400640 1 -- 172.21.15.70:0/1433087774 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506006b5b0 con 0x7f50440047c0 2024-09-13T16:01:52.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f505f400640 1 -- 172.21.15.70:0/1433087774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504400c0b0 con 0x7f5044005180 2024-09-13T16:01:52.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f505f400640 1 -- 172.21.15.70:0/1433087774 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504400c270 con 0x7f5044003b00 2024-09-13T16:01:52.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f505fe00640 1 --2- 172.21.15.70:0/1433087774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50440047c0 0x7f5044004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f5065a00640 1 --2- 172.21.15.70:0/1433087774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5044005180 0x7f504400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f5065000640 1 --2- 172.21.15.70:0/1433087774 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5044003b00 0x7f5044003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f505fe00640 1 -- 172.21.15.70:0/1433087774 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5044003b00 msgr2=0x7f5044003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:52.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f505fe00640 1 --2- 172.21.15.70:0/1433087774 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5044003b00 0x7f5044003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f505fe00640 1 -- 172.21.15.70:0/1433087774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5044005180 msgr2=0x7f504400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:52.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f505fe00640 1 --2- 172.21.15.70:0/1433087774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5044005180 0x7f504400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f505fe00640 1 -- 172.21.15.70:0/1433087774 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5044003520 con 0x7f50440047c0 2024-09-13T16:01:52.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f5065a00640 1 --2- 172.21.15.70:0/1433087774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5044005180 0x7f504400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:52.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.243+0000 7f5065a00640 1 -- 172.21.15.70:0/1433087774 reap_dead start 2024-09-13T16:01:52.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.244+0000 7f505fe00640 1 --2- 172.21.15.70:0/1433087774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50440047c0 0x7f5044004c40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f504c009ac0 tx=0x7f50440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692823db6ff5640f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:52.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.245+0000 7f505f400640 1 -- 172.21.15.70:0/1433087774 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c031400 con 0x7f50440047c0 2024-09-13T16:01:52.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.245+0000 7f505f400640 1 -- 172.21.15.70:0/1433087774 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c02d050 con 0x7f50440047c0 2024-09-13T16:01:52.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.245+0000 7f505f400640 1 -- 172.21.15.70:0/1433087774 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c031780 con 0x7f50440047c0 2024-09-13T16:01:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.245+0000 7f5067a00640 1 -- 172.21.15.70:0/1433087774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50440047c0 msgr2=0x7f5044004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.245+0000 7f5067a00640 1 --2- 172.21.15.70:0/1433087774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50440047c0 0x7f5044004c40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f504c009ac0 tx=0x7f50440057f0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.245+0000 7f5067a00640 1 -- 172.21.15.70:0/1433087774 shutdown_connections 2024-09-13T16:01:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.245+0000 7f5067a00640 1 --2- 172.21.15.70:0/1433087774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50440047c0 0x7f5044004c40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.245+0000 7f5067a00640 1 -- 172.21.15.70:0/1433087774 >> 172.21.15.70:0/1433087774 conn(0x7f50600b0580 msgr2=0x7f50600b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.245+0000 7f5067a00640 1 -- 172.21.15.70:0/1433087774 shutdown_connections 2024-09-13T16:01:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.245+0000 7f5067a00640 1 -- 172.21.15.70:0/1433087774 wait complete. 2024-09-13T16:01:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.247+0000 7f5067a00640 1 Processor -- start 2024-09-13T16:01:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.247+0000 7f5067a00640 1 -- start start 2024-09-13T16:01:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.248+0000 7f5067a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50440047c0 0x7f5060139780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.248+0000 7f5067a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5060139f90 0x7f506013a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.248+0000 7f5067a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50600b2ac0 0x7f50600b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.248+0000 7f5067a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50600b2630 con 0x7f50600b2ac0 2024-09-13T16:01:52.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.248+0000 7f5067a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5060139cc0 con 0x7f50440047c0 2024-09-13T16:01:52.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.248+0000 7f5067a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50600b1a20 con 0x7f5060139f90 2024-09-13T16:01:52.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.248+0000 7f5065a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50600b2ac0 0x7f50600b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.248+0000 7f5065a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50600b2ac0 0x7f50600b2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44172/0 (socket says 172.21.15.70:44172) 2024-09-13T16:01:52.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.248+0000 7f5065a00640 1 -- 172.21.15.70:0/1349818996 learned_addr learned my addr 172.21.15.70:0/1349818996 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:52.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.248+0000 7f505fe00640 1 --2- 172.21.15.70:0/1349818996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5060139f90 0x7f506013a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.248+0000 7f5065000640 1 --2- 172.21.15.70:0/1349818996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50440047c0 0x7f5060139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.249+0000 7f5065a00640 1 -- 172.21.15.70:0/1349818996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5060139f90 msgr2=0x7f506013a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.249+0000 7f5065a00640 1 --2- 172.21.15.70:0/1349818996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5060139f90 0x7f506013a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.249+0000 7f5065a00640 1 -- 172.21.15.70:0/1349818996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50440047c0 msgr2=0x7f5060139780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.249+0000 7f5065a00640 1 --2- 172.21.15.70:0/1349818996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50440047c0 0x7f5060139780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.249+0000 7f5065a00640 1 -- 172.21.15.70:0/1349818996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50600b1d00 con 0x7f50600b2ac0 2024-09-13T16:01:52.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.249+0000 7f5065a00640 1 --2- 172.21.15.70:0/1349818996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50600b2ac0 0x7f50600b2f40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5058000f80 tx=0x7f5058007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:52.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.249+0000 7f505cc00640 1 -- 172.21.15.70:0/1349818996 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505800eb00 con 0x7f50600b2ac0 2024-09-13T16:01:52.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.249+0000 7f505cc00640 1 -- 172.21.15.70:0/1349818996 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505800ec60 con 0x7f50600b2ac0 2024-09-13T16:01:52.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.249+0000 7f505cc00640 1 -- 172.21.15.70:0/1349818996 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058014480 con 0x7f50600b2ac0 2024-09-13T16:01:52.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.249+0000 7f5067a00640 1 -- 172.21.15.70:0/1349818996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50600b1fe0 con 0x7f50600b2ac0 2024-09-13T16:01:52.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.249+0000 7f5067a00640 1 -- 172.21.15.70:0/1349818996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5060148270 con 0x7f50600b2ac0 2024-09-13T16:01:52.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.251+0000 7f5067a00640 1 -- 172.21.15.70:0/1349818996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50600cac90 con 0x7f50600b2ac0 2024-09-13T16:01:52.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.251+0000 7f505cc00640 1 -- 172.21.15.70:0/1349818996 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f505801d450 con 0x7f50600b2ac0 2024-09-13T16:01:52.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.252+0000 7f505cc00640 1 --2- 172.21.15.70:0/1349818996 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f504006ac00 0x7f504006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.252+0000 7f505cc00640 1 -- 172.21.15.70:0/1349818996 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5058088f70 con 0x7f50600b2ac0 2024-09-13T16:01:52.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.252+0000 7f5065000640 1 --2- 172.21.15.70:0/1349818996 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f504006ac00 0x7f504006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.253+0000 7f5065000640 1 --2- 172.21.15.70:0/1349818996 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f504006ac00 0x7f504006d0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5050000f60 tx=0x7f5050009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:52.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.256+0000 7f505cc00640 1 -- 172.21.15.70:0/1349818996 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f50580541f0 con 0x7f50600b2ac0 2024-09-13T16:01:52.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.425+0000 7f5067a00640 1 -- 172.21.15.70:0/1349818996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f506006fee0 con 0x7f50600b2ac0 2024-09-13T16:01:52.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.425+0000 7f505cc00640 1 -- 172.21.15.70:0/1349818996 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5058057810 con 0x7f50600b2ac0 2024-09-13T16:01:52.427 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-13T16:01:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.427+0000 7f5067a00640 1 -- 172.21.15.70:0/1349818996 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f504006ac00 msgr2=0x7f504006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.427+0000 7f5067a00640 1 --2- 172.21.15.70:0/1349818996 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f504006ac00 0x7f504006d0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5050000f60 tx=0x7f5050009040 comp rx=0 tx=0).stop 2024-09-13T16:01:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.427+0000 7f5067a00640 1 -- 172.21.15.70:0/1349818996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50600b2ac0 msgr2=0x7f50600b2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.427+0000 7f5067a00640 1 --2- 172.21.15.70:0/1349818996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50600b2ac0 0x7f50600b2f40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5058000f80 tx=0x7f5058007bc0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.427+0000 7f5067a00640 1 -- 172.21.15.70:0/1349818996 shutdown_connections 2024-09-13T16:01:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.427+0000 7f5067a00640 1 --2- 172.21.15.70:0/1349818996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50600b2ac0 0x7f50600b2f40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.427+0000 7f5067a00640 1 --2- 172.21.15.70:0/1349818996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5060139f90 0x7f506013a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.427+0000 7f5067a00640 1 --2- 172.21.15.70:0/1349818996 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f504006ac00 0x7f504006d0c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.427+0000 7f5067a00640 1 --2- 172.21.15.70:0/1349818996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50440047c0 0x7f5060139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.427+0000 7f5067a00640 1 -- 172.21.15.70:0/1349818996 >> 172.21.15.70:0/1349818996 conn(0x7f50600b0580 msgr2=0x7f50600cb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.427+0000 7f5067a00640 1 -- 172.21.15.70:0/1349818996 shutdown_connections 2024-09-13T16:01:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.427+0000 7f5067a00640 1 -- 172.21.15.70:0/1349818996 wait complete. 2024-09-13T16:01:52.445 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_cap_flush.TestCapFlush.test_replay_create' 2024-09-13T16:01:52.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.595+0000 7f4a9ee00640 1 Processor -- start 2024-09-13T16:01:52.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.595+0000 7f4a9ee00640 1 -- start start 2024-09-13T16:01:52.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.597+0000 7f4a9ee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a98153b20 0x7f4a980b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.597+0000 7f4a9ee00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4a98159a80 0x7f4a980b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.597+0000 7f4a9ee00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a98153f00 con 0x7f4a980b2410 2024-09-13T16:01:52.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.597+0000 7f4a9ee00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a980ce600 con 0x7f4a98159a80 2024-09-13T16:01:52.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.597+0000 7f4a9ee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a98070f90 con 0x7f4a98153b20 2024-09-13T16:01:52.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.597+0000 7f4a97400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4a98159a80 0x7f4a980b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.597+0000 7f4a97400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4a98159a80 0x7f4a980b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44186/0 (socket says 172.21.15.70:44186) 2024-09-13T16:01:52.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.597+0000 7f4a97400640 1 -- 172.21.15.70:0/1708981959 learned_addr learned my addr 172.21.15.70:0/1708981959 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:52.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.597+0000 7f4a97e00640 1 --2- 172.21.15.70:0/1708981959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a98153b20 0x7f4a980b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.597+0000 7f4a97400640 1 -- 172.21.15.70:0/1708981959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a98153b20 msgr2=0x7f4a980b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:52.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.597+0000 7f4a97400640 1 --2- 172.21.15.70:0/1708981959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a98153b20 0x7f4a980b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.597+0000 7f4a97400640 1 -- 172.21.15.70:0/1708981959 >> v1:172.21.15.107:6789/0 conn(0x7f4a980b2410 legacy=0x7f4a9806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.597+0000 7f4a97400640 1 -- 172.21.15.70:0/1708981959 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a980b1a40 con 0x7f4a98159a80 2024-09-13T16:01:52.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.598+0000 7f4a97400640 1 --2- 172.21.15.70:0/1708981959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a98159a80 0x7f4a980b1ed0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4a840098a0 tx=0x7f4a8402a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2066d21ffce6e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:52.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.599+0000 7f4a96a00640 1 -- 172.21.15.70:0/1708981959 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a84032440 con 0x7f4a98159a80 2024-09-13T16:01:52.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.599+0000 7f4a96a00640 1 -- 172.21.15.70:0/1708981959 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a840325a0 con 0x7f4a98159a80 2024-09-13T16:01:52.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.599+0000 7f4a96a00640 1 -- 172.21.15.70:0/1708981959 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a84032930 con 0x7f4a98159a80 2024-09-13T16:01:52.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.599+0000 7f4a9ee00640 1 -- 172.21.15.70:0/1708981959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a98159a80 msgr2=0x7f4a980b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.599+0000 7f4a9ee00640 1 --2- 172.21.15.70:0/1708981959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a98159a80 0x7f4a980b1ed0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4a840098a0 tx=0x7f4a8402a290 comp rx=0 tx=0).stop 2024-09-13T16:01:52.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.599+0000 7f4a9ee00640 1 -- 172.21.15.70:0/1708981959 shutdown_connections 2024-09-13T16:01:52.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.599+0000 7f4a9ee00640 1 --2- 172.21.15.70:0/1708981959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a98159a80 0x7f4a980b1ed0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.599+0000 7f4a9ee00640 1 --2- 172.21.15.70:0/1708981959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a98153b20 0x7f4a980b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.599+0000 7f4a9ee00640 1 -- 172.21.15.70:0/1708981959 >> 172.21.15.70:0/1708981959 conn(0x7f4a980b0510 msgr2=0x7f4a980b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:52.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.599+0000 7f4a9ee00640 1 -- 172.21.15.70:0/1708981959 shutdown_connections 2024-09-13T16:01:52.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.599+0000 7f4a9ee00640 1 -- 172.21.15.70:0/1708981959 wait complete. 2024-09-13T16:01:52.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.601+0000 7f4a9ee00640 1 Processor -- start 2024-09-13T16:01:52.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.601+0000 7f4a9ee00640 1 -- start start 2024-09-13T16:01:52.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.602+0000 7f4a9ee00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a980b2410 0x7f4a98148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.602+0000 7f4a9ee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a98153b20 0x7f4a981540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.602+0000 7f4a9ee00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a98159a80 0x7f4a9815ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.602+0000 7f4a9ee00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a981487b0 con 0x7f4a980b2410 2024-09-13T16:01:52.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.602+0000 7f4a9ee00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a98155ba0 con 0x7f4a98159a80 2024-09-13T16:01:52.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.602+0000 7f4a9ee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a98154b00 con 0x7f4a98153b20 2024-09-13T16:01:52.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.602+0000 7f4a97e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a980b2410 0x7f4a98148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.602+0000 7f4a97e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a980b2410 0x7f4a98148270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44190/0 (socket says 172.21.15.70:44190) 2024-09-13T16:01:52.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.602+0000 7f4a97e00640 1 -- 172.21.15.70:0/2672507810 learned_addr learned my addr 172.21.15.70:0/2672507810 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:52.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.602+0000 7f4a97400640 1 --2- 172.21.15.70:0/2672507810 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a98153b20 0x7f4a981540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.602+0000 7f4a9ce00640 1 --2- 172.21.15.70:0/2672507810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a98159a80 0x7f4a9815ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.603+0000 7f4a97e00640 1 -- 172.21.15.70:0/2672507810 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a98153b20 msgr2=0x7f4a981540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.603+0000 7f4a97e00640 1 --2- 172.21.15.70:0/2672507810 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a98153b20 0x7f4a981540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.603+0000 7f4a97e00640 1 -- 172.21.15.70:0/2672507810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a98159a80 msgr2=0x7f4a9815ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.603+0000 7f4a97e00640 1 --2- 172.21.15.70:0/2672507810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a98159a80 0x7f4a9815ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.603+0000 7f4a97e00640 1 -- 172.21.15.70:0/2672507810 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a840094d0 con 0x7f4a980b2410 2024-09-13T16:01:52.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.603+0000 7f4a97e00640 1 --2- 172.21.15.70:0/2672507810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a980b2410 0x7f4a98148270 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800e870 tx=0x7f4a8800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:52.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.603+0000 7f4a8fe00640 1 -- 172.21.15.70:0/2672507810 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a880094f0 con 0x7f4a980b2410 2024-09-13T16:01:52.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.603+0000 7f4a8fe00640 1 -- 172.21.15.70:0/2672507810 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8800c940 con 0x7f4a980b2410 2024-09-13T16:01:52.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.603+0000 7f4a9ee00640 1 -- 172.21.15.70:0/2672507810 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a98154de0 con 0x7f4a980b2410 2024-09-13T16:01:52.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.603+0000 7f4a8fe00640 1 -- 172.21.15.70:0/2672507810 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8800ccf0 con 0x7f4a980b2410 2024-09-13T16:01:52.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.603+0000 7f4a9ee00640 1 -- 172.21.15.70:0/2672507810 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a981553a0 con 0x7f4a980b2410 2024-09-13T16:01:52.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.604+0000 7f4a9ee00640 1 -- 172.21.15.70:0/2672507810 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a980ae1f0 con 0x7f4a980b2410 2024-09-13T16:01:52.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.605+0000 7f4a8fe00640 1 -- 172.21.15.70:0/2672507810 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4a88013470 con 0x7f4a980b2410 2024-09-13T16:01:52.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.606+0000 7f4a8fe00640 1 --2- 172.21.15.70:0/2672507810 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4a7806ac00 0x7f4a7806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.606+0000 7f4a8fe00640 1 -- 172.21.15.70:0/2672507810 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a88089430 con 0x7f4a980b2410 2024-09-13T16:01:52.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.606+0000 7f4a97400640 1 --2- 172.21.15.70:0/2672507810 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4a7806ac00 0x7f4a7806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.607+0000 7f4a97400640 1 --2- 172.21.15.70:0/2672507810 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4a7806ac00 0x7f4a7806d0c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a84034000 tx=0x7f4a8402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:52.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.610+0000 7f4a8fe00640 1 -- 172.21.15.70:0/2672507810 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4a88054620 con 0x7f4a980b2410 2024-09-13T16:01:52.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:52.842+0000 7f4a9ee00640 1 -- 172.21.15.70:0/2672507810 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_cap_flush.TestCapFlush.test_replay_create"]} v 0) v1 -- 0x7f4a9815a4b0 con 0x7f4a980b2410 2024-09-13T16:01:53.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.123+0000 7f4a8fe00640 1 -- 172.21.15.70:0/2672507810 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_cap_flush.TestCapFlush.test_replay_create"]}]=0 v54) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4a9815a4b0 con 0x7f4a980b2410 2024-09-13T16:01:53.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.125+0000 7f4a9ee00640 1 -- 172.21.15.70:0/2672507810 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4a7806ac00 msgr2=0x7f4a7806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:53.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.125+0000 7f4a9ee00640 1 --2- 172.21.15.70:0/2672507810 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4a7806ac00 0x7f4a7806d0c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a84034000 tx=0x7f4a8402e000 comp rx=0 tx=0).stop 2024-09-13T16:01:53.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.125+0000 7f4a9ee00640 1 -- 172.21.15.70:0/2672507810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a980b2410 msgr2=0x7f4a98148270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:53.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.125+0000 7f4a9ee00640 1 --2- 172.21.15.70:0/2672507810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a980b2410 0x7f4a98148270 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800e870 tx=0x7f4a8800ed30 comp rx=0 tx=0).stop 2024-09-13T16:01:53.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.125+0000 7f4a9ee00640 1 -- 172.21.15.70:0/2672507810 shutdown_connections 2024-09-13T16:01:53.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.125+0000 7f4a9ee00640 1 --2- 172.21.15.70:0/2672507810 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4a7806ac00 0x7f4a7806d0c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:53.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.125+0000 7f4a9ee00640 1 --2- 172.21.15.70:0/2672507810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a98159a80 0x7f4a9815ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:53.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.125+0000 7f4a9ee00640 1 --2- 172.21.15.70:0/2672507810 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a98153b20 0x7f4a981540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:53.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.125+0000 7f4a9ee00640 1 --2- 172.21.15.70:0/2672507810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a980b2410 0x7f4a98148270 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:53.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.125+0000 7f4a9ee00640 1 -- 172.21.15.70:0/2672507810 >> 172.21.15.70:0/2672507810 conn(0x7f4a980b0510 msgr2=0x7f4a980ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:53.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.125+0000 7f4a9ee00640 1 -- 172.21.15.70:0/2672507810 shutdown_connections 2024-09-13T16:01:53.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.125+0000 7f4a9ee00640 1 -- 172.21.15.70:0/2672507810 wait complete. 2024-09-13T16:01:53.144 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T16:01:53.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.296+0000 7fcfe0e00640 1 Processor -- start 2024-09-13T16:01:53.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.297+0000 7fcfe0e00640 1 -- start start 2024-09-13T16:01:53.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.298+0000 7fcfe0e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcfdc156f30 0x7fcfdc15a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:53.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.298+0000 7fcfe0e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcfdc0b1db0 0x7fcfdc0cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:53.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.298+0000 7fcfe0e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfdc157310 con 0x7fcfdc06b630 2024-09-13T16:01:53.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.298+0000 7fcfe0e00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfdc0b29c0 con 0x7fcfdc156f30 2024-09-13T16:01:53.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.298+0000 7fcfe0e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc0b2ca0 con 0x7fcfdc0b1db0 2024-09-13T16:01:53.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.298+0000 7fcfdb400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcfdc156f30 0x7fcfdc15a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:53.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.298+0000 7fcfdb400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcfdc156f30 0x7fcfdc15a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44200/0 (socket says 172.21.15.70:44200) 2024-09-13T16:01:53.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.298+0000 7fcfdb400640 1 -- 172.21.15.70:0/3677762497 learned_addr learned my addr 172.21.15.70:0/3677762497 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:53.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.298+0000 7fcfdbe00640 1 --2- 172.21.15.70:0/3677762497 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcfdc0b1db0 0x7fcfdc0cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:53.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.298+0000 7fcfdb400640 1 -- 172.21.15.70:0/3677762497 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcfdc0b1db0 msgr2=0x7fcfdc0cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:53.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.298+0000 7fcfdb400640 1 --2- 172.21.15.70:0/3677762497 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcfdc0b1db0 0x7fcfdc0cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:53.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.299+0000 7fcfdb400640 1 -- 172.21.15.70:0/3677762497 >> v1:172.21.15.107:6789/0 conn(0x7fcfdc06b630 legacy=0x7fcfdc0b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:53.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.299+0000 7fcfdb400640 1 -- 172.21.15.70:0/3677762497 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc0b2f80 con 0x7fcfdc156f30 2024-09-13T16:01:53.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.299+0000 7fcfdb400640 1 --2- 172.21.15.70:0/3677762497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfdc156f30 0x7fcfdc15a460 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009870 tx=0x7fcfcc02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b28173dfd7c217d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:53.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.300+0000 7fcfda000640 1 -- 172.21.15.70:0/3677762497 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc032440 con 0x7fcfdc156f30 2024-09-13T16:01:53.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.300+0000 7fcfda000640 1 -- 172.21.15.70:0/3677762497 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc0325a0 con 0x7fcfdc156f30 2024-09-13T16:01:53.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.300+0000 7fcfda000640 1 -- 172.21.15.70:0/3677762497 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc032930 con 0x7fcfdc156f30 2024-09-13T16:01:53.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.300+0000 7fcfe0e00640 1 -- 172.21.15.70:0/3677762497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfdc156f30 msgr2=0x7fcfdc15a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:53.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.300+0000 7fcfe0e00640 1 --2- 172.21.15.70:0/3677762497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfdc156f30 0x7fcfdc15a460 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009870 tx=0x7fcfcc02a250 comp rx=0 tx=0).stop 2024-09-13T16:01:53.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.300+0000 7fcfe0e00640 1 -- 172.21.15.70:0/3677762497 shutdown_connections 2024-09-13T16:01:53.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.300+0000 7fcfe0e00640 1 --2- 172.21.15.70:0/3677762497 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcfdc0b1db0 0x7fcfdc0cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:53.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.300+0000 7fcfe0e00640 1 --2- 172.21.15.70:0/3677762497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfdc156f30 0x7fcfdc15a460 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:53.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.300+0000 7fcfe0e00640 1 -- 172.21.15.70:0/3677762497 >> 172.21.15.70:0/3677762497 conn(0x7fcfdc069ed0 msgr2=0x7fcfdc06a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:53.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.300+0000 7fcfe0e00640 1 -- 172.21.15.70:0/3677762497 shutdown_connections 2024-09-13T16:01:53.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.300+0000 7fcfe0e00640 1 -- 172.21.15.70:0/3677762497 wait complete. 2024-09-13T16:01:53.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.302+0000 7fcfe0e00640 1 Processor -- start 2024-09-13T16:01:53.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.302+0000 7fcfe0e00640 1 -- start start 2024-09-13T16:01:53.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.303+0000 7fcfe0e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcfdc06b630 0x7fcfdc1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:53.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.303+0000 7fcfe0e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfdc0b1db0 0x7fcfdc0b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:53.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.303+0000 7fcfe0e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfdc156f30 0x7fcfdc155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:53.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.303+0000 7fcfe0e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc156030 con 0x7fcfdc156f30 2024-09-13T16:01:53.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.303+0000 7fcfe0e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc1e63d0 con 0x7fcfdc0b1db0 2024-09-13T16:01:53.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.303+0000 7fcfe0e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc1e66b0 con 0x7fcfdc06b630 2024-09-13T16:01:53.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.303+0000 7fcfdbe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfdc156f30 0x7fcfdc155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:53.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.303+0000 7fcfdbe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfdc156f30 0x7fcfdc155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44210/0 (socket says 172.21.15.70:44210) 2024-09-13T16:01:53.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.303+0000 7fcfdbe00640 1 -- 172.21.15.70:0/2653600353 learned_addr learned my addr 172.21.15.70:0/2653600353 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:53.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.304+0000 7fcfdaa00640 1 --2- 172.21.15.70:0/2653600353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfdc0b1db0 0x7fcfdc0b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:53.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.304+0000 7fcfdb400640 1 --2- 172.21.15.70:0/2653600353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcfdc06b630 0x7fcfdc1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:53.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.304+0000 7fcfdbe00640 1 -- 172.21.15.70:0/2653600353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcfdc06b630 msgr2=0x7fcfdc1561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:53.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.304+0000 7fcfdbe00640 1 --2- 172.21.15.70:0/2653600353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcfdc06b630 0x7fcfdc1561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:53.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.304+0000 7fcfdbe00640 1 -- 172.21.15.70:0/2653600353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfdc0b1db0 msgr2=0x7fcfdc0b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:53.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.304+0000 7fcfdbe00640 1 --2- 172.21.15.70:0/2653600353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfdc0b1db0 0x7fcfdc0b0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:53.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.304+0000 7fcfdbe00640 1 -- 172.21.15.70:0/2653600353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc0094d0 con 0x7fcfdc156f30 2024-09-13T16:01:53.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.304+0000 7fcfdbe00640 1 --2- 172.21.15.70:0/2653600353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfdc156f30 0x7fcfdc155600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4007e40 tx=0x7fcfd400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:53.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.304+0000 7fcfd3400640 1 -- 172.21.15.70:0/2653600353 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4014620 con 0x7fcfdc156f30 2024-09-13T16:01:53.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.304+0000 7fcfd3400640 1 -- 172.21.15.70:0/2653600353 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd400ee90 con 0x7fcfdc156f30 2024-09-13T16:01:53.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.304+0000 7fcfe0e00640 1 -- 172.21.15.70:0/2653600353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfdc1f25a0 con 0x7fcfdc156f30 2024-09-13T16:01:53.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.304+0000 7fcfd3400640 1 -- 172.21.15.70:0/2653600353 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd40149e0 con 0x7fcfdc156f30 2024-09-13T16:01:53.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.304+0000 7fcfe0e00640 1 -- 172.21.15.70:0/2653600353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfdc155c70 con 0x7fcfdc156f30 2024-09-13T16:01:53.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.305+0000 7fcfe0e00640 1 -- 172.21.15.70:0/2653600353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfdc1f2ac0 con 0x7fcfdc156f30 2024-09-13T16:01:53.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.306+0000 7fcfd3400640 1 -- 172.21.15.70:0/2653600353 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcfd4014b40 con 0x7fcfdc156f30 2024-09-13T16:01:53.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.307+0000 7fcfd3400640 1 --2- 172.21.15.70:0/2653600353 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fcfbc06ac00 0x7fcfbc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:53.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.307+0000 7fcfd3400640 1 -- 172.21.15.70:0/2653600353 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfd4089d30 con 0x7fcfdc156f30 2024-09-13T16:01:53.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.307+0000 7fcfdb400640 1 --2- 172.21.15.70:0/2653600353 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fcfbc06ac00 0x7fcfbc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:53.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.308+0000 7fcfdb400640 1 --2- 172.21.15.70:0/2653600353 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fcfbc06ac00 0x7fcfbc06d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc034000 tx=0x7fcfcc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:53.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.311+0000 7fcfd3400640 1 -- 172.21.15.70:0/2653600353 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcfdc1f2ac0 con 0x7fcfdc156f30 2024-09-13T16:01:53.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.480+0000 7fcfe0e00640 1 -- 172.21.15.70:0/2653600353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcfdc1f2ac0 con 0x7fcfdc156f30 2024-09-13T16:01:53.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.484+0000 7fcfd3400640 1 -- 172.21.15.70:0/2653600353 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcfdc1f2ac0 con 0x7fcfdc156f30 2024-09-13T16:01:53.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.486+0000 7fcfe0e00640 1 -- 172.21.15.70:0/2653600353 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fcfbc06ac00 msgr2=0x7fcfbc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:53.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.486+0000 7fcfe0e00640 1 --2- 172.21.15.70:0/2653600353 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fcfbc06ac00 0x7fcfbc06d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc034000 tx=0x7fcfcc02e000 comp rx=0 tx=0).stop 2024-09-13T16:01:53.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.486+0000 7fcfe0e00640 1 -- 172.21.15.70:0/2653600353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfdc156f30 msgr2=0x7fcfdc155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:53.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.486+0000 7fcfe0e00640 1 --2- 172.21.15.70:0/2653600353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfdc156f30 0x7fcfdc155600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4007e40 tx=0x7fcfd400e4b0 comp rx=0 tx=0).stop 2024-09-13T16:01:53.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.486+0000 7fcfe0e00640 1 -- 172.21.15.70:0/2653600353 shutdown_connections 2024-09-13T16:01:53.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.486+0000 7fcfe0e00640 1 --2- 172.21.15.70:0/2653600353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfdc156f30 0x7fcfdc155600 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:53.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.486+0000 7fcfe0e00640 1 --2- 172.21.15.70:0/2653600353 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fcfbc06ac00 0x7fcfbc06d0c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:53.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.486+0000 7fcfe0e00640 1 --2- 172.21.15.70:0/2653600353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfdc0b1db0 0x7fcfdc0b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:53.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.486+0000 7fcfe0e00640 1 --2- 172.21.15.70:0/2653600353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcfdc06b630 0x7fcfdc1561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:53.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.486+0000 7fcfe0e00640 1 -- 172.21.15.70:0/2653600353 >> 172.21.15.70:0/2653600353 conn(0x7fcfdc069ed0 msgr2=0x7fcfdc06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:53.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.487+0000 7fcfe0e00640 1 -- 172.21.15.70:0/2653600353 shutdown_connections 2024-09-13T16:01:53.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:53.487+0000 7fcfe0e00640 1 -- 172.21.15.70:0/2653600353 wait complete. 2024-09-13T16:01:53.504 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T16:01:53.504 DEBUG:teuthology.orchestra.run.smithi070:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T16:01:53.596 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T16:01:53.696 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T16:01:53.697 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:01:53.697 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:01:53.732 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:01:53.732 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:01:53.808 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:01:53.808 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:01:53.883 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:54.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.074+0000 7f6fed200640 1 Processor -- start 2024-09-13T16:01:54.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.075+0000 7f6fed200640 1 -- start start 2024-09-13T16:01:54.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.076+0000 7f6fed200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6fe815a5c0 0x7f6fe80b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:54.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.076+0000 7f6fed200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6fe815b9b0 0x7f6fe80b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:54.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.076+0000 7f6fed200640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe80cbfc0 con 0x7f6fe80cbac0 2024-09-13T16:01:54.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.076+0000 7f6fed200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe80cce20 con 0x7f6fe815b9b0 2024-09-13T16:01:54.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.076+0000 7f6fed200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe80707a0 con 0x7f6fe815a5c0 2024-09-13T16:01:54.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.076+0000 7f6fe7e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6fe815b9b0 0x7f6fe80b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:54.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.076+0000 7f6fe7e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6fe815b9b0 0x7f6fe80b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44222/0 (socket says 172.21.15.70:44222) 2024-09-13T16:01:54.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.076+0000 7f6fe7e00640 1 -- 172.21.15.70:0/1073556444 learned_addr learned my addr 172.21.15.70:0/1073556444 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:54.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.076+0000 7f6fdea00640 1 --1- 172.21.15.70:0/1073556444 >> v1:172.21.15.70:6789/0 conn(0x7f6fe80cbac0 0x7f6fe806f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49620/0 (socket says 172.21.15.70:49620) 2024-09-13T16:01:54.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.076+0000 7f6fe7400640 1 --2- 172.21.15.70:0/1073556444 >> v2:172.21.15.107:3300/0 conn(0x7f6fe815a5c0 0x7f6fe80b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:54.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.077+0000 7f6fe7e00640 1 -- 172.21.15.70:0/1073556444 >> v2:172.21.15.107:3300/0 conn(0x7f6fe815a5c0 msgr2=0x7f6fe80b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:54.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.077+0000 7f6fe7e00640 1 --2- 172.21.15.70:0/1073556444 >> v2:172.21.15.107:3300/0 conn(0x7f6fe815a5c0 0x7f6fe80b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.077+0000 7f6fe7e00640 1 -- 172.21.15.70:0/1073556444 >> v1:172.21.15.70:6789/0 conn(0x7f6fe80cbac0 legacy=0x7f6fe806f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:54.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.077+0000 7f6fe7e00640 1 -- 172.21.15.70:0/1073556444 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe8070a80 con 0x7f6fe815b9b0 2024-09-13T16:01:54.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.077+0000 7f6fe7e00640 1 --2- 172.21.15.70:0/1073556444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fe815b9b0 0x7f6fe80b3ef0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8067270 tx=0x7f6fe002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f7af5b225810c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:54.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.078+0000 7f6fe6a00640 1 -- 172.21.15.70:0/1073556444 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0031600 con 0x7f6fe815b9b0 2024-09-13T16:01:54.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.078+0000 7f6fe6a00640 1 -- 172.21.15.70:0/1073556444 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe002d050 con 0x7f6fe815b9b0 2024-09-13T16:01:54.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.078+0000 7f6fe6a00640 1 -- 172.21.15.70:0/1073556444 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0031980 con 0x7f6fe815b9b0 2024-09-13T16:01:54.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.078+0000 7f6fed200640 1 -- 172.21.15.70:0/1073556444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fe815b9b0 msgr2=0x7f6fe80b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:54.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.078+0000 7f6fed200640 1 --2- 172.21.15.70:0/1073556444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fe815b9b0 0x7f6fe80b3ef0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8067270 tx=0x7f6fe002a6a0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.078+0000 7f6fed200640 1 -- 172.21.15.70:0/1073556444 shutdown_connections 2024-09-13T16:01:54.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.078+0000 7f6fed200640 1 --2- 172.21.15.70:0/1073556444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fe815b9b0 0x7f6fe80b3ef0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.078+0000 7f6fed200640 1 --2- 172.21.15.70:0/1073556444 >> v2:172.21.15.107:3300/0 conn(0x7f6fe815a5c0 0x7f6fe80b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.078+0000 7f6fed200640 1 -- 172.21.15.70:0/1073556444 >> 172.21.15.70:0/1073556444 conn(0x7f6fe80ae310 msgr2=0x7f6fe80ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:54.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.079+0000 7f6fed200640 1 -- 172.21.15.70:0/1073556444 shutdown_connections 2024-09-13T16:01:54.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.079+0000 7f6fed200640 1 -- 172.21.15.70:0/1073556444 wait complete. 2024-09-13T16:01:54.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.080+0000 7f6fed200640 1 Processor -- start 2024-09-13T16:01:54.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.080+0000 7f6fed200640 1 -- start start 2024-09-13T16:01:54.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.081+0000 7f6fed200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fe80cbac0 0x7f6fe814ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:54.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.081+0000 7f6fed200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fe815a5c0 0x7f6fe80b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:54.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.081+0000 7f6fed200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6fe815b9b0 0x7f6fe80b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:54.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.081+0000 7f6fed200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe80b2220 con 0x7f6fe815a5c0 2024-09-13T16:01:54.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.081+0000 7f6fed200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe80b2440 con 0x7f6fe80cbac0 2024-09-13T16:01:54.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.081+0000 7f6fed200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe80b2720 con 0x7f6fe815b9b0 2024-09-13T16:01:54.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.081+0000 7f6fdea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fe815a5c0 0x7f6fe80b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:54.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.081+0000 7f6fdea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fe815a5c0 0x7f6fe80b17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44234/0 (socket says 172.21.15.70:44234) 2024-09-13T16:01:54.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.081+0000 7f6fdea00640 1 -- 172.21.15.70:0/736898099 learned_addr learned my addr 172.21.15.70:0/736898099 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:54.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.081+0000 7f6fe7400640 1 --2- 172.21.15.70:0/736898099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fe80cbac0 0x7f6fe814ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:54.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.082+0000 7f6fe7e00640 1 --2- 172.21.15.70:0/736898099 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6fe815b9b0 0x7f6fe80b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:54.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.082+0000 7f6fdea00640 1 -- 172.21.15.70:0/736898099 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6fe815b9b0 msgr2=0x7f6fe80b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:54.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.082+0000 7f6fdea00640 1 --2- 172.21.15.70:0/736898099 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6fe815b9b0 0x7f6fe80b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.082+0000 7f6fdea00640 1 -- 172.21.15.70:0/736898099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fe80cbac0 msgr2=0x7f6fe814ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:54.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.082+0000 7f6fdea00640 1 --2- 172.21.15.70:0/736898099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fe80cbac0 0x7f6fe814ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.082+0000 7f6fdea00640 1 -- 172.21.15.70:0/736898099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe0009b30 con 0x7f6fe815a5c0 2024-09-13T16:01:54.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.082+0000 7f6fdea00640 1 --2- 172.21.15.70:0/736898099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fe815a5c0 0x7f6fe80b17a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000c450 tx=0x7f6fd000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:54.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.082+0000 7f6fdfe00640 1 -- 172.21.15.70:0/736898099 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0007480 con 0x7f6fe815a5c0 2024-09-13T16:01:54.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.082+0000 7f6fdfe00640 1 -- 172.21.15.70:0/736898099 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd00075e0 con 0x7f6fe815a5c0 2024-09-13T16:01:54.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.082+0000 7f6fed200640 1 -- 172.21.15.70:0/736898099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe80b2a00 con 0x7f6fe815a5c0 2024-09-13T16:01:54.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.082+0000 7f6fdfe00640 1 -- 172.21.15.70:0/736898099 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0004a00 con 0x7f6fe815a5c0 2024-09-13T16:01:54.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.082+0000 7f6fed200640 1 -- 172.21.15.70:0/736898099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe80b2fc0 con 0x7f6fe815a5c0 2024-09-13T16:01:54.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.083+0000 7f6fed200640 1 -- 172.21.15.70:0/736898099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe8067360 con 0x7f6fe815a5c0 2024-09-13T16:01:54.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.084+0000 7f6fdfe00640 1 -- 172.21.15.70:0/736898099 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6fd0004b60 con 0x7f6fe815a5c0 2024-09-13T16:01:54.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.085+0000 7f6fdfe00640 1 --2- 172.21.15.70:0/736898099 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6fc406ac00 0x7f6fc406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:54.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.085+0000 7f6fdfe00640 1 -- 172.21.15.70:0/736898099 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fd0088700 con 0x7f6fe815a5c0 2024-09-13T16:01:54.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.085+0000 7f6fe7400640 1 --2- 172.21.15.70:0/736898099 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6fc406ac00 0x7f6fc406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:54.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.086+0000 7f6fe7400640 1 --2- 172.21.15.70:0/736898099 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6fc406ac00 0x7f6fc406d0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8006fd0 tx=0x7f6fd8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:54.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.089+0000 7f6fdfe00640 1 -- 172.21.15.70:0/736898099 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6fd0053980 con 0x7f6fe815a5c0 2024-09-13T16:01:54.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.259+0000 7f6fed200640 1 -- 172.21.15.70:0/736898099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fe80b31e0 con 0x7f6fe815a5c0 2024-09-13T16:01:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.260+0000 7f6fdfe00640 1 -- 172.21.15.70:0/736898099 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f6fd0056fa0 con 0x7f6fe815a5c0 2024-09-13T16:01:54.261 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:54.262 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:19.595458+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:54.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.262+0000 7f6fed200640 1 -- 172.21.15.70:0/736898099 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6fc406ac00 msgr2=0x7f6fc406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:54.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.262+0000 7f6fed200640 1 --2- 172.21.15.70:0/736898099 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6fc406ac00 0x7f6fc406d0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8006fd0 tx=0x7f6fd8008040 comp rx=0 tx=0).stop 2024-09-13T16:01:54.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.262+0000 7f6fed200640 1 -- 172.21.15.70:0/736898099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fe815a5c0 msgr2=0x7f6fe80b17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:54.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.262+0000 7f6fed200640 1 --2- 172.21.15.70:0/736898099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fe815a5c0 0x7f6fe80b17a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000c450 tx=0x7f6fd000c910 comp rx=0 tx=0).stop 2024-09-13T16:01:54.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.262+0000 7f6fed200640 1 -- 172.21.15.70:0/736898099 shutdown_connections 2024-09-13T16:01:54.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.262+0000 7f6fed200640 1 --2- 172.21.15.70:0/736898099 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6fe815b9b0 0x7f6fe80b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.262+0000 7f6fed200640 1 --2- 172.21.15.70:0/736898099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fe815a5c0 0x7f6fe80b17a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.262+0000 7f6fed200640 1 --2- 172.21.15.70:0/736898099 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6fc406ac00 0x7f6fc406d0c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.262+0000 7f6fed200640 1 --2- 172.21.15.70:0/736898099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fe80cbac0 0x7f6fe814ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.262+0000 7f6fed200640 1 -- 172.21.15.70:0/736898099 >> 172.21.15.70:0/736898099 conn(0x7f6fe80ae310 msgr2=0x7f6fe806f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:54.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.262+0000 7f6fed200640 1 -- 172.21.15.70:0/736898099 shutdown_connections 2024-09-13T16:01:54.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.262+0000 7f6fed200640 1 -- 172.21.15.70:0/736898099 wait complete. 2024-09-13T16:01:54.280 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:01:06.070694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:01:16.922043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:01:17.580304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:01:54.281 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:01:54.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.434+0000 7fdaaca00640 1 Processor -- start 2024-09-13T16:01:54.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.435+0000 7fdaaca00640 1 -- start start 2024-09-13T16:01:54.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.436+0000 7fdaaca00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdaa80b54c0 0x7fdaa80cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:54.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.436+0000 7fdaaca00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdaa806be10 0x7fdaa806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:54.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.436+0000 7fdaaca00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa80b4790 con 0x7fdaa806b2c0 2024-09-13T16:01:54.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.436+0000 7fdaaca00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa806c290 con 0x7fdaa806be10 2024-09-13T16:01:54.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.436+0000 7fdaaca00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa815cfd0 con 0x7fdaa80b54c0 2024-09-13T16:01:54.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.436+0000 7fdaa7e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdaa806be10 0x7fdaa806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:54.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.436+0000 7fdaa7e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdaa806be10 0x7fdaa806ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44246/0 (socket says 172.21.15.70:44246) 2024-09-13T16:01:54.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.436+0000 7fdaa7e00640 1 -- 172.21.15.70:0/1998535821 learned_addr learned my addr 172.21.15.70:0/1998535821 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:54.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.436+0000 7fdaa7400640 1 --2- 172.21.15.70:0/1998535821 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdaa80b54c0 0x7fdaa80cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:54.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.437+0000 7fdaa7e00640 1 -- 172.21.15.70:0/1998535821 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdaa80b54c0 msgr2=0x7fdaa80cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:54.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.437+0000 7fdaa7e00640 1 --2- 172.21.15.70:0/1998535821 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdaa80b54c0 0x7fdaa80cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.437+0000 7fdaa7e00640 1 -- 172.21.15.70:0/1998535821 >> v1:172.21.15.107:6789/0 conn(0x7fdaa806b2c0 legacy=0x7fdaa806b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:54.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.437+0000 7fdaa7e00640 1 -- 172.21.15.70:0/1998535821 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa806de20 con 0x7fdaa806be10 2024-09-13T16:01:54.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.437+0000 7fdaa7400640 1 --2- 172.21.15.70:0/1998535821 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdaa80b54c0 0x7fdaa80cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:54.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.438+0000 7fdaa7e00640 1 --2- 172.21.15.70:0/1998535821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaa806be10 0x7fdaa806ee70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0009e80 tx=0x7fdaa002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d51c600b1ff8ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:54.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.438+0000 7fdaa6a00640 1 -- 172.21.15.70:0/1998535821 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa002aea0 con 0x7fdaa806be10 2024-09-13T16:01:54.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.438+0000 7fdaa6a00640 1 -- 172.21.15.70:0/1998535821 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa002d050 con 0x7fdaa806be10 2024-09-13T16:01:54.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.438+0000 7fdaa6a00640 1 -- 172.21.15.70:0/1998535821 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0031820 con 0x7fdaa806be10 2024-09-13T16:01:54.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.438+0000 7fdaaca00640 1 -- 172.21.15.70:0/1998535821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaa806be10 msgr2=0x7fdaa806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:54.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.438+0000 7fdaaca00640 1 --2- 172.21.15.70:0/1998535821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaa806be10 0x7fdaa806ee70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0009e80 tx=0x7fdaa002a6c0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.439+0000 7fdaaca00640 1 -- 172.21.15.70:0/1998535821 shutdown_connections 2024-09-13T16:01:54.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.439+0000 7fdaaca00640 1 --2- 172.21.15.70:0/1998535821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaa806be10 0x7fdaa806ee70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.439+0000 7fdaaca00640 1 --2- 172.21.15.70:0/1998535821 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdaa80b54c0 0x7fdaa80cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.439+0000 7fdaaca00640 1 -- 172.21.15.70:0/1998535821 >> 172.21.15.70:0/1998535821 conn(0x7fdaa80d06d0 msgr2=0x7fdaa80d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:54.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.439+0000 7fdaaca00640 1 -- 172.21.15.70:0/1998535821 shutdown_connections 2024-09-13T16:01:54.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.439+0000 7fdaaca00640 1 -- 172.21.15.70:0/1998535821 wait complete. 2024-09-13T16:01:54.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.440+0000 7fdaaca00640 1 Processor -- start 2024-09-13T16:01:54.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.440+0000 7fdaaca00640 1 -- start start 2024-09-13T16:01:54.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.441+0000 7fdaaca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdaa806b2c0 0x7fdaa81598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:54.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.441+0000 7fdaaca00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaa806be10 0x7fdaa8157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:54.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.441+0000 7fdaaca00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdaa80b54c0 0x7fdaa81f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:54.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.441+0000 7fdaaca00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80b19e0 con 0x7fdaa806be10 2024-09-13T16:01:54.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.441+0000 7fdaaca00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa81f3420 con 0x7fdaa806b2c0 2024-09-13T16:01:54.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.441+0000 7fdaaca00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa8159e00 con 0x7fdaa80b54c0 2024-09-13T16:01:54.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.442+0000 7fda9ea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaa806be10 0x7fdaa8157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:54.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.442+0000 7fda9ea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaa806be10 0x7fdaa8157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44260/0 (socket says 172.21.15.70:44260) 2024-09-13T16:01:54.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.442+0000 7fda9ea00640 1 -- 172.21.15.70:0/1408283265 learned_addr learned my addr 172.21.15.70:0/1408283265 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:54.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.442+0000 7fdaa7e00640 1 --2- 172.21.15.70:0/1408283265 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdaa80b54c0 0x7fdaa81f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:54.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.442+0000 7fdaa7400640 1 --2- 172.21.15.70:0/1408283265 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdaa806b2c0 0x7fdaa81598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:54.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.442+0000 7fda9ea00640 1 -- 172.21.15.70:0/1408283265 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdaa80b54c0 msgr2=0x7fdaa81f23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:54.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.442+0000 7fda9ea00640 1 --2- 172.21.15.70:0/1408283265 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdaa80b54c0 0x7fdaa81f23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.442+0000 7fda9ea00640 1 -- 172.21.15.70:0/1408283265 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdaa806b2c0 msgr2=0x7fdaa81598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:54.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.442+0000 7fda9ea00640 1 --2- 172.21.15.70:0/1408283265 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdaa806b2c0 0x7fdaa81598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.442+0000 7fda9ea00640 1 -- 172.21.15.70:0/1408283265 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa0009b30 con 0x7fdaa806be10 2024-09-13T16:01:54.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.442+0000 7fda9ea00640 1 --2- 172.21.15.70:0/1408283265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaa806be10 0x7fdaa8157430 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fda9000c3c0 tx=0x7fda9000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:54.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.443+0000 7fda9fe00640 1 -- 172.21.15.70:0/1408283265 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda900052d0 con 0x7fdaa806be10 2024-09-13T16:01:54.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.443+0000 7fda9fe00640 1 -- 172.21.15.70:0/1408283265 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda90005450 con 0x7fdaa806be10 2024-09-13T16:01:54.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.443+0000 7fda9fe00640 1 -- 172.21.15.70:0/1408283265 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90003830 con 0x7fdaa806be10 2024-09-13T16:01:54.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.443+0000 7fdaaca00640 1 -- 172.21.15.70:0/1408283265 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa81f2e60 con 0x7fdaa806be10 2024-09-13T16:01:54.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.443+0000 7fdaaca00640 1 -- 172.21.15.70:0/1408283265 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa8156c30 con 0x7fdaa806be10 2024-09-13T16:01:54.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.444+0000 7fdaaca00640 1 -- 172.21.15.70:0/1408283265 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa8156a90 con 0x7fdaa806be10 2024-09-13T16:01:54.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.445+0000 7fda9fe00640 1 -- 172.21.15.70:0/1408283265 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fda90003990 con 0x7fdaa806be10 2024-09-13T16:01:54.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.445+0000 7fda9fe00640 1 --2- 172.21.15.70:0/1408283265 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fda8406ac00 0x7fda8406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:54.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.446+0000 7fda9fe00640 1 -- 172.21.15.70:0/1408283265 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda90088690 con 0x7fdaa806be10 2024-09-13T16:01:54.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.446+0000 7fdaa7400640 1 --2- 172.21.15.70:0/1408283265 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fda8406ac00 0x7fda8406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.446+0000 7fdaa7400640 1 --2- 172.21.15.70:0/1408283265 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fda8406ac00 0x7fda8406d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fda98006fd0 tx=0x7fda98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:54.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.450+0000 7fda9fe00640 1 -- 172.21.15.70:0/1408283265 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdaa8156a90 con 0x7fdaa806be10 2024-09-13T16:01:54.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.620+0000 7fdaaca00640 1 -- 172.21.15.70:0/1408283265 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdaa8156a90 con 0x7fdaa806be10 2024-09-13T16:01:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.620+0000 7fda9fe00640 1 -- 172.21.15.70:0/1408283265 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdaa8156a90 con 0x7fdaa806be10 2024-09-13T16:01:54.622 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-13T16:01:54.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.623+0000 7fdaaca00640 1 -- 172.21.15.70:0/1408283265 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fda8406ac00 msgr2=0x7fda8406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:54.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.623+0000 7fdaaca00640 1 --2- 172.21.15.70:0/1408283265 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fda8406ac00 0x7fda8406d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fda98006fd0 tx=0x7fda98008040 comp rx=0 tx=0).stop 2024-09-13T16:01:54.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.623+0000 7fdaaca00640 1 -- 172.21.15.70:0/1408283265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaa806be10 msgr2=0x7fdaa8157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:54.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.623+0000 7fdaaca00640 1 --2- 172.21.15.70:0/1408283265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaa806be10 0x7fdaa8157430 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fda9000c3c0 tx=0x7fda9000c880 comp rx=0 tx=0).stop 2024-09-13T16:01:54.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.623+0000 7fdaaca00640 1 -- 172.21.15.70:0/1408283265 shutdown_connections 2024-09-13T16:01:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.623+0000 7fdaaca00640 1 --2- 172.21.15.70:0/1408283265 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdaa80b54c0 0x7fdaa81f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.623+0000 7fdaaca00640 1 --2- 172.21.15.70:0/1408283265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaa806be10 0x7fdaa8157430 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.623+0000 7fdaaca00640 1 --2- 172.21.15.70:0/1408283265 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fda8406ac00 0x7fda8406d0c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.623+0000 7fdaaca00640 1 --2- 172.21.15.70:0/1408283265 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdaa806b2c0 0x7fdaa81598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.623+0000 7fdaaca00640 1 -- 172.21.15.70:0/1408283265 >> 172.21.15.70:0/1408283265 conn(0x7fdaa80d06d0 msgr2=0x7fdaa80d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.623+0000 7fdaaca00640 1 -- 172.21.15.70:0/1408283265 shutdown_connections 2024-09-13T16:01:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.623+0000 7fdaaca00640 1 -- 172.21.15.70:0/1408283265 wait complete. 2024-09-13T16:01:54.641 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:01:54.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.793+0000 7fb341800640 1 Processor -- start 2024-09-13T16:01:54.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.793+0000 7fb341800640 1 -- start start 2024-09-13T16:01:54.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.795+0000 7fb341800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb33c06f830 0x7fb33c06fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.795+0000 7fb341800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb33c070420 0x7fb33c0cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.795+0000 7fb341800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33c0ce490 con 0x7fb33c154ad0 2024-09-13T16:01:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.795+0000 7fb341800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb33c06b5b0 con 0x7fb33c06f830 2024-09-13T16:01:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.795+0000 7fb341800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb33c06b7c0 con 0x7fb33c070420 2024-09-13T16:01:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.795+0000 7fb332000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb33c06f830 0x7fb33c06fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.795+0000 7fb332000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb33c06f830 0x7fb33c06fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44268/0 (socket says 172.21.15.70:44268) 2024-09-13T16:01:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.795+0000 7fb332000640 1 -- 172.21.15.70:0/1808358091 learned_addr learned my addr 172.21.15.70:0/1808358091 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.795+0000 7fb33b400640 1 --2- 172.21.15.70:0/1808358091 >> v2:172.21.15.107:3300/0 conn(0x7fb33c070420 0x7fb33c0cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.796+0000 7fb332000640 1 -- 172.21.15.70:0/1808358091 >> v2:172.21.15.107:3300/0 conn(0x7fb33c070420 msgr2=0x7fb33c0cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.796+0000 7fb332000640 1 --2- 172.21.15.70:0/1808358091 >> v2:172.21.15.107:3300/0 conn(0x7fb33c070420 0x7fb33c0cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.796+0000 7fb332000640 1 -- 172.21.15.70:0/1808358091 >> v1:172.21.15.107:6789/0 conn(0x7fb33c154ad0 legacy=0x7fb33c0cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.796+0000 7fb332000640 1 -- 172.21.15.70:0/1808358091 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c06baa0 con 0x7fb33c06f830 2024-09-13T16:01:54.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.797+0000 7fb332000640 1 --2- 172.21.15.70:0/1808358091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb33c06f830 0x7fb33c06fee0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0ce780 tx=0x7fb32402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae2a37ebf2ea389 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:54.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.797+0000 7fb33a000640 1 -- 172.21.15.70:0/1808358091 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324032440 con 0x7fb33c06f830 2024-09-13T16:01:54.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.797+0000 7fb33a000640 1 -- 172.21.15.70:0/1808358091 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3240325a0 con 0x7fb33c06f830 2024-09-13T16:01:54.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.797+0000 7fb33a000640 1 -- 172.21.15.70:0/1808358091 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324032930 con 0x7fb33c06f830 2024-09-13T16:01:54.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.797+0000 7fb341800640 1 -- 172.21.15.70:0/1808358091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb33c06f830 msgr2=0x7fb33c06fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:54.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.797+0000 7fb341800640 1 --2- 172.21.15.70:0/1808358091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb33c06f830 0x7fb33c06fee0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0ce780 tx=0x7fb32402a200 comp rx=0 tx=0).stop 2024-09-13T16:01:54.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.797+0000 7fb341800640 1 -- 172.21.15.70:0/1808358091 shutdown_connections 2024-09-13T16:01:54.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.797+0000 7fb341800640 1 --2- 172.21.15.70:0/1808358091 >> v2:172.21.15.107:3300/0 conn(0x7fb33c070420 0x7fb33c0cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.797+0000 7fb341800640 1 --2- 172.21.15.70:0/1808358091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb33c06f830 0x7fb33c06fee0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.797+0000 7fb341800640 1 -- 172.21.15.70:0/1808358091 >> 172.21.15.70:0/1808358091 conn(0x7fb33c0b0580 msgr2=0x7fb33c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:54.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.798+0000 7fb341800640 1 -- 172.21.15.70:0/1808358091 shutdown_connections 2024-09-13T16:01:54.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.798+0000 7fb341800640 1 -- 172.21.15.70:0/1808358091 wait complete. 2024-09-13T16:01:54.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.799+0000 7fb341800640 1 Processor -- start 2024-09-13T16:01:54.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.799+0000 7fb341800640 1 -- start start 2024-09-13T16:01:54.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.800+0000 7fb341800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb33c070420 0x7fb33c1f3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:54.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.800+0000 7fb341800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c154ad0 0x7fb33c1f4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:54.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.800+0000 7fb341800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb33c14f550 0x7fb33c14f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:54.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.800+0000 7fb341800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c150520 con 0x7fb33c070420 2024-09-13T16:01:54.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.800+0000 7fb341800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c138530 con 0x7fb33c154ad0 2024-09-13T16:01:54.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.800+0000 7fb341800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c14e1a0 con 0x7fb33c14f550 2024-09-13T16:01:54.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.800+0000 7fb33aa00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb33c070420 0x7fb33c1f3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:54.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.800+0000 7fb33aa00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb33c070420 0x7fb33c1f3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44280/0 (socket says 172.21.15.70:44280) 2024-09-13T16:01:54.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.800+0000 7fb33aa00640 1 -- 172.21.15.70:0/3011857743 learned_addr learned my addr 172.21.15.70:0/3011857743 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:54.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.801+0000 7fb332000640 1 --2- 172.21.15.70:0/3011857743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c154ad0 0x7fb33c1f4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:54.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.801+0000 7fb33b400640 1 --2- 172.21.15.70:0/3011857743 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb33c14f550 0x7fb33c14f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:54.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.801+0000 7fb33aa00640 1 -- 172.21.15.70:0/3011857743 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb33c14f550 msgr2=0x7fb33c14f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:54.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.801+0000 7fb33aa00640 1 --2- 172.21.15.70:0/3011857743 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb33c14f550 0x7fb33c14f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.801+0000 7fb33aa00640 1 -- 172.21.15.70:0/3011857743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c154ad0 msgr2=0x7fb33c1f4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:54.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.801+0000 7fb33aa00640 1 --2- 172.21.15.70:0/3011857743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c154ad0 0x7fb33c1f4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.801+0000 7fb33aa00640 1 -- 172.21.15.70:0/3011857743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3240094d0 con 0x7fb33c070420 2024-09-13T16:01:54.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.801+0000 7fb332000640 1 --2- 172.21.15.70:0/3011857743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c154ad0 0x7fb33c1f4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:54.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.801+0000 7fb33b400640 1 --2- 172.21.15.70:0/3011857743 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb33c14f550 0x7fb33c14f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:54.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.801+0000 7fb33aa00640 1 --2- 172.21.15.70:0/3011857743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb33c070420 0x7fb33c1f3b30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00c400 tx=0x7fb32c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:54.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.801+0000 7fb333400640 1 -- 172.21.15.70:0/3011857743 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c0052d0 con 0x7fb33c070420 2024-09-13T16:01:54.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.801+0000 7fb333400640 1 -- 172.21.15.70:0/3011857743 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c005430 con 0x7fb33c070420 2024-09-13T16:01:54.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.801+0000 7fb333400640 1 -- 172.21.15.70:0/3011857743 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c003830 con 0x7fb33c070420 2024-09-13T16:01:54.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.801+0000 7fb341800640 1 -- 172.21.15.70:0/3011857743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb33c150240 con 0x7fb33c070420 2024-09-13T16:01:54.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.802+0000 7fb341800640 1 -- 172.21.15.70:0/3011857743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33c1381c0 con 0x7fb33c070420 2024-09-13T16:01:54.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.803+0000 7fb341800640 1 -- 172.21.15.70:0/3011857743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb33c138350 con 0x7fb33c070420 2024-09-13T16:01:54.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.803+0000 7fb333400640 1 -- 172.21.15.70:0/3011857743 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb32c003990 con 0x7fb33c070420 2024-09-13T16:01:54.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.804+0000 7fb333400640 1 --2- 172.21.15.70:0/3011857743 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb31806ac00 0x7fb31806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:54.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.804+0000 7fb333400640 1 -- 172.21.15.70:0/3011857743 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb32c088840 con 0x7fb33c070420 2024-09-13T16:01:54.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.805+0000 7fb332000640 1 --2- 172.21.15.70:0/3011857743 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb31806ac00 0x7fb31806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:54.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.805+0000 7fb332000640 1 --2- 172.21.15.70:0/3011857743 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb31806ac00 0x7fb31806d0c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb324034000 tx=0x7fb32402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:54.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.808+0000 7fb333400640 1 -- 172.21.15.70:0/3011857743 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb32c053ab0 con 0x7fb33c070420 2024-09-13T16:01:54.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.977+0000 7fb341800640 1 -- 172.21.15.70:0/3011857743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb33c06fee0 con 0x7fb33c070420 2024-09-13T16:01:54.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.978+0000 7fb333400640 1 -- 172.21.15.70:0/3011857743 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb32c017020 con 0x7fb33c070420 2024-09-13T16:01:54.979 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-13T16:01:54.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.980+0000 7fb341800640 1 -- 172.21.15.70:0/3011857743 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb31806ac00 msgr2=0x7fb31806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:54.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.980+0000 7fb341800640 1 --2- 172.21.15.70:0/3011857743 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb31806ac00 0x7fb31806d0c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb324034000 tx=0x7fb32402e000 comp rx=0 tx=0).stop 2024-09-13T16:01:54.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.980+0000 7fb341800640 1 -- 172.21.15.70:0/3011857743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb33c070420 msgr2=0x7fb33c1f3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:54.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.980+0000 7fb341800640 1 --2- 172.21.15.70:0/3011857743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb33c070420 0x7fb33c1f3b30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00c400 tx=0x7fb32c00c8c0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.980+0000 7fb341800640 1 -- 172.21.15.70:0/3011857743 shutdown_connections 2024-09-13T16:01:54.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.980+0000 7fb341800640 1 --2- 172.21.15.70:0/3011857743 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb33c14f550 0x7fb33c14f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.980+0000 7fb341800640 1 --2- 172.21.15.70:0/3011857743 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb31806ac00 0x7fb31806d0c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.980+0000 7fb341800640 1 --2- 172.21.15.70:0/3011857743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c154ad0 0x7fb33c1f4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.980+0000 7fb341800640 1 --2- 172.21.15.70:0/3011857743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb33c070420 0x7fb33c1f3b30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:54.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.980+0000 7fb341800640 1 -- 172.21.15.70:0/3011857743 >> 172.21.15.70:0/3011857743 conn(0x7fb33c0b0580 msgr2=0x7fb33c152170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:54.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.980+0000 7fb341800640 1 -- 172.21.15.70:0/3011857743 shutdown_connections 2024-09-13T16:01:54.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:54.980+0000 7fb341800640 1 -- 172.21.15.70:0/3011857743 wait complete. 2024-09-13T16:01:54.998 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:01:55.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.152+0000 7f4a35400640 1 Processor -- start 2024-09-13T16:01:55.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.152+0000 7f4a35400640 1 -- start start 2024-09-13T16:01:55.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.153+0000 7f4a35400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a30069ed0 0x7f4a3006a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:55.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.153+0000 7f4a35400640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3006a850 con 0x7f4a3015c7e0 2024-09-13T16:01:55.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.153+0000 7f4a35400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a300b2900 con 0x7f4a30160510 2024-09-13T16:01:55.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.153+0000 7f4a35400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a30161240 con 0x7f4a30069ed0 2024-09-13T16:01:55.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.153+0000 7f4a2e800640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f4a3015c7e0 0x7f4a300b3680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49626/0 (socket says 172.21.15.70:49626) 2024-09-13T16:01:55.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.153+0000 7f4a2e800640 1 -- 172.21.15.70:0/2619796274 learned_addr learned my addr 172.21.15.70:0/2619796274 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.154+0000 7f4a27e00640 1 --2- 172.21.15.70:0/2619796274 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a30069ed0 0x7f4a3006a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.154+0000 7f4a2de00640 1 -- 172.21.15.70:0/2619796274 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2432485030 0 0) 0x7f4a3006a850 con 0x7f4a3015c7e0 2024-09-13T16:01:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.154+0000 7f4a2de00640 1 -- 172.21.15.70:0/2619796274 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a14003520 con 0x7f4a3015c7e0 2024-09-13T16:01:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.154+0000 7f4a2de00640 1 -- 172.21.15.70:0/2619796274 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4033541886 0 0) 0x7f4a14003520 con 0x7f4a3015c7e0 2024-09-13T16:01:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.154+0000 7f4a2de00640 1 -- 172.21.15.70:0/2619796274 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a30069ed0 msgr2=0x7f4a3006a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.154+0000 7f4a2de00640 1 --2- 172.21.15.70:0/2619796274 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a30069ed0 0x7f4a3006a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.154+0000 7f4a2de00640 1 -- 172.21.15.70:0/2619796274 >> v1:172.21.15.107:6789/0 conn(0x7f4a30160510 legacy=0x7f4a301609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.154+0000 7f4a2de00640 1 -- 172.21.15.70:0/2619796274 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a300b2ba0 con 0x7f4a3015c7e0 2024-09-13T16:01:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.154+0000 7f4a2de00640 1 -- 172.21.15.70:0/2619796274 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f4a20001670 con 0x7f4a3015c7e0 2024-09-13T16:01:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.154+0000 7f4a2de00640 1 -- 172.21.15.70:0/2619796274 >> v1:172.21.15.70:6789/0 conn(0x7f4a3015c7e0 legacy=0x7f4a300b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.154+0000 7f4a2de00640 1 --2- 172.21.15.70:0/2619796274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a140039a0 0x7f4a14003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.154+0000 7f4a2de00640 1 --2- 172.21.15.70:0/2619796274 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a30069ed0 0x7f4a140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.154+0000 7f4a2de00640 1 --2- 172.21.15.70:0/2619796274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a14004d00 0x7f4a14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.154+0000 7f4a2de00640 1 -- 172.21.15.70:0/2619796274 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a30161240 con 0x7f4a14004d00 2024-09-13T16:01:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.154+0000 7f4a2de00640 1 -- 172.21.15.70:0/2619796274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1400ba30 con 0x7f4a140039a0 2024-09-13T16:01:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.154+0000 7f4a2de00640 1 -- 172.21.15.70:0/2619796274 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1400bbf0 con 0x7f4a30069ed0 2024-09-13T16:01:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.154+0000 7f4a2f200640 1 --2- 172.21.15.70:0/2619796274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a14004d00 0x7f4a14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.155+0000 7f4a27e00640 1 --2- 172.21.15.70:0/2619796274 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a30069ed0 0x7f4a140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.155+0000 7f4a2e800640 1 --2- 172.21.15.70:0/2619796274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a140039a0 0x7f4a14003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.155+0000 7f4a2f200640 1 -- 172.21.15.70:0/2619796274 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a30069ed0 msgr2=0x7f4a140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.155+0000 7f4a2f200640 1 --2- 172.21.15.70:0/2619796274 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a30069ed0 0x7f4a140047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.155+0000 7f4a2f200640 1 -- 172.21.15.70:0/2619796274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a140039a0 msgr2=0x7f4a14003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.155+0000 7f4a2f200640 1 --2- 172.21.15.70:0/2619796274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a140039a0 0x7f4a14003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.155+0000 7f4a2f200640 1 -- 172.21.15.70:0/2619796274 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a14003520 con 0x7f4a14004d00 2024-09-13T16:01:55.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.156+0000 7f4a2f200640 1 --2- 172.21.15.70:0/2619796274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a14004d00 0x7f4a14005180 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4a28001e20 tx=0x7f4a140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea8fb3ef56da427 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:55.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.156+0000 7f4a2de00640 1 -- 172.21.15.70:0/2619796274 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2802ae40 con 0x7f4a14004d00 2024-09-13T16:01:55.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.156+0000 7f4a2de00640 1 -- 172.21.15.70:0/2619796274 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a28003970 con 0x7f4a14004d00 2024-09-13T16:01:55.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.156+0000 7f4a2de00640 1 -- 172.21.15.70:0/2619796274 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28003d20 con 0x7f4a14004d00 2024-09-13T16:01:55.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.157+0000 7f4a35400640 1 -- 172.21.15.70:0/2619796274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a14004d00 msgr2=0x7f4a14005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:55.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.157+0000 7f4a35400640 1 --2- 172.21.15.70:0/2619796274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a14004d00 0x7f4a14005180 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4a28001e20 tx=0x7f4a140057f0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.157+0000 7f4a2f200640 1 -- 172.21.15.70:0/2619796274 reap_dead start 2024-09-13T16:01:55.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.157+0000 7f4a35400640 1 -- 172.21.15.70:0/2619796274 shutdown_connections 2024-09-13T16:01:55.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.157+0000 7f4a35400640 1 -- 172.21.15.70:0/2619796274 >> 172.21.15.70:0/2619796274 conn(0x7f4a3006afe0 msgr2=0x7f4a3006b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:55.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.157+0000 7f4a35400640 1 -- 172.21.15.70:0/2619796274 shutdown_connections 2024-09-13T16:01:55.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.157+0000 7f4a35400640 1 -- 172.21.15.70:0/2619796274 wait complete. 2024-09-13T16:01:55.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.158+0000 7f4a35400640 1 Processor -- start 2024-09-13T16:01:55.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.159+0000 7f4a35400640 1 -- start start 2024-09-13T16:01:55.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.159+0000 7f4a35400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a14004d00 0x7f4a30158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:55.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.159+0000 7f4a35400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a3015fd90 0x7f4a30158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:55.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.159+0000 7f4a35400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a301569f0 0x7f4a30156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:55.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.159+0000 7f4a35400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3015cf60 con 0x7f4a301569f0 2024-09-13T16:01:55.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.159+0000 7f4a35400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3015d240 con 0x7f4a3015fd90 2024-09-13T16:01:55.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.159+0000 7f4a35400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3015d520 con 0x7f4a14004d00 2024-09-13T16:01:55.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.160+0000 7f4a2f200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a301569f0 0x7f4a30156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:55.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.160+0000 7f4a2f200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a301569f0 0x7f4a30156e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44290/0 (socket says 172.21.15.70:44290) 2024-09-13T16:01:55.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.160+0000 7f4a2f200640 1 -- 172.21.15.70:0/1313041083 learned_addr learned my addr 172.21.15.70:0/1313041083 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:55.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.160+0000 7f4a27e00640 1 --2- 172.21.15.70:0/1313041083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a3015fd90 0x7f4a30158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:55.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.160+0000 7f4a2e800640 1 --2- 172.21.15.70:0/1313041083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a14004d00 0x7f4a30158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:55.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.160+0000 7f4a2f200640 1 -- 172.21.15.70:0/1313041083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a14004d00 msgr2=0x7f4a30158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:55.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.160+0000 7f4a2f200640 1 --2- 172.21.15.70:0/1313041083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a14004d00 0x7f4a30158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.160+0000 7f4a2f200640 1 -- 172.21.15.70:0/1313041083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a3015fd90 msgr2=0x7f4a30158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:55.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.160+0000 7f4a2f200640 1 --2- 172.21.15.70:0/1313041083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a3015fd90 0x7f4a30158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.160+0000 7f4a2f200640 1 -- 172.21.15.70:0/1313041083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3015d800 con 0x7f4a301569f0 2024-09-13T16:01:55.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.160+0000 7f4a2f200640 1 --2- 172.21.15.70:0/1313041083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a301569f0 0x7f4a30156e70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4a28005040 tx=0x7f4a280014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:55.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.161+0000 7f4a26a00640 1 -- 172.21.15.70:0/1313041083 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28006e80 con 0x7f4a301569f0 2024-09-13T16:01:55.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.161+0000 7f4a26a00640 1 -- 172.21.15.70:0/1313041083 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a28003cf0 con 0x7f4a301569f0 2024-09-13T16:01:55.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.161+0000 7f4a35400640 1 -- 172.21.15.70:0/1313041083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a3015dae0 con 0x7f4a301569f0 2024-09-13T16:01:55.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.161+0000 7f4a26a00640 1 -- 172.21.15.70:0/1313041083 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a280052d0 con 0x7f4a301569f0 2024-09-13T16:01:55.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.161+0000 7f4a35400640 1 -- 172.21.15.70:0/1313041083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a300b0060 con 0x7f4a301569f0 2024-09-13T16:01:55.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.162+0000 7f4a35400640 1 -- 172.21.15.70:0/1313041083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a300b0060 con 0x7f4a301569f0 2024-09-13T16:01:55.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.163+0000 7f4a26a00640 1 -- 172.21.15.70:0/1313041083 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4a28005430 con 0x7f4a301569f0 2024-09-13T16:01:55.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.163+0000 7f4a26a00640 1 --2- 172.21.15.70:0/1313041083 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4a0c06ac00 0x7f4a0c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:55.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.163+0000 7f4a26a00640 1 -- 172.21.15.70:0/1313041083 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a280a9080 con 0x7f4a301569f0 2024-09-13T16:01:55.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.164+0000 7f4a2e800640 1 --2- 172.21.15.70:0/1313041083 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4a0c06ac00 0x7f4a0c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:55.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.164+0000 7f4a2e800640 1 --2- 172.21.15.70:0/1313041083 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4a0c06ac00 0x7f4a0c06d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4a20000c00 tx=0x7f4a20000f80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.168+0000 7f4a26a00640 1 -- 172.21.15.70:0/1313041083 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4a280742e0 con 0x7f4a301569f0 2024-09-13T16:01:55.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.334+0000 7f4a35400640 1 -- 172.21.15.70:0/1313041083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4a300b0060 con 0x7f4a301569f0 2024-09-13T16:01:55.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.335+0000 7f4a26a00640 1 -- 172.21.15.70:0/1313041083 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4a28003e60 con 0x7f4a301569f0 2024-09-13T16:01:55.336 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-13T16:01:55.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.337+0000 7f4a35400640 1 -- 172.21.15.70:0/1313041083 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4a0c06ac00 msgr2=0x7f4a0c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:55.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.337+0000 7f4a35400640 1 --2- 172.21.15.70:0/1313041083 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4a0c06ac00 0x7f4a0c06d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4a20000c00 tx=0x7f4a20000f80 comp rx=0 tx=0).stop 2024-09-13T16:01:55.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.337+0000 7f4a35400640 1 -- 172.21.15.70:0/1313041083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a301569f0 msgr2=0x7f4a30156e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:55.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.337+0000 7f4a35400640 1 --2- 172.21.15.70:0/1313041083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a301569f0 0x7f4a30156e70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4a28005040 tx=0x7f4a280014a0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.337+0000 7f4a35400640 1 -- 172.21.15.70:0/1313041083 shutdown_connections 2024-09-13T16:01:55.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.337+0000 7f4a35400640 1 --2- 172.21.15.70:0/1313041083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a301569f0 0x7f4a30156e70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.337+0000 7f4a35400640 1 --2- 172.21.15.70:0/1313041083 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4a0c06ac00 0x7f4a0c06d0c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.337+0000 7f4a35400640 1 --2- 172.21.15.70:0/1313041083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a3015fd90 0x7f4a30158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.337+0000 7f4a35400640 1 --2- 172.21.15.70:0/1313041083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a14004d00 0x7f4a30158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.337+0000 7f4a35400640 1 -- 172.21.15.70:0/1313041083 >> 172.21.15.70:0/1313041083 conn(0x7f4a3006afe0 msgr2=0x7f4a3015b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:55.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.337+0000 7f4a35400640 1 -- 172.21.15.70:0/1313041083 shutdown_connections 2024-09-13T16:01:55.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.337+0000 7f4a35400640 1 -- 172.21.15.70:0/1313041083 wait complete. 2024-09-13T16:01:55.354 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T16:01:55.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.506+0000 7f61ebe00640 1 Processor -- start 2024-09-13T16:01:55.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.506+0000 7f61ebe00640 1 -- start start 2024-09-13T16:01:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.507+0000 7f61ebe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f61ec0cb3d0 0x7f61ec069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.507+0000 7f61ebe00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f61ec06a410 0x7f61ec070430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.507+0000 7f61ebe00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ec0cb8d0 con 0x7f61ec15dc30 2024-09-13T16:01:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.507+0000 7f61ebe00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ec15e010 con 0x7f61ec06a410 2024-09-13T16:01:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.507+0000 7f61ebe00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ec0ce100 con 0x7f61ec0cb3d0 2024-09-13T16:01:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.507+0000 7f61eb400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f61ec06a410 0x7f61ec070430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.507+0000 7f61eb400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f61ec06a410 0x7f61ec070430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44302/0 (socket says 172.21.15.70:44302) 2024-09-13T16:01:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.507+0000 7f61eb400640 1 -- 172.21.15.70:0/3271894952 learned_addr learned my addr 172.21.15.70:0/3271894952 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.508+0000 7f61e2000640 1 --2- 172.21.15.70:0/3271894952 >> v2:172.21.15.107:3300/0 conn(0x7f61ec0cb3d0 0x7f61ec069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.508+0000 7f61eb400640 1 -- 172.21.15.70:0/3271894952 >> v2:172.21.15.107:3300/0 conn(0x7f61ec0cb3d0 msgr2=0x7f61ec069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.508+0000 7f61eb400640 1 --2- 172.21.15.70:0/3271894952 >> v2:172.21.15.107:3300/0 conn(0x7f61ec0cb3d0 0x7f61ec069ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.508+0000 7f61eb400640 1 -- 172.21.15.70:0/3271894952 >> v1:172.21.15.107:6789/0 conn(0x7f61ec15dc30 legacy=0x7f61ec0cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:55.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.508+0000 7f61eb400640 1 -- 172.21.15.70:0/3271894952 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec0cbbb0 con 0x7f61ec06a410 2024-09-13T16:01:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.509+0000 7f61eb400640 1 --2- 172.21.15.70:0/3271894952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61ec06a410 0x7f61ec070430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f61ec071be0 tx=0x7f61e402a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf8522adbd68112 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.509+0000 7f61ea000640 1 -- 172.21.15.70:0/3271894952 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4031600 con 0x7f61ec06a410 2024-09-13T16:01:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.509+0000 7f61ea000640 1 -- 172.21.15.70:0/3271894952 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e402d050 con 0x7f61ec06a410 2024-09-13T16:01:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.509+0000 7f61ea000640 1 -- 172.21.15.70:0/3271894952 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4031980 con 0x7f61ec06a410 2024-09-13T16:01:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.510+0000 7f61ebe00640 1 -- 172.21.15.70:0/3271894952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61ec06a410 msgr2=0x7f61ec070430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.510+0000 7f61ebe00640 1 --2- 172.21.15.70:0/3271894952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61ec06a410 0x7f61ec070430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f61ec071be0 tx=0x7f61e402a760 comp rx=0 tx=0).stop 2024-09-13T16:01:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.510+0000 7f61ebe00640 1 -- 172.21.15.70:0/3271894952 shutdown_connections 2024-09-13T16:01:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.510+0000 7f61ebe00640 1 --2- 172.21.15.70:0/3271894952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61ec06a410 0x7f61ec070430 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.510+0000 7f61ebe00640 1 --2- 172.21.15.70:0/3271894952 >> v2:172.21.15.107:3300/0 conn(0x7f61ec0cb3d0 0x7f61ec069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.510+0000 7f61ebe00640 1 -- 172.21.15.70:0/3271894952 >> 172.21.15.70:0/3271894952 conn(0x7f61ec0affd0 msgr2=0x7f61ec0b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:55.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.510+0000 7f61ebe00640 1 -- 172.21.15.70:0/3271894952 shutdown_connections 2024-09-13T16:01:55.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.510+0000 7f61ebe00640 1 -- 172.21.15.70:0/3271894952 wait complete. 2024-09-13T16:01:55.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.511+0000 7f61ebe00640 1 Processor -- start 2024-09-13T16:01:55.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.511+0000 7f61ebe00640 1 -- start start 2024-09-13T16:01:55.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.512+0000 7f61ebe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61ec06a410 0x7f61ec1509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:55.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.512+0000 7f61ebe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61ec0cb3d0 0x7f61ec157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:55.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.512+0000 7f61ebe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61ec15dc30 0x7f61ec0b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:55.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.512+0000 7f61ebe00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec155c10 con 0x7f61ec15dc30 2024-09-13T16:01:55.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.512+0000 7f61ebe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec1582f0 con 0x7f61ec06a410 2024-09-13T16:01:55.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.512+0000 7f61ebe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec155ed0 con 0x7f61ec0cb3d0 2024-09-13T16:01:55.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.513+0000 7f61eb400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61ec15dc30 0x7f61ec0b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:55.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.513+0000 7f61eb400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61ec15dc30 0x7f61ec0b2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44312/0 (socket says 172.21.15.70:44312) 2024-09-13T16:01:55.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.513+0000 7f61eb400640 1 -- 172.21.15.70:0/129241891 learned_addr learned my addr 172.21.15.70:0/129241891 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:55.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.513+0000 7f61eaa00640 1 --2- 172.21.15.70:0/129241891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61ec06a410 0x7f61ec1509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:55.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.513+0000 7f61e2000640 1 --2- 172.21.15.70:0/129241891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61ec0cb3d0 0x7f61ec157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:55.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.513+0000 7f61eb400640 1 -- 172.21.15.70:0/129241891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61ec0cb3d0 msgr2=0x7f61ec157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:55.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.513+0000 7f61eb400640 1 --2- 172.21.15.70:0/129241891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61ec0cb3d0 0x7f61ec157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.513+0000 7f61eb400640 1 -- 172.21.15.70:0/129241891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61ec06a410 msgr2=0x7f61ec1509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:55.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.513+0000 7f61eb400640 1 --2- 172.21.15.70:0/129241891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61ec06a410 0x7f61ec1509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.513+0000 7f61eb400640 1 -- 172.21.15.70:0/129241891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e4009b30 con 0x7f61ec15dc30 2024-09-13T16:01:55.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.513+0000 7f61eb400640 1 --2- 172.21.15.70:0/129241891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61ec15dc30 0x7f61ec0b2420 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009e50 tx=0x7f61e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:55.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.514+0000 7f61e3e00640 1 -- 172.21.15.70:0/129241891 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e403d860 con 0x7f61ec15dc30 2024-09-13T16:01:55.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.514+0000 7f61e3e00640 1 -- 172.21.15.70:0/129241891 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e403d9e0 con 0x7f61ec15dc30 2024-09-13T16:01:55.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.514+0000 7f61e3e00640 1 -- 172.21.15.70:0/129241891 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e403dd90 con 0x7f61ec15dc30 2024-09-13T16:01:55.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.514+0000 7f61ebe00640 1 -- 172.21.15.70:0/129241891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ec1561b0 con 0x7f61ec15dc30 2024-09-13T16:01:55.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.514+0000 7f61ebe00640 1 -- 172.21.15.70:0/129241891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ec151640 con 0x7f61ec15dc30 2024-09-13T16:01:55.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.515+0000 7f61ebe00640 1 -- 172.21.15.70:0/129241891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ec067320 con 0x7f61ec15dc30 2024-09-13T16:01:55.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.516+0000 7f61e3e00640 1 -- 172.21.15.70:0/129241891 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f61e403b400 con 0x7f61ec15dc30 2024-09-13T16:01:55.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.516+0000 7f61e3e00640 1 --2- 172.21.15.70:0/129241891 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f61c806ac00 0x7f61c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:55.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.516+0000 7f61e3e00640 1 -- 172.21.15.70:0/129241891 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61e40aa090 con 0x7f61ec15dc30 2024-09-13T16:01:55.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.517+0000 7f61eaa00640 1 --2- 172.21.15.70:0/129241891 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f61c806ac00 0x7f61c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:55.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.517+0000 7f61eaa00640 1 --2- 172.21.15.70:0/129241891 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f61c806ac00 0x7f61c806d0c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f61dc000f60 tx=0x7f61dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:55.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.521+0000 7f61e3e00640 1 -- 172.21.15.70:0/129241891 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f61e4075310 con 0x7f61ec15dc30 2024-09-13T16:01:55.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.702+0000 7f61ebe00640 1 -- 172.21.15.70:0/129241891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f61ec0ad6d0 con 0x7f61ec15dc30 2024-09-13T16:01:55.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.702+0000 7f61e3e00640 1 -- 172.21.15.70:0/129241891 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f61e4009510 con 0x7f61ec15dc30 2024-09-13T16:01:55.703 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2024-09-13T16:01:55.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.704+0000 7f61ebe00640 1 -- 172.21.15.70:0/129241891 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f61c806ac00 msgr2=0x7f61c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:55.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.704+0000 7f61ebe00640 1 --2- 172.21.15.70:0/129241891 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f61c806ac00 0x7f61c806d0c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f61dc000f60 tx=0x7f61dc009040 comp rx=0 tx=0).stop 2024-09-13T16:01:55.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.704+0000 7f61ebe00640 1 -- 172.21.15.70:0/129241891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61ec15dc30 msgr2=0x7f61ec0b2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:55.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.704+0000 7f61ebe00640 1 --2- 172.21.15.70:0/129241891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61ec15dc30 0x7f61ec0b2420 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009e50 tx=0x7f61e4004a40 comp rx=0 tx=0).stop 2024-09-13T16:01:55.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.704+0000 7f61ebe00640 1 -- 172.21.15.70:0/129241891 shutdown_connections 2024-09-13T16:01:55.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.704+0000 7f61ebe00640 1 --2- 172.21.15.70:0/129241891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61ec15dc30 0x7f61ec0b2420 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.704+0000 7f61ebe00640 1 --2- 172.21.15.70:0/129241891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61ec0cb3d0 0x7f61ec157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.704+0000 7f61ebe00640 1 --2- 172.21.15.70:0/129241891 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f61c806ac00 0x7f61c806d0c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.704+0000 7f61ebe00640 1 --2- 172.21.15.70:0/129241891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61ec06a410 0x7f61ec1509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:55.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.704+0000 7f61ebe00640 1 -- 172.21.15.70:0/129241891 >> 172.21.15.70:0/129241891 conn(0x7f61ec0affd0 msgr2=0x7f61ec0ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:55.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.704+0000 7f61ebe00640 1 -- 172.21.15.70:0/129241891 shutdown_connections 2024-09-13T16:01:55.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:55.704+0000 7f61ebe00640 1 -- 172.21.15.70:0/129241891 wait complete. 2024-09-13T16:01:55.721 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T16:01:55.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:55.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-13T16:01:55.783 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2024-09-13T16:01:55.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:55.783 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T16:01:55.832 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:01:55.832 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:01:55.872 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:01:55.873 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:01:55.950 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:01:55.950 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:01:56.029 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:56.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.183+0000 7f5102800640 1 Processor -- start 2024-09-13T16:01:56.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.183+0000 7f5102800640 1 -- start start 2024-09-13T16:01:56.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.184+0000 7f5102800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f50fc0b1b00 0x7f50fc0cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:56.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.184+0000 7f5102800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f50fc0cde50 0x7f50fc15a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:56.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.184+0000 7f5102800640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50fc06bea0 con 0x7f50fc15a520 2024-09-13T16:01:56.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.184+0000 7f5102800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50fc06c180 con 0x7f50fc0cde50 2024-09-13T16:01:56.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.184+0000 7f5102800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50fc06c460 con 0x7f50fc0b1b00 2024-09-13T16:01:56.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.185+0000 7f50fb400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f50fc15a520 0x7f50fc06b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49642/0 (socket says 172.21.15.70:49642) 2024-09-13T16:01:56.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.185+0000 7f50fb400640 1 -- 172.21.15.70:0/2966966284 learned_addr learned my addr 172.21.15.70:0/2966966284 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:56.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.185+0000 7f50fbe00640 1 --2- 172.21.15.70:0/2966966284 >> v2:172.21.15.70:3300/0 conn(0x7f50fc0cde50 0x7f50fc15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:56.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.185+0000 7f50faa00640 1 --2- 172.21.15.70:0/2966966284 >> v2:172.21.15.107:3300/0 conn(0x7f50fc0b1b00 0x7f50fc0cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:56.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.185+0000 7f50fa000640 1 -- 172.21.15.70:0/2966966284 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304387558 0 0) 0x7f50fc06bea0 con 0x7f50fc15a520 2024-09-13T16:01:56.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.185+0000 7f50fa000640 1 -- 172.21.15.70:0/2966966284 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50e0003520 con 0x7f50fc15a520 2024-09-13T16:01:56.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.185+0000 7f50fbe00640 1 -- 172.21.15.70:0/2966966284 >> v2:172.21.15.107:3300/0 conn(0x7f50fc0b1b00 msgr2=0x7f50fc0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:56.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.185+0000 7f50fbe00640 1 --2- 172.21.15.70:0/2966966284 >> v2:172.21.15.107:3300/0 conn(0x7f50fc0b1b00 0x7f50fc0cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.185+0000 7f50fbe00640 1 -- 172.21.15.70:0/2966966284 >> v1:172.21.15.70:6789/0 conn(0x7f50fc15a520 legacy=0x7f50fc06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:56.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.185+0000 7f50fbe00640 1 -- 172.21.15.70:0/2966966284 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc06c740 con 0x7f50fc0cde50 2024-09-13T16:01:56.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.186+0000 7f50fbe00640 1 --2- 172.21.15.70:0/2966966284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50fc0cde50 0x7f50fc15a900 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f50fc06bdd0 tx=0x7f50f402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4650ae1d1c6c7a1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:56.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.186+0000 7f50fa000640 1 -- 172.21.15.70:0/2966966284 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f402aea0 con 0x7f50fc0cde50 2024-09-13T16:01:56.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.186+0000 7f50fa000640 1 -- 172.21.15.70:0/2966966284 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f402d050 con 0x7f50fc0cde50 2024-09-13T16:01:56.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.186+0000 7f50fa000640 1 -- 172.21.15.70:0/2966966284 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f4007960 con 0x7f50fc0cde50 2024-09-13T16:01:56.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.187+0000 7f5102800640 1 -- 172.21.15.70:0/2966966284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50fc0cde50 msgr2=0x7f50fc15a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:56.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.187+0000 7f5102800640 1 --2- 172.21.15.70:0/2966966284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50fc0cde50 0x7f50fc15a900 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f50fc06bdd0 tx=0x7f50f402a680 comp rx=0 tx=0).stop 2024-09-13T16:01:56.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.187+0000 7f5102800640 1 -- 172.21.15.70:0/2966966284 shutdown_connections 2024-09-13T16:01:56.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.187+0000 7f5102800640 1 --2- 172.21.15.70:0/2966966284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50fc0cde50 0x7f50fc15a900 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.187+0000 7f5102800640 1 --2- 172.21.15.70:0/2966966284 >> v2:172.21.15.107:3300/0 conn(0x7f50fc0b1b00 0x7f50fc0cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.187+0000 7f5102800640 1 -- 172.21.15.70:0/2966966284 >> 172.21.15.70:0/2966966284 conn(0x7f50fc0b0510 msgr2=0x7f50fc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:56.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.187+0000 7f5102800640 1 -- 172.21.15.70:0/2966966284 shutdown_connections 2024-09-13T16:01:56.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.187+0000 7f5102800640 1 -- 172.21.15.70:0/2966966284 wait complete. 2024-09-13T16:01:56.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.189+0000 7f5102800640 1 Processor -- start 2024-09-13T16:01:56.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.189+0000 7f5102800640 1 -- start start 2024-09-13T16:01:56.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.190+0000 7f5102800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50fc0b1b00 0x7f50fc150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:56.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.190+0000 7f5102800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50fc0cde50 0x7f50fc0af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:56.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.190+0000 7f5102800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50fc15a520 0x7f50fc0af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:56.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.190+0000 7f5102800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc152680 con 0x7f50fc0b1b00 2024-09-13T16:01:56.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.190+0000 7f5102800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc152960 con 0x7f50fc0cde50 2024-09-13T16:01:56.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.190+0000 7f5102800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc06f700 con 0x7f50fc15a520 2024-09-13T16:01:56.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.190+0000 7f50fb400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50fc0b1b00 0x7f50fc150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:56.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.190+0000 7f50fb400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50fc0b1b00 0x7f50fc150fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44326/0 (socket says 172.21.15.70:44326) 2024-09-13T16:01:56.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.190+0000 7f50fb400640 1 -- 172.21.15.70:0/1496376263 learned_addr learned my addr 172.21.15.70:0/1496376263 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:56.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.190+0000 7f50faa00640 1 --2- 172.21.15.70:0/1496376263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50fc0cde50 0x7f50fc0af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:56.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.190+0000 7f50fbe00640 1 --2- 172.21.15.70:0/1496376263 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50fc15a520 0x7f50fc0af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:56.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.191+0000 7f50fb400640 1 -- 172.21.15.70:0/1496376263 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50fc15a520 msgr2=0x7f50fc0af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:56.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.191+0000 7f50fb400640 1 --2- 172.21.15.70:0/1496376263 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50fc15a520 0x7f50fc0af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.191+0000 7f50fb400640 1 -- 172.21.15.70:0/1496376263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50fc0cde50 msgr2=0x7f50fc0af4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:56.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.191+0000 7f50fb400640 1 --2- 172.21.15.70:0/1496376263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50fc0cde50 0x7f50fc0af4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.191+0000 7f50fb400640 1 -- 172.21.15.70:0/1496376263 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f4009a70 con 0x7f50fc0b1b00 2024-09-13T16:01:56.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.191+0000 7f50fb400640 1 --2- 172.21.15.70:0/1496376263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50fc0b1b00 0x7f50fc150fb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f50ec00c410 tx=0x7f50ec00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:56.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.191+0000 7f50f3400640 1 -- 172.21.15.70:0/1496376263 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec005ce0 con 0x7f50fc0b1b00 2024-09-13T16:01:56.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.191+0000 7f50f3400640 1 -- 172.21.15.70:0/1496376263 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec005e40 con 0x7f50fc0b1b00 2024-09-13T16:01:56.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.191+0000 7f5102800640 1 -- 172.21.15.70:0/1496376263 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50fc06f9e0 con 0x7f50fc0b1b00 2024-09-13T16:01:56.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.191+0000 7f50f3400640 1 -- 172.21.15.70:0/1496376263 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec0072f0 con 0x7f50fc0b1b00 2024-09-13T16:01:56.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.191+0000 7f5102800640 1 -- 172.21.15.70:0/1496376263 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50fc1514f0 con 0x7f50fc0b1b00 2024-09-13T16:01:56.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.192+0000 7f5102800640 1 -- 172.21.15.70:0/1496376263 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50fc151680 con 0x7f50fc0b1b00 2024-09-13T16:01:56.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.193+0000 7f50f3400640 1 -- 172.21.15.70:0/1496376263 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f50ec007510 con 0x7f50fc0b1b00 2024-09-13T16:01:56.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.194+0000 7f50f3400640 1 --2- 172.21.15.70:0/1496376263 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f50dc06ac00 0x7f50dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:56.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.194+0000 7f50f3400640 1 -- 172.21.15.70:0/1496376263 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50ec0889b0 con 0x7f50fc0b1b00 2024-09-13T16:01:56.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.194+0000 7f50faa00640 1 --2- 172.21.15.70:0/1496376263 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f50dc06ac00 0x7f50dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:56.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.195+0000 7f50faa00640 1 --2- 172.21.15.70:0/1496376263 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f50dc06ac00 0x7f50dc06d0c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0ad570 tx=0x7f50e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:56.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.198+0000 7f50f3400640 1 -- 172.21.15.70:0/1496376263 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f50ec053c60 con 0x7f50fc0b1b00 2024-09-13T16:01:56.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.369+0000 7f5102800640 1 -- 172.21.15.70:0/1496376263 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50fc0cd910 con 0x7f50fc0b1b00 2024-09-13T16:01:56.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.370+0000 7f50f3400640 1 -- 172.21.15.70:0/1496376263 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f50ec017090 con 0x7f50fc0b1b00 2024-09-13T16:01:56.371 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:56.371 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:19.595458+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:56.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.372+0000 7f5102800640 1 -- 172.21.15.70:0/1496376263 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f50dc06ac00 msgr2=0x7f50dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:56.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.372+0000 7f5102800640 1 --2- 172.21.15.70:0/1496376263 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f50dc06ac00 0x7f50dc06d0c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0ad570 tx=0x7f50e8008040 comp rx=0 tx=0).stop 2024-09-13T16:01:56.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.372+0000 7f5102800640 1 -- 172.21.15.70:0/1496376263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50fc0b1b00 msgr2=0x7f50fc150fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:56.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.372+0000 7f5102800640 1 --2- 172.21.15.70:0/1496376263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50fc0b1b00 0x7f50fc150fb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f50ec00c410 tx=0x7f50ec00c8d0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.372+0000 7f5102800640 1 -- 172.21.15.70:0/1496376263 shutdown_connections 2024-09-13T16:01:56.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.372+0000 7f5102800640 1 --2- 172.21.15.70:0/1496376263 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50fc15a520 0x7f50fc0af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.372+0000 7f5102800640 1 --2- 172.21.15.70:0/1496376263 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f50dc06ac00 0x7f50dc06d0c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.372+0000 7f5102800640 1 --2- 172.21.15.70:0/1496376263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50fc0cde50 0x7f50fc0af4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.372+0000 7f5102800640 1 --2- 172.21.15.70:0/1496376263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50fc0b1b00 0x7f50fc150fb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.372+0000 7f5102800640 1 -- 172.21.15.70:0/1496376263 >> 172.21.15.70:0/1496376263 conn(0x7f50fc0b0510 msgr2=0x7f50fc06b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:56.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.372+0000 7f5102800640 1 -- 172.21.15.70:0/1496376263 shutdown_connections 2024-09-13T16:01:56.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.372+0000 7f5102800640 1 -- 172.21.15.70:0/1496376263 wait complete. 2024-09-13T16:01:56.390 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:01:06.070694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:01:16.922043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:01:17.580304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:01:56.390 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:01:56.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.545+0000 7faca3600640 1 Processor -- start 2024-09-13T16:01:56.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.545+0000 7faca3600640 1 -- start start 2024-09-13T16:01:56.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.546+0000 7faca3600640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fac9c154ad0 0x7fac9c0cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:56.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.546+0000 7faca3600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac9c06f830 0x7fac9c06fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:56.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.546+0000 7faca3600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9c06b7c0 con 0x7fac9c0ce2c0 2024-09-13T16:01:56.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.546+0000 7faca3600640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac9c06b5b0 con 0x7fac9c154ad0 2024-09-13T16:01:56.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.546+0000 7faca3600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c06baa0 con 0x7fac9c06f830 2024-09-13T16:01:56.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.546+0000 7faca1600640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fac9c0ce2c0 0x7fac9c0cbac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49654/0 (socket says 172.21.15.70:49654) 2024-09-13T16:01:56.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.546+0000 7faca1600640 1 -- 172.21.15.70:0/1697275753 learned_addr learned my addr 172.21.15.70:0/1697275753 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:56.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.546+0000 7fac9be00640 1 --2- 172.21.15.70:0/1697275753 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac9c06f830 0x7fac9c06fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:56.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.546+0000 7faca0c00640 1 --2- 172.21.15.70:0/1697275753 >> v2:172.21.15.70:3300/0 conn(0x7fac9c154ad0 0x7fac9c0cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:56.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.547+0000 7fac9b400640 1 -- 172.21.15.70:0/1697275753 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383945404 0 0) 0x7fac9c06b7c0 con 0x7fac9c0ce2c0 2024-09-13T16:01:56.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.547+0000 7fac9b400640 1 -- 172.21.15.70:0/1697275753 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac84003520 con 0x7fac9c0ce2c0 2024-09-13T16:01:56.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.547+0000 7faca0c00640 1 -- 172.21.15.70:0/1697275753 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac9c06f830 msgr2=0x7fac9c06fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:56.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.547+0000 7faca0c00640 1 --2- 172.21.15.70:0/1697275753 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac9c06f830 0x7fac9c06fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.547+0000 7faca0c00640 1 -- 172.21.15.70:0/1697275753 >> v1:172.21.15.70:6789/0 conn(0x7fac9c0ce2c0 legacy=0x7fac9c0cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:56.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.547+0000 7faca0c00640 1 -- 172.21.15.70:0/1697275753 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c06bd80 con 0x7fac9c154ad0 2024-09-13T16:01:56.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.547+0000 7fac9be00640 1 --2- 172.21.15.70:0/1697275753 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac9c06f830 0x7fac9c06fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:56.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.548+0000 7faca0c00640 1 --2- 172.21.15.70:0/1697275753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac9c154ad0 0x7fac9c0cdd80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fac900097a0 tx=0x7fac9002a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bb6a7099a70e3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:56.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.548+0000 7fac9b400640 1 -- 172.21.15.70:0/1697275753 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9002ae40 con 0x7fac9c154ad0 2024-09-13T16:01:56.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.548+0000 7fac9b400640 1 -- 172.21.15.70:0/1697275753 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac90032440 con 0x7fac9c154ad0 2024-09-13T16:01:56.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.548+0000 7fac9b400640 1 -- 172.21.15.70:0/1697275753 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac900327d0 con 0x7fac9c154ad0 2024-09-13T16:01:56.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.549+0000 7faca3600640 1 -- 172.21.15.70:0/1697275753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac9c154ad0 msgr2=0x7fac9c0cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:56.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.549+0000 7faca3600640 1 --2- 172.21.15.70:0/1697275753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac9c154ad0 0x7fac9c0cdd80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fac900097a0 tx=0x7fac9002a0f0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.549+0000 7faca3600640 1 -- 172.21.15.70:0/1697275753 shutdown_connections 2024-09-13T16:01:56.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.549+0000 7faca3600640 1 --2- 172.21.15.70:0/1697275753 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac9c06f830 0x7fac9c06fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.549+0000 7faca3600640 1 --2- 172.21.15.70:0/1697275753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac9c154ad0 0x7fac9c0cdd80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.549+0000 7faca3600640 1 -- 172.21.15.70:0/1697275753 >> 172.21.15.70:0/1697275753 conn(0x7fac9c0b0580 msgr2=0x7fac9c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:56.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.549+0000 7faca3600640 1 -- 172.21.15.70:0/1697275753 shutdown_connections 2024-09-13T16:01:56.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.549+0000 7faca3600640 1 -- 172.21.15.70:0/1697275753 wait complete. 2024-09-13T16:01:56.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.550+0000 7faca3600640 1 Processor -- start 2024-09-13T16:01:56.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.551+0000 7faca3600640 1 -- start start 2024-09-13T16:01:56.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.551+0000 7faca3600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac9c154ad0 0x7fac9c142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:56.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.551+0000 7faca3600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac9c150cd0 0x7fac9c1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:56.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.551+0000 7faca3600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac9c151150 0x7fac9c152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:56.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.551+0000 7faca3600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c1428c0 con 0x7fac9c154ad0 2024-09-13T16:01:56.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.551+0000 7faca3600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c1516b0 con 0x7fac9c150cd0 2024-09-13T16:01:56.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.551+0000 7faca3600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c151990 con 0x7fac9c151150 2024-09-13T16:01:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.552+0000 7faca0c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac9c154ad0 0x7fac9c142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.552+0000 7faca0c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac9c154ad0 0x7fac9c142380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44352/0 (socket says 172.21.15.70:44352) 2024-09-13T16:01:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.552+0000 7faca0c00640 1 -- 172.21.15.70:0/1429688753 learned_addr learned my addr 172.21.15.70:0/1429688753 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.552+0000 7fac9be00640 1 --2- 172.21.15.70:0/1429688753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac9c150cd0 0x7fac9c1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.552+0000 7faca1600640 1 --2- 172.21.15.70:0/1429688753 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac9c151150 0x7fac9c152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.552+0000 7faca0c00640 1 -- 172.21.15.70:0/1429688753 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac9c151150 msgr2=0x7fac9c152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.552+0000 7faca0c00640 1 --2- 172.21.15.70:0/1429688753 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac9c151150 0x7fac9c152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.552+0000 7faca0c00640 1 -- 172.21.15.70:0/1429688753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac9c150cd0 msgr2=0x7fac9c1524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.552+0000 7faca0c00640 1 --2- 172.21.15.70:0/1429688753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac9c150cd0 0x7fac9c1524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.552+0000 7faca0c00640 1 -- 172.21.15.70:0/1429688753 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac88009400 con 0x7fac9c154ad0 2024-09-13T16:01:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.552+0000 7faca0c00640 1 --2- 172.21.15.70:0/1429688753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac9c154ad0 0x7fac9c142380 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fac90035040 tx=0x7fac900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.553+0000 7fac98c00640 1 -- 172.21.15.70:0/1429688753 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9003d8f0 con 0x7fac9c154ad0 2024-09-13T16:01:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.553+0000 7fac98c00640 1 -- 172.21.15.70:0/1429688753 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9003da70 con 0x7fac9c154ad0 2024-09-13T16:01:56.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.553+0000 7faca3600640 1 -- 172.21.15.70:0/1429688753 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac90009400 con 0x7fac9c154ad0 2024-09-13T16:01:56.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.553+0000 7fac98c00640 1 -- 172.21.15.70:0/1429688753 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9003de20 con 0x7fac9c154ad0 2024-09-13T16:01:56.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.553+0000 7faca3600640 1 -- 172.21.15.70:0/1429688753 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9c151f50 con 0x7fac9c154ad0 2024-09-13T16:01:56.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.554+0000 7faca3600640 1 -- 172.21.15.70:0/1429688753 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9c0cb0d0 con 0x7fac9c154ad0 2024-09-13T16:01:56.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.555+0000 7fac98c00640 1 -- 172.21.15.70:0/1429688753 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fac90039040 con 0x7fac9c154ad0 2024-09-13T16:01:56.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.555+0000 7fac98c00640 1 --2- 172.21.15.70:0/1429688753 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fac7c06ac30 0x7fac7c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:56.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.556+0000 7fac98c00640 1 -- 172.21.15.70:0/1429688753 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac900a9760 con 0x7fac9c154ad0 2024-09-13T16:01:56.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.556+0000 7fac9be00640 1 --2- 172.21.15.70:0/1429688753 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fac7c06ac30 0x7fac7c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:56.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.556+0000 7fac9be00640 1 --2- 172.21.15.70:0/1429688753 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fac7c06ac30 0x7fac7c06d0f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fac9c071230 tx=0x7fac88008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:56.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.560+0000 7fac98c00640 1 -- 172.21.15.70:0/1429688753 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fac90074940 con 0x7fac9c154ad0 2024-09-13T16:01:56.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.725+0000 7faca3600640 1 -- 172.21.15.70:0/1429688753 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac9c0cdd80 con 0x7fac9c154ad0 2024-09-13T16:01:56.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.726+0000 7fac98c00640 1 -- 172.21.15.70:0/1429688753 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac90077f60 con 0x7fac9c154ad0 2024-09-13T16:01:56.727 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-13T16:01:56.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.728+0000 7faca3600640 1 -- 172.21.15.70:0/1429688753 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fac7c06ac30 msgr2=0x7fac7c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:56.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.728+0000 7faca3600640 1 --2- 172.21.15.70:0/1429688753 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fac7c06ac30 0x7fac7c06d0f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fac9c071230 tx=0x7fac88008040 comp rx=0 tx=0).stop 2024-09-13T16:01:56.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.728+0000 7faca3600640 1 -- 172.21.15.70:0/1429688753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac9c154ad0 msgr2=0x7fac9c142380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:56.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.728+0000 7faca3600640 1 --2- 172.21.15.70:0/1429688753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac9c154ad0 0x7fac9c142380 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fac90035040 tx=0x7fac900046c0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.728+0000 7faca3600640 1 -- 172.21.15.70:0/1429688753 shutdown_connections 2024-09-13T16:01:56.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.728+0000 7faca3600640 1 --2- 172.21.15.70:0/1429688753 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac9c151150 0x7fac9c152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.728+0000 7faca3600640 1 --2- 172.21.15.70:0/1429688753 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fac7c06ac30 0x7fac7c06d0f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.728+0000 7faca3600640 1 --2- 172.21.15.70:0/1429688753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac9c150cd0 0x7fac9c1524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.728+0000 7faca3600640 1 --2- 172.21.15.70:0/1429688753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac9c154ad0 0x7fac9c142380 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.728+0000 7faca3600640 1 -- 172.21.15.70:0/1429688753 >> 172.21.15.70:0/1429688753 conn(0x7fac9c0b0580 msgr2=0x7fac9c070720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:56.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.728+0000 7faca3600640 1 -- 172.21.15.70:0/1429688753 shutdown_connections 2024-09-13T16:01:56.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.728+0000 7faca3600640 1 -- 172.21.15.70:0/1429688753 wait complete. 2024-09-13T16:01:56.746 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:01:56.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.900+0000 7f2b4a800640 1 Processor -- start 2024-09-13T16:01:56.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.900+0000 7f2b4a800640 1 -- start start 2024-09-13T16:01:56.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.901+0000 7f2b4a800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2b440b1db0 0x7f2b4415a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.901+0000 7f2b4a800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2b4406b630 0x7f2b440cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.901+0000 7f2b4a800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b44157310 con 0x7f2b44156f30 2024-09-13T16:01:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.901+0000 7f2b4a800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4406bae0 con 0x7f2b440b1db0 2024-09-13T16:01:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.901+0000 7f2b4a800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b440b29c0 con 0x7f2b4406b630 2024-09-13T16:01:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.901+0000 7f2b48a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2b440b1db0 0x7f2b4415a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.901+0000 7f2b48a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2b440b1db0 0x7f2b4415a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44356/0 (socket says 172.21.15.70:44356) 2024-09-13T16:01:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.901+0000 7f2b48a00640 1 -- 172.21.15.70:0/3895977083 learned_addr learned my addr 172.21.15.70:0/3895977083 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.902+0000 7f2b48a00640 1 -- 172.21.15.70:0/3895977083 >> v2:172.21.15.107:3300/0 conn(0x7f2b4406b630 msgr2=0x7f2b440cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.902+0000 7f2b48a00640 1 --2- 172.21.15.70:0/3895977083 >> v2:172.21.15.107:3300/0 conn(0x7f2b4406b630 0x7f2b440cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.902+0000 7f2b48a00640 1 -- 172.21.15.70:0/3895977083 >> v1:172.21.15.107:6789/0 conn(0x7f2b44156f30 legacy=0x7f2b440b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.902+0000 7f2b48a00640 1 -- 172.21.15.70:0/3895977083 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b440b2ca0 con 0x7f2b440b1db0 2024-09-13T16:01:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.903+0000 7f2b48a00640 1 --2- 172.21.15.70:0/3895977083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b440b1db0 0x7f2b4415a460 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009870 tx=0x7f2b3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce97fc027de784a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.903+0000 7f2b43e00640 1 -- 172.21.15.70:0/3895977083 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b30032440 con 0x7f2b440b1db0 2024-09-13T16:01:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.903+0000 7f2b43e00640 1 -- 172.21.15.70:0/3895977083 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b300325a0 con 0x7f2b440b1db0 2024-09-13T16:01:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.903+0000 7f2b43e00640 1 -- 172.21.15.70:0/3895977083 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b30032930 con 0x7f2b440b1db0 2024-09-13T16:01:56.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.903+0000 7f2b4a800640 1 -- 172.21.15.70:0/3895977083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b440b1db0 msgr2=0x7f2b4415a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:56.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.904+0000 7f2b4a800640 1 --2- 172.21.15.70:0/3895977083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b440b1db0 0x7f2b4415a460 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009870 tx=0x7f2b3002a270 comp rx=0 tx=0).stop 2024-09-13T16:01:56.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.904+0000 7f2b4a800640 1 -- 172.21.15.70:0/3895977083 shutdown_connections 2024-09-13T16:01:56.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.904+0000 7f2b4a800640 1 --2- 172.21.15.70:0/3895977083 >> v2:172.21.15.107:3300/0 conn(0x7f2b4406b630 0x7f2b440cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.904+0000 7f2b4a800640 1 --2- 172.21.15.70:0/3895977083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b440b1db0 0x7f2b4415a460 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.904+0000 7f2b4a800640 1 -- 172.21.15.70:0/3895977083 >> 172.21.15.70:0/3895977083 conn(0x7f2b44069ed0 msgr2=0x7f2b4406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:56.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.904+0000 7f2b4a800640 1 -- 172.21.15.70:0/3895977083 shutdown_connections 2024-09-13T16:01:56.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.904+0000 7f2b4a800640 1 -- 172.21.15.70:0/3895977083 wait complete. 2024-09-13T16:01:56.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.905+0000 7f2b4a800640 1 Processor -- start 2024-09-13T16:01:56.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.905+0000 7f2b4a800640 1 -- start start 2024-09-13T16:01:56.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.906+0000 7f2b4a800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b4406b630 0x7f2b440a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:56.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.906+0000 7f2b4a800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b440b1db0 0x7f2b44154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.906+0000 7f2b4a800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b44156f30 0x7f2b440ad090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.906+0000 7f2b4a800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440a96c0 con 0x7f2b44156f30 2024-09-13T16:01:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.906+0000 7f2b4a800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b44155130 con 0x7f2b4406b630 2024-09-13T16:01:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.906+0000 7f2b4a800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440a8a40 con 0x7f2b440b1db0 2024-09-13T16:01:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.907+0000 7f2b49e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b44156f30 0x7f2b440ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.907+0000 7f2b49e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b44156f30 0x7f2b440ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44362/0 (socket says 172.21.15.70:44362) 2024-09-13T16:01:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.907+0000 7f2b49e00640 1 -- 172.21.15.70:0/4241270659 learned_addr learned my addr 172.21.15.70:0/4241270659 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:56.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.907+0000 7f2b48a00640 1 --2- 172.21.15.70:0/4241270659 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b440b1db0 0x7f2b44154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:56.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.907+0000 7f2b49e00640 1 -- 172.21.15.70:0/4241270659 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b440b1db0 msgr2=0x7f2b44154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:56.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.907+0000 7f2b49400640 1 --2- 172.21.15.70:0/4241270659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b4406b630 0x7f2b440a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:56.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.907+0000 7f2b49e00640 1 --2- 172.21.15.70:0/4241270659 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b440b1db0 0x7f2b44154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.907+0000 7f2b49e00640 1 -- 172.21.15.70:0/4241270659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b4406b630 msgr2=0x7f2b440a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:56.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.907+0000 7f2b49e00640 1 --2- 172.21.15.70:0/4241270659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b4406b630 0x7f2b440a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.907+0000 7f2b49e00640 1 -- 172.21.15.70:0/4241270659 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b300094d0 con 0x7f2b44156f30 2024-09-13T16:01:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.907+0000 7f2b48a00640 1 --2- 172.21.15.70:0/4241270659 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b440b1db0 0x7f2b44154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.907+0000 7f2b49400640 1 --2- 172.21.15.70:0/4241270659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b4406b630 0x7f2b440a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.907+0000 7f2b49e00640 1 --2- 172.21.15.70:0/4241270659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b44156f30 0x7f2b440ad090 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00b970 tx=0x7f2b3c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.908+0000 7f2b41600640 1 -- 172.21.15.70:0/4241270659 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c00cb40 con 0x7f2b44156f30 2024-09-13T16:01:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.908+0000 7f2b41600640 1 -- 172.21.15.70:0/4241270659 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3c00ccc0 con 0x7f2b44156f30 2024-09-13T16:01:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.908+0000 7f2b4a800640 1 -- 172.21.15.70:0/4241270659 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b440a8d20 con 0x7f2b44156f30 2024-09-13T16:01:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.908+0000 7f2b41600640 1 -- 172.21.15.70:0/4241270659 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c014680 con 0x7f2b44156f30 2024-09-13T16:01:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.908+0000 7f2b4a800640 1 -- 172.21.15.70:0/4241270659 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b440a92e0 con 0x7f2b44156f30 2024-09-13T16:01:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.909+0000 7f2b4a800640 1 -- 172.21.15.70:0/4241270659 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4415a460 con 0x7f2b44156f30 2024-09-13T16:01:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.910+0000 7f2b41600640 1 -- 172.21.15.70:0/4241270659 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2b3c01d3b0 con 0x7f2b44156f30 2024-09-13T16:01:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.910+0000 7f2b41600640 1 --2- 172.21.15.70:0/4241270659 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2b2406ac00 0x7f2b2406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.910+0000 7f2b41600640 1 -- 172.21.15.70:0/4241270659 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b3c0892e0 con 0x7f2b44156f30 2024-09-13T16:01:56.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.911+0000 7f2b49400640 1 --2- 172.21.15.70:0/4241270659 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2b2406ac00 0x7f2b2406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:56.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.911+0000 7f2b49400640 1 --2- 172.21.15.70:0/4241270659 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2b2406ac00 0x7f2b2406d0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2b38007fd0 tx=0x7f2b38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:56.914+0000 7f2b41600640 1 -- 172.21.15.70:0/4241270659 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2b3c0544b0 con 0x7f2b44156f30 2024-09-13T16:01:57.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.080+0000 7f2b4a800640 1 -- 172.21.15.70:0/4241270659 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2b44071780 con 0x7f2b44156f30 2024-09-13T16:01:57.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.081+0000 7f2b41600640 1 -- 172.21.15.70:0/4241270659 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2b3c057ad0 con 0x7f2b44156f30 2024-09-13T16:01:57.082 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-13T16:01:57.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.083+0000 7f2b4a800640 1 -- 172.21.15.70:0/4241270659 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2b2406ac00 msgr2=0x7f2b2406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:57.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.083+0000 7f2b4a800640 1 --2- 172.21.15.70:0/4241270659 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2b2406ac00 0x7f2b2406d0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2b38007fd0 tx=0x7f2b38009040 comp rx=0 tx=0).stop 2024-09-13T16:01:57.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.083+0000 7f2b4a800640 1 -- 172.21.15.70:0/4241270659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b44156f30 msgr2=0x7f2b440ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:57.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.083+0000 7f2b4a800640 1 --2- 172.21.15.70:0/4241270659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b44156f30 0x7f2b440ad090 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00b970 tx=0x7f2b3c00be30 comp rx=0 tx=0).stop 2024-09-13T16:01:57.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.083+0000 7f2b4a800640 1 -- 172.21.15.70:0/4241270659 shutdown_connections 2024-09-13T16:01:57.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.083+0000 7f2b4a800640 1 --2- 172.21.15.70:0/4241270659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b44156f30 0x7f2b440ad090 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.083+0000 7f2b4a800640 1 --2- 172.21.15.70:0/4241270659 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b440b1db0 0x7f2b44154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.083+0000 7f2b4a800640 1 --2- 172.21.15.70:0/4241270659 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2b2406ac00 0x7f2b2406d0c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.083+0000 7f2b4a800640 1 --2- 172.21.15.70:0/4241270659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b4406b630 0x7f2b440a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.083+0000 7f2b4a800640 1 -- 172.21.15.70:0/4241270659 >> 172.21.15.70:0/4241270659 conn(0x7f2b44069ed0 msgr2=0x7f2b440b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:57.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.083+0000 7f2b4a800640 1 -- 172.21.15.70:0/4241270659 shutdown_connections 2024-09-13T16:01:57.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.083+0000 7f2b4a800640 1 -- 172.21.15.70:0/4241270659 wait complete. 2024-09-13T16:01:57.100 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:01:57.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.254+0000 7f0e89a00640 1 Processor -- start 2024-09-13T16:01:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.254+0000 7f0e89a00640 1 -- start start 2024-09-13T16:01:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.256+0000 7f0e89a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0e84156f60 0x7f0e8415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.256+0000 7f0e89a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0e84071690 0x7f0e840cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.256+0000 7f0e89a00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e8406f5f0 con 0x7f0e840cafa0 2024-09-13T16:01:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.256+0000 7f0e89a00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e8415aa30 con 0x7f0e84071690 2024-09-13T16:01:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.256+0000 7f0e89a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e84070450 con 0x7f0e84156f60 2024-09-13T16:01:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.256+0000 7f0e83400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0e84071690 0x7f0e840cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.256+0000 7f0e7a000640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f0e840cafa0 0x7f0e84070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49666/0 (socket says 172.21.15.70:49666) 2024-09-13T16:01:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.256+0000 7f0e7a000640 1 -- 172.21.15.70:0/1241312910 learned_addr learned my addr 172.21.15.70:0/1241312910 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.256+0000 7f0e82a00640 1 --2- 172.21.15.70:0/1241312910 >> v2:172.21.15.107:3300/0 conn(0x7f0e84156f60 0x7f0e8415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.256+0000 7f0e82000640 1 -- 172.21.15.70:0/1241312910 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306790361 0 0) 0x7f0e8406f5f0 con 0x7f0e840cafa0 2024-09-13T16:01:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.256+0000 7f0e83400640 1 -- 172.21.15.70:0/1241312910 >> v2:172.21.15.107:3300/0 conn(0x7f0e84156f60 msgr2=0x7f0e8415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.256+0000 7f0e83400640 1 --2- 172.21.15.70:0/1241312910 >> v2:172.21.15.107:3300/0 conn(0x7f0e84156f60 0x7f0e8415a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.256+0000 7f0e83400640 1 -- 172.21.15.70:0/1241312910 >> v1:172.21.15.70:6789/0 conn(0x7f0e840cafa0 legacy=0x7f0e84070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.256+0000 7f0e83400640 1 -- 172.21.15.70:0/1241312910 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8406f840 con 0x7f0e84071690 2024-09-13T16:01:57.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.257+0000 7f0e83400640 1 --2- 172.21.15.70:0/1241312910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e84071690 0x7f0e840cc8b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0e840cb560 tx=0x7f0e7c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3a2f04e2e27d49 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:57.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.258+0000 7f0e82000640 1 -- 172.21.15.70:0/1241312910 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c02aea0 con 0x7f0e84071690 2024-09-13T16:01:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.258+0000 7f0e82000640 1 -- 172.21.15.70:0/1241312910 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7c02d050 con 0x7f0e84071690 2024-09-13T16:01:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.258+0000 7f0e82000640 1 -- 172.21.15.70:0/1241312910 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c007960 con 0x7f0e84071690 2024-09-13T16:01:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.258+0000 7f0e89a00640 1 -- 172.21.15.70:0/1241312910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e84071690 msgr2=0x7f0e840cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.258+0000 7f0e89a00640 1 --2- 172.21.15.70:0/1241312910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e84071690 0x7f0e840cc8b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0e840cb560 tx=0x7f0e7c02a680 comp rx=0 tx=0).stop 2024-09-13T16:01:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.258+0000 7f0e89a00640 1 -- 172.21.15.70:0/1241312910 shutdown_connections 2024-09-13T16:01:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.258+0000 7f0e89a00640 1 --2- 172.21.15.70:0/1241312910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e84071690 0x7f0e840cc8b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.258+0000 7f0e89a00640 1 --2- 172.21.15.70:0/1241312910 >> v2:172.21.15.107:3300/0 conn(0x7f0e84156f60 0x7f0e8415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.258+0000 7f0e89a00640 1 -- 172.21.15.70:0/1241312910 >> 172.21.15.70:0/1241312910 conn(0x7f0e840b0580 msgr2=0x7f0e840b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.258+0000 7f0e89a00640 1 -- 172.21.15.70:0/1241312910 shutdown_connections 2024-09-13T16:01:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.258+0000 7f0e89a00640 1 -- 172.21.15.70:0/1241312910 wait complete. 2024-09-13T16:01:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.260+0000 7f0e89a00640 1 Processor -- start 2024-09-13T16:01:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.260+0000 7f0e89a00640 1 -- start start 2024-09-13T16:01:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.261+0000 7f0e89a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e84071690 0x7f0e8414db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.261+0000 7f0e89a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e840cafa0 0x7f0e841462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.261+0000 7f0e89a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e84156f60 0x7f0e8415fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.261+0000 7f0e89a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8414e360 con 0x7f0e84156f60 2024-09-13T16:01:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.261+0000 7f0e89a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8415ecb0 con 0x7f0e840cafa0 2024-09-13T16:01:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.261+0000 7f0e89a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8414e0c0 con 0x7f0e84071690 2024-09-13T16:01:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.261+0000 7f0e83400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e84156f60 0x7f0e8415fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.261+0000 7f0e83400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e84156f60 0x7f0e8415fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44384/0 (socket says 172.21.15.70:44384) 2024-09-13T16:01:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.261+0000 7f0e83400640 1 -- 172.21.15.70:0/2774534720 learned_addr learned my addr 172.21.15.70:0/2774534720 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.261+0000 7f0e82a00640 1 --2- 172.21.15.70:0/2774534720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e84071690 0x7f0e8414db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.261+0000 7f0e7a000640 1 --2- 172.21.15.70:0/2774534720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e840cafa0 0x7f0e841462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.261+0000 7f0e83400640 1 -- 172.21.15.70:0/2774534720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e84071690 msgr2=0x7f0e8414db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.261+0000 7f0e83400640 1 --2- 172.21.15.70:0/2774534720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e84071690 0x7f0e8414db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.261+0000 7f0e83400640 1 -- 172.21.15.70:0/2774534720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e840cafa0 msgr2=0x7f0e841462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.261+0000 7f0e83400640 1 --2- 172.21.15.70:0/2774534720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e840cafa0 0x7f0e841462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.261+0000 7f0e83400640 1 -- 172.21.15.70:0/2774534720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c009a70 con 0x7f0e84156f60 2024-09-13T16:01:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.262+0000 7f0e83400640 1 --2- 172.21.15.70:0/2774534720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e84156f60 0x7f0e8415fa30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c02ac70 tx=0x7f0e7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.262+0000 7f0e7b400640 1 -- 172.21.15.70:0/2774534720 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c03c830 con 0x7f0e84156f60 2024-09-13T16:01:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.262+0000 7f0e7b400640 1 -- 172.21.15.70:0/2774534720 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7c03c990 con 0x7f0e84156f60 2024-09-13T16:01:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.262+0000 7f0e7b400640 1 -- 172.21.15.70:0/2774534720 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c03cd00 con 0x7f0e84156f60 2024-09-13T16:01:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.262+0000 7f0e89a00640 1 -- 172.21.15.70:0/2774534720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e84146800 con 0x7f0e84156f60 2024-09-13T16:01:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.263+0000 7f0e89a00640 1 -- 172.21.15.70:0/2774534720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e8415f230 con 0x7f0e84156f60 2024-09-13T16:01:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.264+0000 7f0e89a00640 1 -- 172.21.15.70:0/2774534720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e8406fde0 con 0x7f0e84156f60 2024-09-13T16:01:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.264+0000 7f0e7b400640 1 -- 172.21.15.70:0/2774534720 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0e7c031400 con 0x7f0e84156f60 2024-09-13T16:01:57.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.265+0000 7f0e7b400640 1 --2- 172.21.15.70:0/2774534720 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0e6006ac00 0x7f0e6006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:57.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.265+0000 7f0e7b400640 1 -- 172.21.15.70:0/2774534720 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e7c0aade0 con 0x7f0e84156f60 2024-09-13T16:01:57.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.265+0000 7f0e82a00640 1 --2- 172.21.15.70:0/2774534720 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0e6006ac00 0x7f0e6006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:57.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.266+0000 7f0e82a00640 1 --2- 172.21.15.70:0/2774534720 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0e6006ac00 0x7f0e6006d0c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0e74009aa0 tx=0x7f0e74009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:57.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.269+0000 7f0e7b400640 1 -- 172.21.15.70:0/2774534720 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0e8406fde0 con 0x7f0e84156f60 2024-09-13T16:01:57.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.438+0000 7f0e89a00640 1 -- 172.21.15.70:0/2774534720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0e8406fde0 con 0x7f0e84156f60 2024-09-13T16:01:57.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.439+0000 7f0e7b400640 1 -- 172.21.15.70:0/2774534720 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0e7c040020 con 0x7f0e84156f60 2024-09-13T16:01:57.441 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-13T16:01:57.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.441+0000 7f0e89a00640 1 -- 172.21.15.70:0/2774534720 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0e6006ac00 msgr2=0x7f0e6006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:57.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.441+0000 7f0e89a00640 1 --2- 172.21.15.70:0/2774534720 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0e6006ac00 0x7f0e6006d0c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0e74009aa0 tx=0x7f0e74009190 comp rx=0 tx=0).stop 2024-09-13T16:01:57.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.441+0000 7f0e89a00640 1 -- 172.21.15.70:0/2774534720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e84156f60 msgr2=0x7f0e8415fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:57.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.441+0000 7f0e89a00640 1 --2- 172.21.15.70:0/2774534720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e84156f60 0x7f0e8415fa30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c02ac70 tx=0x7f0e7c004a40 comp rx=0 tx=0).stop 2024-09-13T16:01:57.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.441+0000 7f0e89a00640 1 -- 172.21.15.70:0/2774534720 shutdown_connections 2024-09-13T16:01:57.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.441+0000 7f0e89a00640 1 --2- 172.21.15.70:0/2774534720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e84156f60 0x7f0e8415fa30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.441+0000 7f0e89a00640 1 --2- 172.21.15.70:0/2774534720 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0e6006ac00 0x7f0e6006d0c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.441+0000 7f0e89a00640 1 --2- 172.21.15.70:0/2774534720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e840cafa0 0x7f0e841462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.441+0000 7f0e89a00640 1 --2- 172.21.15.70:0/2774534720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e84071690 0x7f0e8414db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.441+0000 7f0e89a00640 1 -- 172.21.15.70:0/2774534720 >> 172.21.15.70:0/2774534720 conn(0x7f0e840b0580 msgr2=0x7f0e840b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:57.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.441+0000 7f0e89a00640 1 -- 172.21.15.70:0/2774534720 shutdown_connections 2024-09-13T16:01:57.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.442+0000 7f0e89a00640 1 -- 172.21.15.70:0/2774534720 wait complete. 2024-09-13T16:01:57.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T16:01:57.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.612+0000 7fe3cf000640 1 Processor -- start 2024-09-13T16:01:57.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.612+0000 7fe3cf000640 1 -- start start 2024-09-13T16:01:57.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.613+0000 7fe3cf000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe3c815c270 0x7fe3c8070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:57.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.613+0000 7fe3cf000640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c80b1f00 con 0x7fe3c806c310 2024-09-13T16:01:57.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.613+0000 7fe3cf000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c815c650 con 0x7fe3c806ffb0 2024-09-13T16:01:57.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.613+0000 7fe3cf000640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c80712c0 con 0x7fe3c815c270 2024-09-13T16:01:57.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.614+0000 7fe3c7e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe3c815c270 0x7fe3c8070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:57.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.614+0000 7fe3c7e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe3c815c270 0x7fe3c8070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44388/0 (socket says 172.21.15.70:44388) 2024-09-13T16:01:57.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.614+0000 7fe3cd000640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe3c806c310 0x7fe3c80b2390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49676/0 (socket says 172.21.15.70:49676) 2024-09-13T16:01:57.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.614+0000 7fe3c7e00640 1 -- 172.21.15.70:0/2464065149 learned_addr learned my addr 172.21.15.70:0/2464065149 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:57.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.614+0000 7fe3c7e00640 1 -- 172.21.15.70:0/2464065149 >> v1:172.21.15.107:6789/0 conn(0x7fe3c806ffb0 legacy=0x7fe3c806bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:57.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.614+0000 7fe3c7e00640 1 -- 172.21.15.70:0/2464065149 >> v1:172.21.15.70:6789/0 conn(0x7fe3c806c310 legacy=0x7fe3c80b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:57.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.614+0000 7fe3c7e00640 1 -- 172.21.15.70:0/2464065149 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8070fe0 con 0x7fe3c815c270 2024-09-13T16:01:57.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.615+0000 7fe3c7e00640 1 --2- 172.21.15.70:0/2464065149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3c815c270 0x7fe3c8070950 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009870 tx=0x7fe3b802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db87dc8bfb4004e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:57.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.615+0000 7fe3c6a00640 1 -- 172.21.15.70:0/2464065149 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8032640 con 0x7fe3c815c270 2024-09-13T16:01:57.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.615+0000 7fe3c6a00640 1 -- 172.21.15.70:0/2464065149 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b80327a0 con 0x7fe3c815c270 2024-09-13T16:01:57.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.615+0000 7fe3c6a00640 1 -- 172.21.15.70:0/2464065149 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8032b30 con 0x7fe3c815c270 2024-09-13T16:01:57.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.616+0000 7fe3cf000640 1 -- 172.21.15.70:0/2464065149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3c815c270 msgr2=0x7fe3c8070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:57.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.616+0000 7fe3cf000640 1 --2- 172.21.15.70:0/2464065149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3c815c270 0x7fe3c8070950 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009870 tx=0x7fe3b802a300 comp rx=0 tx=0).stop 2024-09-13T16:01:57.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.616+0000 7fe3cf000640 1 -- 172.21.15.70:0/2464065149 shutdown_connections 2024-09-13T16:01:57.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.616+0000 7fe3cf000640 1 --2- 172.21.15.70:0/2464065149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3c815c270 0x7fe3c8070950 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.616+0000 7fe3cf000640 1 -- 172.21.15.70:0/2464065149 >> 172.21.15.70:0/2464065149 conn(0x7fe3c80b0510 msgr2=0x7fe3c80b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.616+0000 7fe3cf000640 1 -- 172.21.15.70:0/2464065149 shutdown_connections 2024-09-13T16:01:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.616+0000 7fe3cf000640 1 -- 172.21.15.70:0/2464065149 wait complete. 2024-09-13T16:01:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.618+0000 7fe3cf000640 1 Processor -- start 2024-09-13T16:01:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.618+0000 7fe3cf000640 1 -- start start 2024-09-13T16:01:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.618+0000 7fe3cf000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe3c806c310 0x7fe3c8142560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.618+0000 7fe3cf000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3c806ffb0 0x7fe3c815a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.618+0000 7fe3cf000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3c815c270 0x7fe3c8157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.618+0000 7fe3cf000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c814d4c0 con 0x7fe3c815c270 2024-09-13T16:01:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.619+0000 7fe3cf000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c814c8b0 con 0x7fe3c806ffb0 2024-09-13T16:01:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.619+0000 7fe3cf000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c814cb90 con 0x7fe3c806c310 2024-09-13T16:01:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.619+0000 7fe3cd000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3c815c270 0x7fe3c8157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.619+0000 7fe3cd000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3c815c270 0x7fe3c8157400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44390/0 (socket says 172.21.15.70:44390) 2024-09-13T16:01:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.619+0000 7fe3cd000640 1 -- 172.21.15.70:0/2809954260 learned_addr learned my addr 172.21.15.70:0/2809954260 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.619+0000 7fe3c7e00640 1 --2- 172.21.15.70:0/2809954260 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe3c806c310 0x7fe3c8142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.619+0000 7fe3c7400640 1 --2- 172.21.15.70:0/2809954260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3c806ffb0 0x7fe3c815a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.619+0000 7fe3cd000640 1 -- 172.21.15.70:0/2809954260 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe3c806c310 msgr2=0x7fe3c8142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.619+0000 7fe3cd000640 1 --2- 172.21.15.70:0/2809954260 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe3c806c310 0x7fe3c8142560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.619+0000 7fe3cd000640 1 -- 172.21.15.70:0/2809954260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3c806ffb0 msgr2=0x7fe3c815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.619+0000 7fe3cd000640 1 --2- 172.21.15.70:0/2809954260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3c806ffb0 0x7fe3c815a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.619+0000 7fe3cd000640 1 -- 172.21.15.70:0/2809954260 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b80094d0 con 0x7fe3c815c270 2024-09-13T16:01:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.619+0000 7fe3cd000640 1 --2- 172.21.15.70:0/2809954260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3c815c270 0x7fe3c8157400 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000c780 tx=0x7fe3c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.620+0000 7fe3bfe00640 1 -- 172.21.15.70:0/2809954260 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c000ce90 con 0x7fe3c815c270 2024-09-13T16:01:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.620+0000 7fe3bfe00640 1 -- 172.21.15.70:0/2809954260 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c000a640 con 0x7fe3c815c270 2024-09-13T16:01:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.620+0000 7fe3bfe00640 1 -- 172.21.15.70:0/2809954260 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c000a9f0 con 0x7fe3c815c270 2024-09-13T16:01:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.620+0000 7fe3cf000640 1 -- 172.21.15.70:0/2809954260 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c814ce70 con 0x7fe3c815c270 2024-09-13T16:01:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.620+0000 7fe3cf000640 1 -- 172.21.15.70:0/2809954260 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c814c4f0 con 0x7fe3c815c270 2024-09-13T16:01:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.621+0000 7fe3cf000640 1 -- 172.21.15.70:0/2809954260 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c806fd40 con 0x7fe3c815c270 2024-09-13T16:01:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.622+0000 7fe3bfe00640 1 -- 172.21.15.70:0/2809954260 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe3c000ab50 con 0x7fe3c815c270 2024-09-13T16:01:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.622+0000 7fe3bfe00640 1 --2- 172.21.15.70:0/2809954260 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe3a806ac30 0x7fe3a806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.623+0000 7fe3bfe00640 1 -- 172.21.15.70:0/2809954260 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3c0088ab0 con 0x7fe3c815c270 2024-09-13T16:01:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.623+0000 7fe3c7e00640 1 --2- 172.21.15.70:0/2809954260 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe3a806ac30 0x7fe3a806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.623+0000 7fe3c7e00640 1 --2- 172.21.15.70:0/2809954260 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe3a806ac30 0x7fe3a806d0f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8034000 tx=0x7fe3b802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.627+0000 7fe3bfe00640 1 -- 172.21.15.70:0/2809954260 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe3c0053d30 con 0x7fe3c815c270 2024-09-13T16:01:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.806+0000 7fe3cf000640 1 -- 172.21.15.70:0/2809954260 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe3c814d600 con 0x7fe3c815c270 2024-09-13T16:01:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.806+0000 7fe3bfe00640 1 -- 172.21.15.70:0/2809954260 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe3c814d600 con 0x7fe3c815c270 2024-09-13T16:01:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2024-09-13T16:01:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.808+0000 7fe3cf000640 1 -- 172.21.15.70:0/2809954260 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe3a806ac30 msgr2=0x7fe3a806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.808+0000 7fe3cf000640 1 --2- 172.21.15.70:0/2809954260 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe3a806ac30 0x7fe3a806d0f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8034000 tx=0x7fe3b802e000 comp rx=0 tx=0).stop 2024-09-13T16:01:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.808+0000 7fe3cf000640 1 -- 172.21.15.70:0/2809954260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3c815c270 msgr2=0x7fe3c8157400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.808+0000 7fe3cf000640 1 --2- 172.21.15.70:0/2809954260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3c815c270 0x7fe3c8157400 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000c780 tx=0x7fe3c000cc40 comp rx=0 tx=0).stop 2024-09-13T16:01:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.808+0000 7fe3cf000640 1 -- 172.21.15.70:0/2809954260 shutdown_connections 2024-09-13T16:01:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.808+0000 7fe3cf000640 1 --2- 172.21.15.70:0/2809954260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3c815c270 0x7fe3c8157400 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.808+0000 7fe3cf000640 1 --2- 172.21.15.70:0/2809954260 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe3a806ac30 0x7fe3a806d0f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.808+0000 7fe3cf000640 1 --2- 172.21.15.70:0/2809954260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3c806ffb0 0x7fe3c815a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.808+0000 7fe3cf000640 1 --2- 172.21.15.70:0/2809954260 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe3c806c310 0x7fe3c8142560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.808+0000 7fe3cf000640 1 -- 172.21.15.70:0/2809954260 >> 172.21.15.70:0/2809954260 conn(0x7fe3c80b0510 msgr2=0x7fe3c80b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:57.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.808+0000 7fe3cf000640 1 -- 172.21.15.70:0/2809954260 shutdown_connections 2024-09-13T16:01:57.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:57.808+0000 7fe3cf000640 1 -- 172.21.15.70:0/2809954260 wait complete. 2024-09-13T16:01:57.825 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T16:01:57.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:57.825 DEBUG:teuthology.orchestra.run.smithi107:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-13T16:01:57.893 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2024-09-13T16:01:57.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:57.893 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T16:01:57.947 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:01:57.948 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:01:57.984 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:01:57.984 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:01:58.060 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:01:58.060 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:01:58.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:01:58.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.327+0000 7f5da3400640 1 Processor -- start 2024-09-13T16:01:58.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.327+0000 7f5da3400640 1 -- start start 2024-09-13T16:01:58.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.328+0000 7f5da3400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5d9c0b3990 0x7f5d9c159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:58.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.328+0000 7f5da3400640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9c159fc0 con 0x7f5d9c153b20 2024-09-13T16:01:58.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.328+0000 7f5da3400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9c153f00 con 0x7f5d9c06f660 2024-09-13T16:01:58.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.328+0000 7f5da3400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d9c0ce600 con 0x7f5d9c0b3990 2024-09-13T16:01:58.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.329+0000 7f5da0a00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5d9c153b20 0x7f5d9c0b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49680/0 (socket says 172.21.15.70:49680) 2024-09-13T16:01:58.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.329+0000 7f5da0a00640 1 -- 172.21.15.70:0/3754324944 learned_addr learned my addr 172.21.15.70:0/3754324944 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:58.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.329+0000 7f5d93e00640 1 --2- 172.21.15.70:0/3754324944 >> v2:172.21.15.107:3300/0 conn(0x7f5d9c0b3990 0x7f5d9c159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:58.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.329+0000 7f5d9be00640 1 -- 172.21.15.70:0/3754324944 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309215267 0 0) 0x7f5d9c159fc0 con 0x7f5d9c153b20 2024-09-13T16:01:58.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.329+0000 7f5d9be00640 1 -- 172.21.15.70:0/3754324944 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d80003520 con 0x7f5d9c153b20 2024-09-13T16:01:58.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.329+0000 7f5d9be00640 1 -- 172.21.15.70:0/3754324944 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842762833 0 0) 0x7f5d9c153f00 con 0x7f5d9c06f660 2024-09-13T16:01:58.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.329+0000 7f5d9be00640 1 -- 172.21.15.70:0/3754324944 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d9c159fc0 con 0x7f5d9c06f660 2024-09-13T16:01:58.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.329+0000 7f5d93e00640 1 -- 172.21.15.70:0/3754324944 >> v1:172.21.15.107:6789/0 conn(0x7f5d9c06f660 legacy=0x7f5d9c06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:58.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.329+0000 7f5d93e00640 1 -- 172.21.15.70:0/3754324944 >> v1:172.21.15.70:6789/0 conn(0x7f5d9c153b20 legacy=0x7f5d9c0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:58.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.329+0000 7f5d93e00640 1 -- 172.21.15.70:0/3754324944 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c0b1a40 con 0x7f5d9c0b3990 2024-09-13T16:01:58.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.330+0000 7f5d93e00640 1 --2- 172.21.15.70:0/3754324944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d9c0b3990 0x7f5d9c159a80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5d840097a0 tx=0x7f5d8402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c859f57c72a3097d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:58.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.330+0000 7f5d9be00640 1 -- 172.21.15.70:0/3754324944 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84032440 con 0x7f5d9c0b3990 2024-09-13T16:01:58.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.331+0000 7f5d9be00640 1 -- 172.21.15.70:0/3754324944 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d840325a0 con 0x7f5d9c0b3990 2024-09-13T16:01:58.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.331+0000 7f5d9be00640 1 -- 172.21.15.70:0/3754324944 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84032910 con 0x7f5d9c0b3990 2024-09-13T16:01:58.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.331+0000 7f5da3400640 1 -- 172.21.15.70:0/3754324944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d9c0b3990 msgr2=0x7f5d9c159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:58.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.331+0000 7f5da3400640 1 --2- 172.21.15.70:0/3754324944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d9c0b3990 0x7f5d9c159a80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5d840097a0 tx=0x7f5d8402a230 comp rx=0 tx=0).stop 2024-09-13T16:01:58.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.331+0000 7f5da3400640 1 -- 172.21.15.70:0/3754324944 shutdown_connections 2024-09-13T16:01:58.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.331+0000 7f5da3400640 1 --2- 172.21.15.70:0/3754324944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d9c0b3990 0x7f5d9c159a80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:58.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.331+0000 7f5da3400640 1 -- 172.21.15.70:0/3754324944 >> 172.21.15.70:0/3754324944 conn(0x7f5d9c0b0510 msgr2=0x7f5d9c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:58.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.331+0000 7f5da3400640 1 -- 172.21.15.70:0/3754324944 shutdown_connections 2024-09-13T16:01:58.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.331+0000 7f5da3400640 1 -- 172.21.15.70:0/3754324944 wait complete. 2024-09-13T16:01:58.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.333+0000 7f5da3400640 1 Processor -- start 2024-09-13T16:01:58.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.333+0000 7f5da3400640 1 -- start start 2024-09-13T16:01:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.334+0000 7f5da3400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d9c06f660 0x7f5d9c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.334+0000 7f5da3400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d9c0b3990 0x7f5d9c153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.334+0000 7f5da3400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d9c153b20 0x7f5d9c1f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.334+0000 7f5da3400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c15b1e0 con 0x7f5d9c153b20 2024-09-13T16:01:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.334+0000 7f5da3400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c1f31b0 con 0x7f5d9c06f660 2024-09-13T16:01:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.334+0000 7f5da3400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c15c7b0 con 0x7f5d9c0b3990 2024-09-13T16:01:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.334+0000 7f5da1400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d9c153b20 0x7f5d9c1f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.334+0000 7f5da1400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d9c153b20 0x7f5d9c1f2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44404/0 (socket says 172.21.15.70:44404) 2024-09-13T16:01:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.334+0000 7f5da0a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d9c06f660 0x7f5d9c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.334+0000 7f5da1400640 1 -- 172.21.15.70:0/1224960588 learned_addr learned my addr 172.21.15.70:0/1224960588 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.334+0000 7f5d93e00640 1 --2- 172.21.15.70:0/1224960588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d9c0b3990 0x7f5d9c153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.334+0000 7f5da0a00640 1 -- 172.21.15.70:0/1224960588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d9c0b3990 msgr2=0x7f5d9c153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.334+0000 7f5da0a00640 1 --2- 172.21.15.70:0/1224960588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d9c0b3990 0x7f5d9c153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.334+0000 7f5da0a00640 1 -- 172.21.15.70:0/1224960588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d9c153b20 msgr2=0x7f5d9c1f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.334+0000 7f5da0a00640 1 --2- 172.21.15.70:0/1224960588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d9c153b20 0x7f5d9c1f2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.334+0000 7f5da0a00640 1 -- 172.21.15.70:0/1224960588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d84009400 con 0x7f5d9c06f660 2024-09-13T16:01:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.335+0000 7f5da0a00640 1 --2- 172.21.15.70:0/1224960588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d9c06f660 0x7f5d9c15c0b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00c3e0 tx=0x7f5d8c00c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.335+0000 7f5d99600640 1 -- 172.21.15.70:0/1224960588 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c005ce0 con 0x7f5d9c06f660 2024-09-13T16:01:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.335+0000 7f5d99600640 1 -- 172.21.15.70:0/1224960588 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8c005e40 con 0x7f5d9c06f660 2024-09-13T16:01:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.335+0000 7f5d99600640 1 -- 172.21.15.70:0/1224960588 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c0072f0 con 0x7f5d9c06f660 2024-09-13T16:01:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.335+0000 7f5da3400640 1 -- 172.21.15.70:0/1224960588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d9c15ca90 con 0x7f5d9c06f660 2024-09-13T16:01:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.335+0000 7f5da3400640 1 -- 172.21.15.70:0/1224960588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9c15ae00 con 0x7f5d9c06f660 2024-09-13T16:01:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.336+0000 7f5da3400640 1 -- 172.21.15.70:0/1224960588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9c159a80 con 0x7f5d9c06f660 2024-09-13T16:01:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.337+0000 7f5d99600640 1 -- 172.21.15.70:0/1224960588 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5d8c007450 con 0x7f5d9c06f660 2024-09-13T16:01:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.338+0000 7f5d99600640 1 --2- 172.21.15.70:0/1224960588 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5d7806ac00 0x7f5d7806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.338+0000 7f5d99600640 1 -- 172.21.15.70:0/1224960588 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5d8c088ba0 con 0x7f5d9c06f660 2024-09-13T16:01:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.338+0000 7f5d93e00640 1 --2- 172.21.15.70:0/1224960588 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5d7806ac00 0x7f5d7806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:58.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.339+0000 7f5d93e00640 1 --2- 172.21.15.70:0/1224960588 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5d7806ac00 0x7f5d7806d0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5d84034000 tx=0x7f5d8402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:58.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.342+0000 7f5d99600640 1 -- 172.21.15.70:0/1224960588 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5d8c053e20 con 0x7f5d9c06f660 2024-09-13T16:01:58.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.514+0000 7f5da3400640 1 -- 172.21.15.70:0/1224960588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d9c0b3460 con 0x7f5d9c06f660 2024-09-13T16:01:58.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.515+0000 7f5d99600640 1 -- 172.21.15.70:0/1224960588 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16663 (secure 0 0 0) 0x7f5d8c057440 con 0x7f5d9c06f660 2024-09-13T16:01:58.517 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:01:58.517 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:58.132506+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:01:58.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.518+0000 7f5da3400640 1 -- 172.21.15.70:0/1224960588 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5d7806ac00 msgr2=0x7f5d7806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:58.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.518+0000 7f5da3400640 1 --2- 172.21.15.70:0/1224960588 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5d7806ac00 0x7f5d7806d0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5d84034000 tx=0x7f5d8402e000 comp rx=0 tx=0).stop 2024-09-13T16:01:58.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.518+0000 7f5da3400640 1 -- 172.21.15.70:0/1224960588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d9c06f660 msgr2=0x7f5d9c15c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:58.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.518+0000 7f5da3400640 1 --2- 172.21.15.70:0/1224960588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d9c06f660 0x7f5d9c15c0b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00c3e0 tx=0x7f5d8c00c8a0 comp rx=0 tx=0).stop 2024-09-13T16:01:58.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.518+0000 7f5da3400640 1 -- 172.21.15.70:0/1224960588 shutdown_connections 2024-09-13T16:01:58.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.518+0000 7f5da3400640 1 --2- 172.21.15.70:0/1224960588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d9c153b20 0x7f5d9c1f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:58.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.518+0000 7f5da3400640 1 --2- 172.21.15.70:0/1224960588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d9c0b3990 0x7f5d9c153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:58.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.518+0000 7f5da3400640 1 --2- 172.21.15.70:0/1224960588 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f5d7806ac00 0x7f5d7806d0c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:58.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.518+0000 7f5da3400640 1 --2- 172.21.15.70:0/1224960588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d9c06f660 0x7f5d9c15c0b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:58.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.518+0000 7f5da3400640 1 -- 172.21.15.70:0/1224960588 >> 172.21.15.70:0/1224960588 conn(0x7f5d9c0b0510 msgr2=0x7f5d9c15d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:58.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.518+0000 7f5da3400640 1 -- 172.21.15.70:0/1224960588 shutdown_connections 2024-09-13T16:01:58.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.518+0000 7f5da3400640 1 -- 172.21.15.70:0/1224960588 wait complete. 2024-09-13T16:01:58.536 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:01:06.070694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:01:16.922043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:01:17.580304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:01:58.536 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:01:58.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.695+0000 7f2123400640 1 Processor -- start 2024-09-13T16:01:58.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.695+0000 7f2123400640 1 -- start start 2024-09-13T16:01:58.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.696+0000 7f2123400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f211c0ae060 0x7f211c15c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:58.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.696+0000 7f2123400640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c06fce0 con 0x7f211c1566f0 2024-09-13T16:01:58.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.696+0000 7f2123400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c06c550 con 0x7f211c070170 2024-09-13T16:01:58.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.696+0000 7f2123400640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211c06c820 con 0x7f211c0ae060 2024-09-13T16:01:58.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.696+0000 7f2120a00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f211c1566f0 0x7f211c06be40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49686/0 (socket says 172.21.15.70:49686) 2024-09-13T16:01:58.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.696+0000 7f2120a00640 1 -- 172.21.15.70:0/1274919120 learned_addr learned my addr 172.21.15.70:0/1274919120 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:58.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.696+0000 7f2121400640 1 --2- 172.21.15.70:0/1274919120 >> v2:172.21.15.70:3300/0 conn(0x7f211c0ae060 0x7f211c15c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:58.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.697+0000 7f211b400640 1 -- 172.21.15.70:0/1274919120 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391832734 0 0) 0x7f211c06fce0 con 0x7f211c1566f0 2024-09-13T16:01:58.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.697+0000 7f211b400640 1 -- 172.21.15.70:0/1274919120 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2104003440 con 0x7f211c1566f0 2024-09-13T16:01:58.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.697+0000 7f2121400640 1 -- 172.21.15.70:0/1274919120 >> v1:172.21.15.107:6789/0 conn(0x7f211c070170 legacy=0x7f211c0ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:58.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.697+0000 7f2121400640 1 -- 172.21.15.70:0/1274919120 >> v1:172.21.15.70:6789/0 conn(0x7f211c1566f0 legacy=0x7f211c06be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:58.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.697+0000 7f2121400640 1 -- 172.21.15.70:0/1274919120 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c06f690 con 0x7f211c0ae060 2024-09-13T16:01:58.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.698+0000 7f2121400640 1 --2- 172.21.15.70:0/1274919120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f211c0ae060 0x7f211c15c800 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2114009d90 tx=0x7f211402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7d69539d29f367 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:58.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.698+0000 7f211b400640 1 -- 172.21.15.70:0/1274919120 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114007740 con 0x7f211c0ae060 2024-09-13T16:01:58.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.698+0000 7f211b400640 1 -- 172.21.15.70:0/1274919120 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211402d050 con 0x7f211c0ae060 2024-09-13T16:01:58.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.698+0000 7f211b400640 1 -- 172.21.15.70:0/1274919120 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114007aa0 con 0x7f211c0ae060 2024-09-13T16:01:58.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.699+0000 7f2123400640 1 -- 172.21.15.70:0/1274919120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f211c0ae060 msgr2=0x7f211c15c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:58.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.699+0000 7f2123400640 1 --2- 172.21.15.70:0/1274919120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f211c0ae060 0x7f211c15c800 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2114009d90 tx=0x7f211402a6f0 comp rx=0 tx=0).stop 2024-09-13T16:01:58.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.699+0000 7f2123400640 1 -- 172.21.15.70:0/1274919120 shutdown_connections 2024-09-13T16:01:58.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.699+0000 7f2123400640 1 --2- 172.21.15.70:0/1274919120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f211c0ae060 0x7f211c15c800 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:58.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.699+0000 7f2123400640 1 -- 172.21.15.70:0/1274919120 >> 172.21.15.70:0/1274919120 conn(0x7f211c0b0580 msgr2=0x7f211c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:58.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.699+0000 7f2123400640 1 -- 172.21.15.70:0/1274919120 shutdown_connections 2024-09-13T16:01:58.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.699+0000 7f2123400640 1 -- 172.21.15.70:0/1274919120 wait complete. 2024-09-13T16:01:58.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.700+0000 7f2123400640 1 Processor -- start 2024-09-13T16:01:58.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.701+0000 7f2123400640 1 -- start start 2024-09-13T16:01:58.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.701+0000 7f2123400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f211c070170 0x7f211c13c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:58.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.701+0000 7f2123400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f211c0ae060 0x7f211c15a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:58.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.701+0000 7f2123400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f211c1566f0 0x7f211c14d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:58.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.701+0000 7f2123400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c15b7d0 con 0x7f211c070170 2024-09-13T16:01:58.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.701+0000 7f2123400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c15bc60 con 0x7f211c0ae060 2024-09-13T16:01:58.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.701+0000 7f2123400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c15abc0 con 0x7f211c1566f0 2024-09-13T16:01:58.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.702+0000 7f2120a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f211c070170 0x7f211c13c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:58.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.702+0000 7f2120a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f211c070170 0x7f211c13c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44432/0 (socket says 172.21.15.70:44432) 2024-09-13T16:01:58.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.702+0000 7f2120a00640 1 -- 172.21.15.70:0/4094341431 learned_addr learned my addr 172.21.15.70:0/4094341431 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:58.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.702+0000 7f211be00640 1 --2- 172.21.15.70:0/4094341431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f211c0ae060 0x7f211c15a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:58.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.702+0000 7f2121400640 1 --2- 172.21.15.70:0/4094341431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f211c1566f0 0x7f211c14d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:58.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.702+0000 7f2120a00640 1 -- 172.21.15.70:0/4094341431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f211c1566f0 msgr2=0x7f211c14d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:58.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.702+0000 7f2120a00640 1 --2- 172.21.15.70:0/4094341431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f211c1566f0 0x7f211c14d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:58.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.702+0000 7f2120a00640 1 -- 172.21.15.70:0/4094341431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f211c0ae060 msgr2=0x7f211c15a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:58.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.702+0000 7f2120a00640 1 --2- 172.21.15.70:0/4094341431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f211c0ae060 0x7f211c15a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:58.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.702+0000 7f2120a00640 1 -- 172.21.15.70:0/4094341431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2114009a70 con 0x7f211c070170 2024-09-13T16:01:58.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.702+0000 7f211be00640 1 --2- 172.21.15.70:0/4094341431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f211c0ae060 0x7f211c15a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:58.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.702+0000 7f2120a00640 1 --2- 172.21.15.70:0/4094341431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f211c070170 0x7f211c13c220 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f211000c410 tx=0x7f211000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:58.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.703+0000 7f2118c00640 1 -- 172.21.15.70:0/4094341431 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2110005ce0 con 0x7f211c070170 2024-09-13T16:01:58.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.703+0000 7f2118c00640 1 -- 172.21.15.70:0/4094341431 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2110005e40 con 0x7f211c070170 2024-09-13T16:01:58.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.703+0000 7f2118c00640 1 -- 172.21.15.70:0/4094341431 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21100072f0 con 0x7f211c070170 2024-09-13T16:01:58.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.703+0000 7f2123400640 1 -- 172.21.15.70:0/4094341431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211c15aea0 con 0x7f211c070170 2024-09-13T16:01:58.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.703+0000 7f2123400640 1 -- 172.21.15.70:0/4094341431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211c15b460 con 0x7f211c070170 2024-09-13T16:01:58.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.704+0000 7f2123400640 1 -- 172.21.15.70:0/4094341431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211c15b5f0 con 0x7f211c070170 2024-09-13T16:01:58.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.705+0000 7f2118c00640 1 -- 172.21.15.70:0/4094341431 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2110007450 con 0x7f211c070170 2024-09-13T16:01:58.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.706+0000 7f2118c00640 1 --2- 172.21.15.70:0/4094341431 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f20fc06ac30 0x7f20fc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:58.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.706+0000 7f2118c00640 1 -- 172.21.15.70:0/4094341431 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2110088aa0 con 0x7f211c070170 2024-09-13T16:01:58.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.706+0000 7f211be00640 1 --2- 172.21.15.70:0/4094341431 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f20fc06ac30 0x7f20fc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:58.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.706+0000 7f211be00640 1 --2- 172.21.15.70:0/4094341431 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f20fc06ac30 0x7f20fc06d0f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f211c1f1190 tx=0x7f2108009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:58.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.710+0000 7f2118c00640 1 -- 172.21.15.70:0/4094341431 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f21100576b0 con 0x7f211c070170 2024-09-13T16:01:58.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.876+0000 7f2123400640 1 -- 172.21.15.70:0/4094341431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f211c0b34b0 con 0x7f211c070170 2024-09-13T16:01:58.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.876+0000 7f2118c00640 1 -- 172.21.15.70:0/4094341431 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21100170a0 con 0x7f211c070170 2024-09-13T16:01:58.878 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-13T16:01:58.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.878+0000 7f2123400640 1 -- 172.21.15.70:0/4094341431 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f20fc06ac30 msgr2=0x7f20fc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:58.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.878+0000 7f2123400640 1 --2- 172.21.15.70:0/4094341431 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f20fc06ac30 0x7f20fc06d0f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f211c1f1190 tx=0x7f2108009040 comp rx=0 tx=0).stop 2024-09-13T16:01:58.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.878+0000 7f2123400640 1 -- 172.21.15.70:0/4094341431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f211c070170 msgr2=0x7f211c13c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:58.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.878+0000 7f2123400640 1 --2- 172.21.15.70:0/4094341431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f211c070170 0x7f211c13c220 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f211000c410 tx=0x7f211000c8d0 comp rx=0 tx=0).stop 2024-09-13T16:01:58.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.879+0000 7f2123400640 1 -- 172.21.15.70:0/4094341431 shutdown_connections 2024-09-13T16:01:58.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.879+0000 7f2123400640 1 --2- 172.21.15.70:0/4094341431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f211c1566f0 0x7f211c14d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:58.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.879+0000 7f2123400640 1 --2- 172.21.15.70:0/4094341431 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f20fc06ac30 0x7f20fc06d0f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:58.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.879+0000 7f2123400640 1 --2- 172.21.15.70:0/4094341431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f211c0ae060 0x7f211c15a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:58.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.879+0000 7f2123400640 1 --2- 172.21.15.70:0/4094341431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f211c070170 0x7f211c13c220 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:58.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.879+0000 7f2123400640 1 -- 172.21.15.70:0/4094341431 >> 172.21.15.70:0/4094341431 conn(0x7f211c0b0580 msgr2=0x7f211c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:58.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.879+0000 7f2123400640 1 -- 172.21.15.70:0/4094341431 shutdown_connections 2024-09-13T16:01:58.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:58.879+0000 7f2123400640 1 -- 172.21.15.70:0/4094341431 wait complete. 2024-09-13T16:01:58.895 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:01:59.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.050+0000 7fac83400640 1 Processor -- start 2024-09-13T16:01:59.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.050+0000 7fac83400640 1 -- start start 2024-09-13T16:01:59.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.051+0000 7fac83400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fac7c1566f0 0x7fac7c070170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:59.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.051+0000 7fac83400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fac7c0ae060 0x7fac7c15c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:59.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.051+0000 7fac83400640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7c06fce0 con 0x7fac7c06be40 2024-09-13T16:01:59.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.051+0000 7fac83400640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac7c06c820 con 0x7fac7c0ae060 2024-09-13T16:01:59.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.051+0000 7fac83400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac7c06f690 con 0x7fac7c1566f0 2024-09-13T16:01:59.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.051+0000 7fac81400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fac7c0ae060 0x7fac7c15c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:59.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.051+0000 7fac7be00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fac7c06be40 0x7fac7c0ad950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49702/0 (socket says 172.21.15.70:49702) 2024-09-13T16:01:59.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.051+0000 7fac7be00640 1 -- 172.21.15.70:0/3226463661 learned_addr learned my addr 172.21.15.70:0/3226463661 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:01:59.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.051+0000 7fac81400640 1 --2- 172.21.15.70:0/3226463661 >> v2:172.21.15.70:3300/0 conn(0x7fac7c0ae060 0x7fac7c15c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44442/0 (socket says 172.21.15.70:44442) 2024-09-13T16:01:59.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.051+0000 7fac80a00640 1 --2- 172.21.15.70:0/3226463661 >> v2:172.21.15.107:3300/0 conn(0x7fac7c1566f0 0x7fac7c070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:59.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.052+0000 7fac81400640 1 -- 172.21.15.70:0/3226463661 >> v2:172.21.15.107:3300/0 conn(0x7fac7c1566f0 msgr2=0x7fac7c070170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:59.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.052+0000 7fac81400640 1 --2- 172.21.15.70:0/3226463661 >> v2:172.21.15.107:3300/0 conn(0x7fac7c1566f0 0x7fac7c070170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.052+0000 7fac81400640 1 -- 172.21.15.70:0/3226463661 >> v1:172.21.15.70:6789/0 conn(0x7fac7c06be40 legacy=0x7fac7c0ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:59.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.052+0000 7fac81400640 1 -- 172.21.15.70:0/3226463661 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c06f970 con 0x7fac7c0ae060 2024-09-13T16:01:59.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.053+0000 7fac81400640 1 --2- 172.21.15.70:0/3226463661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac7c0ae060 0x7fac7c15c800 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0677f0 tx=0x7fac7402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586f47da01f0b453 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:59.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.053+0000 7fac7b400640 1 -- 172.21.15.70:0/3226463661 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7402aea0 con 0x7fac7c0ae060 2024-09-13T16:01:59.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.053+0000 7fac7b400640 1 -- 172.21.15.70:0/3226463661 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7402d050 con 0x7fac7c0ae060 2024-09-13T16:01:59.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.053+0000 7fac7b400640 1 -- 172.21.15.70:0/3226463661 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac74007960 con 0x7fac7c0ae060 2024-09-13T16:01:59.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.054+0000 7fac83400640 1 -- 172.21.15.70:0/3226463661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac7c0ae060 msgr2=0x7fac7c15c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:59.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.054+0000 7fac83400640 1 --2- 172.21.15.70:0/3226463661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac7c0ae060 0x7fac7c15c800 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0677f0 tx=0x7fac7402a680 comp rx=0 tx=0).stop 2024-09-13T16:01:59.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.054+0000 7fac83400640 1 -- 172.21.15.70:0/3226463661 shutdown_connections 2024-09-13T16:01:59.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.054+0000 7fac83400640 1 --2- 172.21.15.70:0/3226463661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac7c0ae060 0x7fac7c15c800 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.054+0000 7fac83400640 1 --2- 172.21.15.70:0/3226463661 >> v2:172.21.15.107:3300/0 conn(0x7fac7c1566f0 0x7fac7c070170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.054+0000 7fac83400640 1 -- 172.21.15.70:0/3226463661 >> 172.21.15.70:0/3226463661 conn(0x7fac7c0b0580 msgr2=0x7fac7c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:59.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.054+0000 7fac83400640 1 -- 172.21.15.70:0/3226463661 shutdown_connections 2024-09-13T16:01:59.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.054+0000 7fac83400640 1 -- 172.21.15.70:0/3226463661 wait complete. 2024-09-13T16:01:59.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.055+0000 7fac83400640 1 Processor -- start 2024-09-13T16:01:59.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.056+0000 7fac83400640 1 -- start start 2024-09-13T16:01:59.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.056+0000 7fac83400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac7c06be40 0x7fac7c14c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:59.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.056+0000 7fac83400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac7c0ae060 0x7fac7c14a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:59.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.056+0000 7fac83400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac7c1566f0 0x7fac7c1590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:59.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.056+0000 7fac83400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c141c90 con 0x7fac7c1566f0 2024-09-13T16:01:59.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.056+0000 7fac83400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c14aa20 con 0x7fac7c06be40 2024-09-13T16:01:59.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.056+0000 7fac83400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c14ad00 con 0x7fac7c0ae060 2024-09-13T16:01:59.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.057+0000 7fac81400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac7c1566f0 0x7fac7c1590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:59.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.057+0000 7fac81400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac7c1566f0 0x7fac7c1590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44454/0 (socket says 172.21.15.70:44454) 2024-09-13T16:01:59.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.057+0000 7fac81400640 1 -- 172.21.15.70:0/1467637492 learned_addr learned my addr 172.21.15.70:0/1467637492 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:59.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.057+0000 7fac7be00640 1 --2- 172.21.15.70:0/1467637492 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac7c0ae060 0x7fac7c14a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:59.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.057+0000 7fac80a00640 1 --2- 172.21.15.70:0/1467637492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac7c06be40 0x7fac7c14c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:59.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.057+0000 7fac81400640 1 -- 172.21.15.70:0/1467637492 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac7c0ae060 msgr2=0x7fac7c14a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:59.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.057+0000 7fac81400640 1 --2- 172.21.15.70:0/1467637492 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac7c0ae060 0x7fac7c14a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.057+0000 7fac81400640 1 -- 172.21.15.70:0/1467637492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac7c06be40 msgr2=0x7fac7c14c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:59.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.057+0000 7fac81400640 1 --2- 172.21.15.70:0/1467637492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac7c06be40 0x7fac7c14c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.057+0000 7fac81400640 1 -- 172.21.15.70:0/1467637492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac74009a70 con 0x7fac7c1566f0 2024-09-13T16:01:59.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.057+0000 7fac81400640 1 --2- 172.21.15.70:0/1467637492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac7c1566f0 0x7fac7c1590a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fac7402ac70 tx=0x7fac74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:59.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.058+0000 7fac78c00640 1 -- 172.21.15.70:0/1467637492 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7403c830 con 0x7fac7c1566f0 2024-09-13T16:01:59.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.058+0000 7fac78c00640 1 -- 172.21.15.70:0/1467637492 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7403c990 con 0x7fac7c1566f0 2024-09-13T16:01:59.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.058+0000 7fac78c00640 1 -- 172.21.15.70:0/1467637492 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7403cd00 con 0x7fac7c1566f0 2024-09-13T16:01:59.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.058+0000 7fac83400640 1 -- 172.21.15.70:0/1467637492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac7c15a3d0 con 0x7fac7c1566f0 2024-09-13T16:01:59.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.058+0000 7fac83400640 1 -- 172.21.15.70:0/1467637492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7c15a990 con 0x7fac7c1566f0 2024-09-13T16:01:59.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.059+0000 7fac83400640 1 -- 172.21.15.70:0/1467637492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac7c15ab70 con 0x7fac7c1566f0 2024-09-13T16:01:59.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.060+0000 7fac78c00640 1 -- 172.21.15.70:0/1467637492 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fac74031400 con 0x7fac7c1566f0 2024-09-13T16:01:59.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.060+0000 7fac78c00640 1 --2- 172.21.15.70:0/1467637492 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fac5c06ac00 0x7fac5c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:59.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.061+0000 7fac78c00640 1 -- 172.21.15.70:0/1467637492 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fac740aaf80 con 0x7fac7c1566f0 2024-09-13T16:01:59.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.061+0000 7fac80a00640 1 --2- 172.21.15.70:0/1467637492 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fac5c06ac00 0x7fac5c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:59.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.061+0000 7fac80a00640 1 --2- 172.21.15.70:0/1467637492 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fac5c06ac00 0x7fac5c06d0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fac70009a30 tx=0x7fac70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:59.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.065+0000 7fac78c00640 1 -- 172.21.15.70:0/1467637492 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fac74076050 con 0x7fac7c1566f0 2024-09-13T16:01:59.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.238+0000 7fac83400640 1 -- 172.21.15.70:0/1467637492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fac7c06c2d0 con 0x7fac7c1566f0 2024-09-13T16:01:59.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.238+0000 7fac78c00640 1 -- 172.21.15.70:0/1467637492 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fac7403ce60 con 0x7fac7c1566f0 2024-09-13T16:01:59.240 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-13T16:01:59.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.240+0000 7fac83400640 1 -- 172.21.15.70:0/1467637492 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fac5c06ac00 msgr2=0x7fac5c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:59.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.240+0000 7fac83400640 1 --2- 172.21.15.70:0/1467637492 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fac5c06ac00 0x7fac5c06d0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fac70009a30 tx=0x7fac70008040 comp rx=0 tx=0).stop 2024-09-13T16:01:59.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.240+0000 7fac83400640 1 -- 172.21.15.70:0/1467637492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac7c1566f0 msgr2=0x7fac7c1590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:59.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.240+0000 7fac83400640 1 --2- 172.21.15.70:0/1467637492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac7c1566f0 0x7fac7c1590a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fac7402ac70 tx=0x7fac74004a40 comp rx=0 tx=0).stop 2024-09-13T16:01:59.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.240+0000 7fac83400640 1 -- 172.21.15.70:0/1467637492 shutdown_connections 2024-09-13T16:01:59.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.240+0000 7fac83400640 1 --2- 172.21.15.70:0/1467637492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac7c1566f0 0x7fac7c1590a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.240+0000 7fac83400640 1 --2- 172.21.15.70:0/1467637492 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fac7c0ae060 0x7fac7c14a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.240+0000 7fac83400640 1 --2- 172.21.15.70:0/1467637492 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fac5c06ac00 0x7fac5c06d0c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.240+0000 7fac83400640 1 --2- 172.21.15.70:0/1467637492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac7c06be40 0x7fac7c14c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.241+0000 7fac83400640 1 -- 172.21.15.70:0/1467637492 >> 172.21.15.70:0/1467637492 conn(0x7fac7c0b0580 msgr2=0x7fac7c070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:59.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.241+0000 7fac83400640 1 -- 172.21.15.70:0/1467637492 shutdown_connections 2024-09-13T16:01:59.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.241+0000 7fac83400640 1 -- 172.21.15.70:0/1467637492 wait complete. 2024-09-13T16:01:59.257 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:01:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.413+0000 7f654a600640 1 Processor -- start 2024-09-13T16:01:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.414+0000 7f654a600640 1 -- start start 2024-09-13T16:01:59.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.415+0000 7f654a600640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6544156f30 0x7f654415a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:59.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.415+0000 7f654a600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f654406b630 0x7f65440b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:59.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.415+0000 7f654a600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65440b2030 con 0x7f65440b1be0 2024-09-13T16:01:59.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.415+0000 7f654a600640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6544157310 con 0x7f6544156f30 2024-09-13T16:01:59.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.415+0000 7f654a600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65440b29c0 con 0x7f654406b630 2024-09-13T16:01:59.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.415+0000 7f6549200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6544156f30 0x7f654415a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:59.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.415+0000 7f6549200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6544156f30 0x7f654415a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44456/0 (socket says 172.21.15.70:44456) 2024-09-13T16:01:59.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.415+0000 7f6549200640 1 -- 172.21.15.70:0/3630145763 learned_addr learned my addr 172.21.15.70:0/3630145763 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:59.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.415+0000 7f6543e00640 1 --2- 172.21.15.70:0/3630145763 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f654406b630 0x7f65440b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:59.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.416+0000 7f6549200640 1 -- 172.21.15.70:0/3630145763 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f654406b630 msgr2=0x7f65440b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:59.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.416+0000 7f6549200640 1 --2- 172.21.15.70:0/3630145763 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f654406b630 0x7f65440b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.416+0000 7f6549200640 1 -- 172.21.15.70:0/3630145763 >> v1:172.21.15.107:6789/0 conn(0x7f65440b1be0 legacy=0x7f654415ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:59.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.416+0000 7f6549200640 1 -- 172.21.15.70:0/3630145763 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65440b2ca0 con 0x7f6544156f30 2024-09-13T16:01:59.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.417+0000 7f6549200640 1 --2- 172.21.15.70:0/3630145763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6544156f30 0x7f654415a460 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f653400bb10 tx=0x7f653402c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60fac19259b522a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.417+0000 7f6543400640 1 -- 172.21.15.70:0/3630145763 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534032820 con 0x7f6544156f30 2024-09-13T16:01:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.417+0000 7f6543400640 1 -- 172.21.15.70:0/3630145763 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653402e040 con 0x7f6544156f30 2024-09-13T16:01:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.417+0000 7f6543400640 1 -- 172.21.15.70:0/3630145763 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534032ba0 con 0x7f6544156f30 2024-09-13T16:01:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.417+0000 7f654a600640 1 -- 172.21.15.70:0/3630145763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6544156f30 msgr2=0x7f654415a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.417+0000 7f654a600640 1 --2- 172.21.15.70:0/3630145763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6544156f30 0x7f654415a460 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f653400bb10 tx=0x7f653402c920 comp rx=0 tx=0).stop 2024-09-13T16:01:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.417+0000 7f654a600640 1 -- 172.21.15.70:0/3630145763 shutdown_connections 2024-09-13T16:01:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.417+0000 7f654a600640 1 --2- 172.21.15.70:0/3630145763 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f654406b630 0x7f65440b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.417+0000 7f654a600640 1 --2- 172.21.15.70:0/3630145763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6544156f30 0x7f654415a460 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.418+0000 7f654a600640 1 -- 172.21.15.70:0/3630145763 >> 172.21.15.70:0/3630145763 conn(0x7f6544069ed0 msgr2=0x7f654406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.418+0000 7f654a600640 1 -- 172.21.15.70:0/3630145763 shutdown_connections 2024-09-13T16:01:59.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.418+0000 7f654a600640 1 -- 172.21.15.70:0/3630145763 wait complete. 2024-09-13T16:01:59.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.419+0000 7f654a600640 1 Processor -- start 2024-09-13T16:01:59.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.419+0000 7f654a600640 1 -- start start 2024-09-13T16:01:59.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.420+0000 7f654a600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f654406b630 0x7f654414d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:59.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.420+0000 7f654a600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65440b1be0 0x7f6544153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:59.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.420+0000 7f654a600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6544156f30 0x7f6544153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:59.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.420+0000 7f654a600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654415db60 con 0x7f65440b1be0 2024-09-13T16:01:59.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.420+0000 7f654a600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65440ae520 con 0x7f654406b630 2024-09-13T16:01:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.420+0000 7f654a600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654415d2c0 con 0x7f6544156f30 2024-09-13T16:01:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.420+0000 7f6543e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65440b1be0 0x7f6544153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.420+0000 7f6543e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65440b1be0 0x7f6544153240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44462/0 (socket says 172.21.15.70:44462) 2024-09-13T16:01:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.420+0000 7f6543e00640 1 -- 172.21.15.70:0/3912086322 learned_addr learned my addr 172.21.15.70:0/3912086322 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.421+0000 7f6549200640 1 --2- 172.21.15.70:0/3912086322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f654406b630 0x7f654414d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.421+0000 7f6549c00640 1 --2- 172.21.15.70:0/3912086322 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6544156f30 0x7f6544153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.421+0000 7f6543e00640 1 -- 172.21.15.70:0/3912086322 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6544156f30 msgr2=0x7f6544153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.421+0000 7f6543e00640 1 --2- 172.21.15.70:0/3912086322 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6544156f30 0x7f6544153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.421+0000 7f6543e00640 1 -- 172.21.15.70:0/3912086322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f654406b630 msgr2=0x7f654414d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.421+0000 7f6543e00640 1 --2- 172.21.15.70:0/3912086322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f654406b630 0x7f654414d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.421+0000 7f6543e00640 1 -- 172.21.15.70:0/3912086322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653400b770 con 0x7f65440b1be0 2024-09-13T16:01:59.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.421+0000 7f6543e00640 1 --2- 172.21.15.70:0/3912086322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65440b1be0 0x7f6544153240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f653000e9b0 tx=0x7f653000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:59.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.421+0000 7f6540c00640 1 -- 172.21.15.70:0/3912086322 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6530009670 con 0x7f65440b1be0 2024-09-13T16:01:59.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.421+0000 7f6540c00640 1 -- 172.21.15.70:0/3912086322 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653000c9a0 con 0x7f65440b1be0 2024-09-13T16:01:59.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.421+0000 7f6540c00640 1 -- 172.21.15.70:0/3912086322 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653000cd50 con 0x7f65440b1be0 2024-09-13T16:01:59.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.421+0000 7f654a600640 1 -- 172.21.15.70:0/3912086322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654415d5a0 con 0x7f65440b1be0 2024-09-13T16:01:59.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.422+0000 7f654a600640 1 -- 172.21.15.70:0/3912086322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654414b130 con 0x7f65440b1be0 2024-09-13T16:01:59.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.423+0000 7f654a600640 1 -- 172.21.15.70:0/3912086322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65440ae2f0 con 0x7f65440b1be0 2024-09-13T16:01:59.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.424+0000 7f6540c00640 1 -- 172.21.15.70:0/3912086322 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6530013470 con 0x7f65440b1be0 2024-09-13T16:01:59.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.425+0000 7f6540c00640 1 --2- 172.21.15.70:0/3912086322 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f652406ac30 0x7f652406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:59.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.425+0000 7f6540c00640 1 -- 172.21.15.70:0/3912086322 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f65300895b0 con 0x7f65440b1be0 2024-09-13T16:01:59.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.425+0000 7f6549200640 1 --2- 172.21.15.70:0/3912086322 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f652406ac30 0x7f652406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:59.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.426+0000 7f6549200640 1 --2- 172.21.15.70:0/3912086322 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f652406ac30 0x7f652406d0f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6534037000 tx=0x7f6534032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:59.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.429+0000 7f6540c00640 1 -- 172.21.15.70:0/3912086322 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f65440ae2f0 con 0x7f65440b1be0 2024-09-13T16:01:59.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.604+0000 7f654a600640 1 -- 172.21.15.70:0/3912086322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f65440ae2f0 con 0x7f65440b1be0 2024-09-13T16:01:59.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.604+0000 7f6540c00640 1 -- 172.21.15.70:0/3912086322 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f65440ae2f0 con 0x7f65440b1be0 2024-09-13T16:01:59.606 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-13T16:01:59.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.606+0000 7f654a600640 1 -- 172.21.15.70:0/3912086322 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f652406ac30 msgr2=0x7f652406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:59.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.606+0000 7f654a600640 1 --2- 172.21.15.70:0/3912086322 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f652406ac30 0x7f652406d0f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6534037000 tx=0x7f6534032000 comp rx=0 tx=0).stop 2024-09-13T16:01:59.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.606+0000 7f654a600640 1 -- 172.21.15.70:0/3912086322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65440b1be0 msgr2=0x7f6544153240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:59.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.606+0000 7f654a600640 1 --2- 172.21.15.70:0/3912086322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65440b1be0 0x7f6544153240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f653000e9b0 tx=0x7f653000ee70 comp rx=0 tx=0).stop 2024-09-13T16:01:59.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.606+0000 7f654a600640 1 -- 172.21.15.70:0/3912086322 shutdown_connections 2024-09-13T16:01:59.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.606+0000 7f654a600640 1 --2- 172.21.15.70:0/3912086322 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6544156f30 0x7f6544153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.606+0000 7f654a600640 1 --2- 172.21.15.70:0/3912086322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65440b1be0 0x7f6544153240 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.606+0000 7f654a600640 1 --2- 172.21.15.70:0/3912086322 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f652406ac30 0x7f652406d0f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.606+0000 7f654a600640 1 --2- 172.21.15.70:0/3912086322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f654406b630 0x7f654414d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.606+0000 7f654a600640 1 -- 172.21.15.70:0/3912086322 >> 172.21.15.70:0/3912086322 conn(0x7f6544069ed0 msgr2=0x7f6544070670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:59.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.607+0000 7f654a600640 1 -- 172.21.15.70:0/3912086322 shutdown_connections 2024-09-13T16:01:59.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.607+0000 7f654a600640 1 -- 172.21.15.70:0/3912086322 wait complete. 2024-09-13T16:01:59.624 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T16:01:59.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.775+0000 7f81f4400640 1 Processor -- start 2024-09-13T16:01:59.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.775+0000 7f81f4400640 1 -- start start 2024-09-13T16:01:59.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.776+0000 7f81f4400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f81ec15c270 0x7f81ec070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:59.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.776+0000 7f81f4400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81ec06ffb0 0x7f81ec06bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:59.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.777+0000 7f81f4400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ec0b1f00 con 0x7f81ec06c140 2024-09-13T16:01:59.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.777+0000 7f81f4400640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81ec06c5b0 con 0x7f81ec15c270 2024-09-13T16:01:59.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.777+0000 7f81f4400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec15c650 con 0x7f81ec06ffb0 2024-09-13T16:01:59.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.777+0000 7f81f1a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f81ec15c270 0x7f81ec070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:59.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.777+0000 7f81f1a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f81ec15c270 0x7f81ec070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44478/0 (socket says 172.21.15.70:44478) 2024-09-13T16:01:59.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.777+0000 7f81f1a00640 1 -- 172.21.15.70:0/3545795588 learned_addr learned my addr 172.21.15.70:0/3545795588 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:59.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.777+0000 7f81f1000640 1 --2- 172.21.15.70:0/3545795588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81ec06ffb0 0x7f81ec06bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:59.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.777+0000 7f81f1a00640 1 -- 172.21.15.70:0/3545795588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81ec06ffb0 msgr2=0x7f81ec06bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:59.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.777+0000 7f81f1a00640 1 --2- 172.21.15.70:0/3545795588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81ec06ffb0 0x7f81ec06bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.777+0000 7f81f1a00640 1 -- 172.21.15.70:0/3545795588 >> v1:172.21.15.107:6789/0 conn(0x7f81ec06c140 legacy=0x7f81ec15c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:59.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.777+0000 7f81f1a00640 1 -- 172.21.15.70:0/3545795588 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec0712c0 con 0x7f81ec15c270 2024-09-13T16:01:59.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.778+0000 7f81f1a00640 1 --2- 172.21.15.70:0/3545795588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81ec15c270 0x7f81ec070950 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f81e000aa10 tx=0x7f81e002b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6aafe48edcdc40 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:59.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.779+0000 7f81ebe00640 1 -- 172.21.15.70:0/3545795588 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e0030710 con 0x7f81ec15c270 2024-09-13T16:01:59.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.779+0000 7f81ebe00640 1 -- 172.21.15.70:0/3545795588 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e002e050 con 0x7f81ec15c270 2024-09-13T16:01:59.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.779+0000 7f81ebe00640 1 -- 172.21.15.70:0/3545795588 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e0030a90 con 0x7f81ec15c270 2024-09-13T16:01:59.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.779+0000 7f81f4400640 1 -- 172.21.15.70:0/3545795588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81ec15c270 msgr2=0x7f81ec070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:59.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.779+0000 7f81f4400640 1 --2- 172.21.15.70:0/3545795588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81ec15c270 0x7f81ec070950 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f81e000aa10 tx=0x7f81e002b610 comp rx=0 tx=0).stop 2024-09-13T16:01:59.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.779+0000 7f81f4400640 1 -- 172.21.15.70:0/3545795588 shutdown_connections 2024-09-13T16:01:59.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.779+0000 7f81f4400640 1 --2- 172.21.15.70:0/3545795588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81ec06ffb0 0x7f81ec06bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.779+0000 7f81f4400640 1 --2- 172.21.15.70:0/3545795588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81ec15c270 0x7f81ec070950 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.779+0000 7f81f4400640 1 -- 172.21.15.70:0/3545795588 >> 172.21.15.70:0/3545795588 conn(0x7f81ec0b0510 msgr2=0x7f81ec0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:59.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.779+0000 7f81f4400640 1 -- 172.21.15.70:0/3545795588 shutdown_connections 2024-09-13T16:01:59.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.779+0000 7f81f4400640 1 -- 172.21.15.70:0/3545795588 wait complete. 2024-09-13T16:01:59.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.781+0000 7f81f4400640 1 Processor -- start 2024-09-13T16:01:59.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.781+0000 7f81f4400640 1 -- start start 2024-09-13T16:01:59.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.782+0000 7f81f4400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81ec06c140 0x7f81ec1ef7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:59.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.782+0000 7f81f4400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81ec06ffb0 0x7f81ec152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:59.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.782+0000 7f81f4400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81ec15c270 0x7f81ec152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:59.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.782+0000 7f81f4400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec150730 con 0x7f81ec06ffb0 2024-09-13T16:01:59.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.782+0000 7f81f4400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec150a10 con 0x7f81ec06c140 2024-09-13T16:01:59.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.782+0000 7f81f4400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec150cf0 con 0x7f81ec15c270 2024-09-13T16:01:59.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.782+0000 7f81f1000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81ec06ffb0 0x7f81ec152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:59.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.782+0000 7f81f1000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81ec06ffb0 0x7f81ec152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44494/0 (socket says 172.21.15.70:44494) 2024-09-13T16:01:59.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.782+0000 7f81f1000640 1 -- 172.21.15.70:0/803990953 learned_addr learned my addr 172.21.15.70:0/803990953 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:01:59.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.782+0000 7f81f2400640 1 --2- 172.21.15.70:0/803990953 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81ec15c270 0x7f81ec152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:59.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.782+0000 7f81f1a00640 1 --2- 172.21.15.70:0/803990953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81ec06c140 0x7f81ec1ef7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:59.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.783+0000 7f81f1000640 1 -- 172.21.15.70:0/803990953 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81ec15c270 msgr2=0x7f81ec152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:59.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.783+0000 7f81f1000640 1 --2- 172.21.15.70:0/803990953 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81ec15c270 0x7f81ec152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.783+0000 7f81f1000640 1 -- 172.21.15.70:0/803990953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81ec06c140 msgr2=0x7f81ec1ef7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:59.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.783+0000 7f81f1000640 1 --2- 172.21.15.70:0/803990953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81ec06c140 0x7f81ec1ef7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.783+0000 7f81f1000640 1 -- 172.21.15.70:0/803990953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e000a670 con 0x7f81ec06ffb0 2024-09-13T16:01:59.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.783+0000 7f81f1000640 1 --2- 172.21.15.70:0/803990953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81ec06ffb0 0x7f81ec152300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f81d800d800 tx=0x7f81d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:59.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.783+0000 7f81e9600640 1 -- 172.21.15.70:0/803990953 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d800b6c0 con 0x7f81ec06ffb0 2024-09-13T16:01:59.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.783+0000 7f81e9600640 1 -- 172.21.15.70:0/803990953 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d800b840 con 0x7f81ec06ffb0 2024-09-13T16:01:59.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.783+0000 7f81f4400640 1 -- 172.21.15.70:0/803990953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ec150fd0 con 0x7f81ec06ffb0 2024-09-13T16:01:59.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.783+0000 7f81e9600640 1 -- 172.21.15.70:0/803990953 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d800bbf0 con 0x7f81ec06ffb0 2024-09-13T16:01:59.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.784+0000 7f81f4400640 1 -- 172.21.15.70:0/803990953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81ec1efd20 con 0x7f81ec06ffb0 2024-09-13T16:01:59.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.785+0000 7f81f4400640 1 -- 172.21.15.70:0/803990953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ec070950 con 0x7f81ec06ffb0 2024-09-13T16:01:59.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.785+0000 7f81e9600640 1 -- 172.21.15.70:0/803990953 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f81d800bd50 con 0x7f81ec06ffb0 2024-09-13T16:01:59.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.787+0000 7f81e9600640 1 --2- 172.21.15.70:0/803990953 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f81cc06ac00 0x7f81cc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:59.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.787+0000 7f81e9600640 1 -- 172.21.15.70:0/803990953 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f81d8089930 con 0x7f81ec06ffb0 2024-09-13T16:01:59.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.787+0000 7f81f1a00640 1 --2- 172.21.15.70:0/803990953 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f81cc06ac00 0x7f81cc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:59.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.788+0000 7f81f1a00640 1 --2- 172.21.15.70:0/803990953 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f81cc06ac00 0x7f81cc06d0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f81e0035000 tx=0x7f81e0034040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:59.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.791+0000 7f81e9600640 1 -- 172.21.15.70:0/803990953 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f81d8054aa0 con 0x7f81ec06ffb0 2024-09-13T16:01:59.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.970+0000 7f81f4400640 1 -- 172.21.15.70:0/803990953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f81ec15b6d0 con 0x7f81ec06ffb0 2024-09-13T16:01:59.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.971+0000 7f81e9600640 1 -- 172.21.15.70:0/803990953 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f81d80580c0 con 0x7f81ec06ffb0 2024-09-13T16:01:59.972 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2024-09-13T16:01:59.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.973+0000 7f81f4400640 1 -- 172.21.15.70:0/803990953 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f81cc06ac00 msgr2=0x7f81cc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:59.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.973+0000 7f81f4400640 1 --2- 172.21.15.70:0/803990953 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f81cc06ac00 0x7f81cc06d0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f81e0035000 tx=0x7f81e0034040 comp rx=0 tx=0).stop 2024-09-13T16:01:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.973+0000 7f81f4400640 1 -- 172.21.15.70:0/803990953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81ec06ffb0 msgr2=0x7f81ec152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.973+0000 7f81f4400640 1 --2- 172.21.15.70:0/803990953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81ec06ffb0 0x7f81ec152300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f81d800d800 tx=0x7f81d800dcc0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.973+0000 7f81f4400640 1 -- 172.21.15.70:0/803990953 shutdown_connections 2024-09-13T16:01:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.973+0000 7f81f4400640 1 --2- 172.21.15.70:0/803990953 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81ec15c270 0x7f81ec152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.973+0000 7f81f4400640 1 --2- 172.21.15.70:0/803990953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81ec06ffb0 0x7f81ec152300 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.973+0000 7f81f4400640 1 --2- 172.21.15.70:0/803990953 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f81cc06ac00 0x7f81cc06d0c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.973+0000 7f81f4400640 1 --2- 172.21.15.70:0/803990953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81ec06c140 0x7f81ec1ef7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.973+0000 7f81f4400640 1 -- 172.21.15.70:0/803990953 >> 172.21.15.70:0/803990953 conn(0x7f81ec0b0510 msgr2=0x7f81ec15a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.973+0000 7f81f4400640 1 -- 172.21.15.70:0/803990953 shutdown_connections 2024-09-13T16:01:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:01:59.973+0000 7f81f4400640 1 -- 172.21.15.70:0/803990953 wait complete. 2024-09-13T16:01:59.989 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-13T16:01:59.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:01:59.990 DEBUG:teuthology.orchestra.run.smithi070:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-13T16:02:00.049 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2024-09-13T16:02:00.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:00.049 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T16:02:00.085 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:02:00.086 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:02:00.125 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:02:00.125 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:02:00.203 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:02:00.203 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:02:00.281 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:02:00.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.433+0000 7f98f4800640 1 Processor -- start 2024-09-13T16:02:00.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.433+0000 7f98f4800640 1 -- start start 2024-09-13T16:02:00.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.435+0000 7f98f4800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f98ec153b20 0x7f98ec0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:00.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.435+0000 7f98f4800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f98ec06f660 0x7f98ec06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:00.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.435+0000 7f98f4800640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ec153f00 con 0x7f98ec159a80 2024-09-13T16:02:00.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.435+0000 7f98f4800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ec0ce600 con 0x7f98ec153b20 2024-09-13T16:02:00.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.435+0000 7f98f4800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ec070f90 con 0x7f98ec06f660 2024-09-13T16:02:00.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.435+0000 7f98f1e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f98ec153b20 0x7f98ec0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:00.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.435+0000 7f98f1400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f98ec159a80 0x7f98ec0b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41798/0 (socket says 172.21.15.70:41798) 2024-09-13T16:02:00.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.435+0000 7f98f1400640 1 -- 172.21.15.70:0/1184959989 learned_addr learned my addr 172.21.15.70:0/1184959989 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:00.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.435+0000 7f98f1e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f98ec153b20 0x7f98ec0b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60926/0 (socket says 172.21.15.70:60926) 2024-09-13T16:02:00.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.435+0000 7f98f2800640 1 --2- 172.21.15.70:0/1184959989 >> v2:172.21.15.107:3300/0 conn(0x7f98ec06f660 0x7f98ec06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:00.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.435+0000 7f98f1e00640 1 -- 172.21.15.70:0/1184959989 >> v2:172.21.15.107:3300/0 conn(0x7f98ec06f660 msgr2=0x7f98ec06fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:00.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.435+0000 7f98f1e00640 1 --2- 172.21.15.70:0/1184959989 >> v2:172.21.15.107:3300/0 conn(0x7f98ec06f660 0x7f98ec06fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.435+0000 7f98f1e00640 1 -- 172.21.15.70:0/1184959989 >> v1:172.21.15.70:6789/0 conn(0x7f98ec159a80 legacy=0x7f98ec0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:00.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.435+0000 7f98f1e00640 1 -- 172.21.15.70:0/1184959989 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec0b1a40 con 0x7f98ec153b20 2024-09-13T16:02:00.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.435+0000 7f98f0a00640 1 -- 172.21.15.70:0/1184959989 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780696296 0 0) 0x7f98ec153f00 con 0x7f98ec159a80 2024-09-13T16:02:00.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.435+0000 7f98f2800640 1 --2- 172.21.15.70:0/1184959989 >> v2:172.21.15.107:3300/0 conn(0x7f98ec06f660 0x7f98ec06fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:00.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.436+0000 7f98f1e00640 1 --2- 172.21.15.70:0/1184959989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec153b20 0x7f98ec0b3990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0cb060 tx=0x7f98e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbede58a8f3d077e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:00.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.437+0000 7f98f0a00640 1 -- 172.21.15.70:0/1184959989 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0032440 con 0x7f98ec153b20 2024-09-13T16:02:00.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.437+0000 7f98f0a00640 1 -- 172.21.15.70:0/1184959989 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e00325a0 con 0x7f98ec153b20 2024-09-13T16:02:00.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.437+0000 7f98f0a00640 1 -- 172.21.15.70:0/1184959989 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0032930 con 0x7f98ec153b20 2024-09-13T16:02:00.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.437+0000 7f98f4800640 1 -- 172.21.15.70:0/1184959989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec153b20 msgr2=0x7f98ec0b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:00.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.437+0000 7f98f4800640 1 --2- 172.21.15.70:0/1184959989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec153b20 0x7f98ec0b3990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0cb060 tx=0x7f98e002a1e0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.437+0000 7f98f4800640 1 -- 172.21.15.70:0/1184959989 shutdown_connections 2024-09-13T16:02:00.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.437+0000 7f98f4800640 1 --2- 172.21.15.70:0/1184959989 >> v2:172.21.15.107:3300/0 conn(0x7f98ec06f660 0x7f98ec06fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.437+0000 7f98f4800640 1 --2- 172.21.15.70:0/1184959989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec153b20 0x7f98ec0b3990 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.437+0000 7f98f4800640 1 -- 172.21.15.70:0/1184959989 >> 172.21.15.70:0/1184959989 conn(0x7f98ec0b0510 msgr2=0x7f98ec0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:00.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.437+0000 7f98f4800640 1 -- 172.21.15.70:0/1184959989 shutdown_connections 2024-09-13T16:02:00.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.437+0000 7f98f4800640 1 -- 172.21.15.70:0/1184959989 wait complete. 2024-09-13T16:02:00.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.439+0000 7f98f4800640 1 Processor -- start 2024-09-13T16:02:00.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.439+0000 7f98f4800640 1 -- start start 2024-09-13T16:02:00.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.440+0000 7f98f4800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec06f660 0x7f98ec158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:00.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.440+0000 7f98f4800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98ec153b20 0x7f98ec155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:00.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.440+0000 7f98f4800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98ec159a80 0x7f98ec0acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:00.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.440+0000 7f98f4800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec157d70 con 0x7f98ec06f660 2024-09-13T16:02:00.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.440+0000 7f98f4800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec15c660 con 0x7f98ec153b20 2024-09-13T16:02:00.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.440+0000 7f98f4800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec1576b0 con 0x7f98ec159a80 2024-09-13T16:02:00.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.440+0000 7f98f1e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec06f660 0x7f98ec158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:00.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.440+0000 7f98f1e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec06f660 0x7f98ec158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60934/0 (socket says 172.21.15.70:60934) 2024-09-13T16:02:00.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.440+0000 7f98f1e00640 1 -- 172.21.15.70:0/1070609549 learned_addr learned my addr 172.21.15.70:0/1070609549 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:00.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.440+0000 7f98f1400640 1 --2- 172.21.15.70:0/1070609549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98ec153b20 0x7f98ec155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:00.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.440+0000 7f98f2800640 1 --2- 172.21.15.70:0/1070609549 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98ec159a80 0x7f98ec0acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:00.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.440+0000 7f98f1e00640 1 -- 172.21.15.70:0/1070609549 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98ec159a80 msgr2=0x7f98ec0acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:00.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.440+0000 7f98f1e00640 1 --2- 172.21.15.70:0/1070609549 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98ec159a80 0x7f98ec0acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.440+0000 7f98f1e00640 1 -- 172.21.15.70:0/1070609549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98ec153b20 msgr2=0x7f98ec155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:00.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.440+0000 7f98f1e00640 1 --2- 172.21.15.70:0/1070609549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98ec153b20 0x7f98ec155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.440+0000 7f98f1e00640 1 -- 172.21.15.70:0/1070609549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e0009400 con 0x7f98ec06f660 2024-09-13T16:02:00.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.441+0000 7f98f1e00640 1 --2- 172.21.15.70:0/1070609549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec06f660 0x7f98ec158190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f98e0000c00 tx=0x7f98e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:00.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.441+0000 7f98e6000640 1 -- 172.21.15.70:0/1070609549 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0004230 con 0x7f98ec06f660 2024-09-13T16:02:00.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.441+0000 7f98e6000640 1 -- 172.21.15.70:0/1070609549 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e0004390 con 0x7f98ec06f660 2024-09-13T16:02:00.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.441+0000 7f98e6000640 1 -- 172.21.15.70:0/1070609549 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0030b20 con 0x7f98ec06f660 2024-09-13T16:02:00.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.441+0000 7f98f4800640 1 -- 172.21.15.70:0/1070609549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ec157990 con 0x7f98ec06f660 2024-09-13T16:02:00.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.441+0000 7f98f4800640 1 -- 172.21.15.70:0/1070609549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ec15c940 con 0x7f98ec06f660 2024-09-13T16:02:00.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.442+0000 7f98f4800640 1 -- 172.21.15.70:0/1070609549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ec0b3990 con 0x7f98ec06f660 2024-09-13T16:02:00.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.443+0000 7f98e6000640 1 -- 172.21.15.70:0/1070609549 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f98e0039050 con 0x7f98ec06f660 2024-09-13T16:02:00.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.444+0000 7f98e6000640 1 --2- 172.21.15.70:0/1070609549 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f98d006ac00 0x7f98d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:00.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.444+0000 7f98e6000640 1 -- 172.21.15.70:0/1070609549 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f98e00a9d60 con 0x7f98ec06f660 2024-09-13T16:02:00.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.444+0000 7f98f1400640 1 --2- 172.21.15.70:0/1070609549 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f98d006ac00 0x7f98d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:00.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.445+0000 7f98f1400640 1 --2- 172.21.15.70:0/1070609549 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f98d006ac00 0x7f98d006d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0b0e20 tx=0x7f98dc007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:00.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.448+0000 7f98e6000640 1 -- 172.21.15.70:0/1070609549 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f98e0074ff0 con 0x7f98ec06f660 2024-09-13T16:02:00.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.617+0000 7f98f4800640 1 -- 172.21.15.70:0/1070609549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98ec0cc230 con 0x7f98ec06f660 2024-09-13T16:02:00.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.618+0000 7f98e6000640 1 -- 172.21.15.70:0/1070609549 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16663 (secure 0 0 0) 0x7f98e004b020 con 0x7f98ec06f660 2024-09-13T16:02:00.619 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:00.620 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":22,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:59.137141+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:02:00.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.620+0000 7f98f4800640 1 -- 172.21.15.70:0/1070609549 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f98d006ac00 msgr2=0x7f98d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:00.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.620+0000 7f98f4800640 1 --2- 172.21.15.70:0/1070609549 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f98d006ac00 0x7f98d006d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0b0e20 tx=0x7f98dc007d50 comp rx=0 tx=0).stop 2024-09-13T16:02:00.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.620+0000 7f98f4800640 1 -- 172.21.15.70:0/1070609549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec06f660 msgr2=0x7f98ec158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:00.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.620+0000 7f98f4800640 1 --2- 172.21.15.70:0/1070609549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec06f660 0x7f98ec158190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f98e0000c00 tx=0x7f98e00046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.620+0000 7f98f4800640 1 -- 172.21.15.70:0/1070609549 shutdown_connections 2024-09-13T16:02:00.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.620+0000 7f98f4800640 1 --2- 172.21.15.70:0/1070609549 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98ec159a80 0x7f98ec0acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.620+0000 7f98f4800640 1 --2- 172.21.15.70:0/1070609549 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f98d006ac00 0x7f98d006d0c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.620+0000 7f98f4800640 1 --2- 172.21.15.70:0/1070609549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98ec153b20 0x7f98ec155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.620+0000 7f98f4800640 1 --2- 172.21.15.70:0/1070609549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec06f660 0x7f98ec158190 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.620+0000 7f98f4800640 1 -- 172.21.15.70:0/1070609549 >> 172.21.15.70:0/1070609549 conn(0x7f98ec0b0510 msgr2=0x7f98ec15d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:00.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.620+0000 7f98f4800640 1 -- 172.21.15.70:0/1070609549 shutdown_connections 2024-09-13T16:02:00.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.621+0000 7f98f4800640 1 -- 172.21.15.70:0/1070609549 wait complete. 2024-09-13T16:02:00.638 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:01:06.070694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:01:16.922043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:01:17.580304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:02:00.639 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:02:00.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.794+0000 7fde22800640 1 Processor -- start 2024-09-13T16:02:00.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.794+0000 7fde22800640 1 -- start start 2024-09-13T16:02:00.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.795+0000 7fde22800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c15c7f0 0x7fde1c0cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:00.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.795+0000 7fde22800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fde1c0d2690 0x7fde1c0d2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:00.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.795+0000 7fde22800640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde1c0d0770 con 0x7fde1c0b1b90 2024-09-13T16:02:00.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.795+0000 7fde22800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde1c0d3080 con 0x7fde1c0d2690 2024-09-13T16:02:00.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.795+0000 7fde22800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c0b1fd0 con 0x7fde1c15c7f0 2024-09-13T16:02:00.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.795+0000 7fde21e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fde1c0d2690 0x7fde1c0d2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:00.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.795+0000 7fde21e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fde1c0d2690 0x7fde1c0d2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60944/0 (socket says 172.21.15.70:60944) 2024-09-13T16:02:00.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.795+0000 7fde21e00640 1 -- 172.21.15.70:0/2508979675 learned_addr learned my addr 172.21.15.70:0/2508979675 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:00.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.795+0000 7fde20a00640 1 --1- 172.21.15.70:0/2508979675 >> v1:172.21.15.70:6789/0 conn(0x7fde1c0b1b90 0x7fde1c0b5600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41814/0 (socket says 172.21.15.70:41814) 2024-09-13T16:02:00.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.796+0000 7fde21400640 1 --2- 172.21.15.70:0/2508979675 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c15c7f0 0x7fde1c0cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:00.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.796+0000 7fde21e00640 1 -- 172.21.15.70:0/2508979675 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c15c7f0 msgr2=0x7fde1c0cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:00.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.796+0000 7fde21e00640 1 --2- 172.21.15.70:0/2508979675 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c15c7f0 0x7fde1c0cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.796+0000 7fde21e00640 1 -- 172.21.15.70:0/2508979675 >> v1:172.21.15.70:6789/0 conn(0x7fde1c0b1b90 legacy=0x7fde1c0b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:00.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.796+0000 7fde21e00640 1 -- 172.21.15.70:0/2508979675 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c0d09c0 con 0x7fde1c0d2690 2024-09-13T16:02:00.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.796+0000 7fde1be00640 1 -- 172.21.15.70:0/2508979675 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933294900 0 0) 0x7fde1c0d0770 con 0x7fde1c0b1b90 2024-09-13T16:02:00.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.797+0000 7fde21e00640 1 --2- 172.21.15.70:0/2508979675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde1c0d2690 0x7fde1c0d2b40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fde14009870 tx=0x7fde1402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cebb4857182ad2b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:00.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.797+0000 7fde1be00640 1 -- 172.21.15.70:0/2508979675 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde14032440 con 0x7fde1c0d2690 2024-09-13T16:02:00.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.797+0000 7fde1be00640 1 -- 172.21.15.70:0/2508979675 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde140325a0 con 0x7fde1c0d2690 2024-09-13T16:02:00.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.797+0000 7fde1be00640 1 -- 172.21.15.70:0/2508979675 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde14032930 con 0x7fde1c0d2690 2024-09-13T16:02:00.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.797+0000 7fde22800640 1 -- 172.21.15.70:0/2508979675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde1c0d2690 msgr2=0x7fde1c0d2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:00.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.797+0000 7fde22800640 1 --2- 172.21.15.70:0/2508979675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde1c0d2690 0x7fde1c0d2b40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fde14009870 tx=0x7fde1402a250 comp rx=0 tx=0).stop 2024-09-13T16:02:00.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.798+0000 7fde22800640 1 -- 172.21.15.70:0/2508979675 shutdown_connections 2024-09-13T16:02:00.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.798+0000 7fde22800640 1 --2- 172.21.15.70:0/2508979675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde1c0d2690 0x7fde1c0d2b40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.798+0000 7fde22800640 1 --2- 172.21.15.70:0/2508979675 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c15c7f0 0x7fde1c0cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.798+0000 7fde22800640 1 -- 172.21.15.70:0/2508979675 >> 172.21.15.70:0/2508979675 conn(0x7fde1c06a3a0 msgr2=0x7fde1c06a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:00.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.798+0000 7fde22800640 1 -- 172.21.15.70:0/2508979675 shutdown_connections 2024-09-13T16:02:00.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.798+0000 7fde22800640 1 -- 172.21.15.70:0/2508979675 wait complete. 2024-09-13T16:02:00.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.799+0000 7fde22800640 1 Processor -- start 2024-09-13T16:02:00.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.799+0000 7fde22800640 1 -- start start 2024-09-13T16:02:00.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.800+0000 7fde22800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde1c0b1b90 0x7fde1c1f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:00.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.800+0000 7fde22800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde1c0d2690 0x7fde1c1f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:00.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.800+0000 7fde22800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c15c7f0 0x7fde1c0cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:00.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.800+0000 7fde22800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c0ca820 con 0x7fde1c0b1b90 2024-09-13T16:02:00.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.800+0000 7fde22800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c1f22b0 con 0x7fde1c0d2690 2024-09-13T16:02:00.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.800+0000 7fde22800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c0caa70 con 0x7fde1c15c7f0 2024-09-13T16:02:00.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.801+0000 7fde21400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde1c0b1b90 0x7fde1c1f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:00.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.801+0000 7fde21400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde1c0b1b90 0x7fde1c1f4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60956/0 (socket says 172.21.15.70:60956) 2024-09-13T16:02:00.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.801+0000 7fde21400640 1 -- 172.21.15.70:0/3097420443 learned_addr learned my addr 172.21.15.70:0/3097420443 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:00.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.801+0000 7fde20a00640 1 --2- 172.21.15.70:0/3097420443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde1c0d2690 0x7fde1c1f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:00.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.801+0000 7fde21e00640 1 --2- 172.21.15.70:0/3097420443 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c15c7f0 0x7fde1c0cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:00.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.801+0000 7fde21400640 1 -- 172.21.15.70:0/3097420443 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c15c7f0 msgr2=0x7fde1c0cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:00.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.801+0000 7fde21400640 1 --2- 172.21.15.70:0/3097420443 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c15c7f0 0x7fde1c0cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.801+0000 7fde21400640 1 -- 172.21.15.70:0/3097420443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde1c0d2690 msgr2=0x7fde1c1f1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:00.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.801+0000 7fde21400640 1 --2- 172.21.15.70:0/3097420443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde1c0d2690 0x7fde1c1f1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.801+0000 7fde21400640 1 -- 172.21.15.70:0/3097420443 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde140094d0 con 0x7fde1c0b1b90 2024-09-13T16:02:00.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.801+0000 7fde21400640 1 --2- 172.21.15.70:0/3097420443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde1c0b1b90 0x7fde1c1f4c50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fde10007e40 tx=0x7fde1000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:00.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.801+0000 7fde19600640 1 -- 172.21.15.70:0/3097420443 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde10014620 con 0x7fde1c0b1b90 2024-09-13T16:02:00.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.802+0000 7fde19600640 1 -- 172.21.15.70:0/3097420443 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1000ee90 con 0x7fde1c0b1b90 2024-09-13T16:02:00.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.802+0000 7fde19600640 1 -- 172.21.15.70:0/3097420443 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde100149c0 con 0x7fde1c0b1b90 2024-09-13T16:02:00.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.802+0000 7fde22800640 1 -- 172.21.15.70:0/3097420443 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde1c0cad50 con 0x7fde1c0b1b90 2024-09-13T16:02:00.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.802+0000 7fde22800640 1 -- 172.21.15.70:0/3097420443 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde1c0cb310 con 0x7fde1c0b1b90 2024-09-13T16:02:00.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.803+0000 7fde22800640 1 -- 172.21.15.70:0/3097420443 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1c15cbd0 con 0x7fde1c0b1b90 2024-09-13T16:02:00.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.803+0000 7fde19600640 1 -- 172.21.15.70:0/3097420443 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fde10014b20 con 0x7fde1c0b1b90 2024-09-13T16:02:00.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.804+0000 7fde19600640 1 --2- 172.21.15.70:0/3097420443 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fddfc06ac30 0x7fddfc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:00.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.804+0000 7fde19600640 1 -- 172.21.15.70:0/3097420443 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fde10089d20 con 0x7fde1c0b1b90 2024-09-13T16:02:00.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.805+0000 7fde20a00640 1 --2- 172.21.15.70:0/3097420443 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fddfc06ac30 0x7fddfc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:00.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.805+0000 7fde20a00640 1 --2- 172.21.15.70:0/3097420443 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fddfc06ac30 0x7fddfc06d0f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0b2900 tx=0x7fde08007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:00.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.808+0000 7fde19600640 1 -- 172.21.15.70:0/3097420443 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fde10054de0 con 0x7fde1c0b1b90 2024-09-13T16:02:00.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.974+0000 7fde22800640 1 -- 172.21.15.70:0/3097420443 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde1c0cd6f0 con 0x7fde1c0b1b90 2024-09-13T16:02:00.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.975+0000 7fde19600640 1 -- 172.21.15.70:0/3097420443 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fde10058400 con 0x7fde1c0b1b90 2024-09-13T16:02:00.976 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-13T16:02:00.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.977+0000 7fde22800640 1 -- 172.21.15.70:0/3097420443 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fddfc06ac30 msgr2=0x7fddfc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:00.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.977+0000 7fde22800640 1 --2- 172.21.15.70:0/3097420443 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fddfc06ac30 0x7fddfc06d0f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0b2900 tx=0x7fde08007d50 comp rx=0 tx=0).stop 2024-09-13T16:02:00.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.977+0000 7fde22800640 1 -- 172.21.15.70:0/3097420443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde1c0b1b90 msgr2=0x7fde1c1f4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.977+0000 7fde22800640 1 --2- 172.21.15.70:0/3097420443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde1c0b1b90 0x7fde1c1f4c50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fde10007e40 tx=0x7fde1000e4b0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.977+0000 7fde22800640 1 -- 172.21.15.70:0/3097420443 shutdown_connections 2024-09-13T16:02:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.977+0000 7fde22800640 1 --2- 172.21.15.70:0/3097420443 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde1c15c7f0 0x7fde1c0cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.977+0000 7fde22800640 1 --2- 172.21.15.70:0/3097420443 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fddfc06ac30 0x7fddfc06d0f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.977+0000 7fde22800640 1 --2- 172.21.15.70:0/3097420443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde1c0d2690 0x7fde1c1f1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.977+0000 7fde22800640 1 --2- 172.21.15.70:0/3097420443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde1c0b1b90 0x7fde1c1f4c50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.977+0000 7fde22800640 1 -- 172.21.15.70:0/3097420443 >> 172.21.15.70:0/3097420443 conn(0x7fde1c06a3a0 msgr2=0x7fde1c06a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.977+0000 7fde22800640 1 -- 172.21.15.70:0/3097420443 shutdown_connections 2024-09-13T16:02:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:00.977+0000 7fde22800640 1 -- 172.21.15.70:0/3097420443 wait complete. 2024-09-13T16:02:00.995 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:02:01.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.148+0000 7f7f67e00640 1 Processor -- start 2024-09-13T16:02:01.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.149+0000 7f7f67e00640 1 -- start start 2024-09-13T16:02:01.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.150+0000 7f7f67e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7f6815c700 0x7f7f6806b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:01.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.150+0000 7f7f67e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7f6806b5d0 0x7f7f680b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:01.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.150+0000 7f7f67e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f6806bb30 con 0x7f7f6806cbd0 2024-09-13T16:02:01.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.150+0000 7f7f67e00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6806be10 con 0x7f7f6806b5d0 2024-09-13T16:02:01.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.150+0000 7f7f67e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6806c0f0 con 0x7f7f6815c700 2024-09-13T16:02:01.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.150+0000 7f7f66000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7f6806b5d0 0x7f7f680b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:01.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.150+0000 7f7f66000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7f6806b5d0 0x7f7f680b22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60958/0 (socket says 172.21.15.70:60958) 2024-09-13T16:02:01.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.150+0000 7f7f66000640 1 -- 172.21.15.70:0/273057488 learned_addr learned my addr 172.21.15.70:0/273057488 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:01.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.150+0000 7f7f66a00640 1 --2- 172.21.15.70:0/273057488 >> v2:172.21.15.107:3300/0 conn(0x7f7f6815c700 0x7f7f6806b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:01.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.151+0000 7f7f66000640 1 -- 172.21.15.70:0/273057488 >> v2:172.21.15.107:3300/0 conn(0x7f7f6815c700 msgr2=0x7f7f6806b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:01.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.151+0000 7f7f66000640 1 --2- 172.21.15.70:0/273057488 >> v2:172.21.15.107:3300/0 conn(0x7f7f6815c700 0x7f7f6806b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.151+0000 7f7f66000640 1 -- 172.21.15.70:0/273057488 >> v1:172.21.15.107:6789/0 conn(0x7f7f6806cbd0 legacy=0x7f7f68071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:01.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.151+0000 7f7f66000640 1 -- 172.21.15.70:0/273057488 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6806c3d0 con 0x7f7f6806b5d0 2024-09-13T16:02:01.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.151+0000 7f7f66a00640 1 --2- 172.21.15.70:0/273057488 >> v2:172.21.15.107:3300/0 conn(0x7f7f6815c700 0x7f7f6806b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:01.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.152+0000 7f7f66000640 1 --2- 172.21.15.70:0/273057488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6806b5d0 0x7f7f680b22c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7f68071530 tx=0x7f7f5402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cbd4a242bd07c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:01.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.152+0000 7f7f65600640 1 -- 172.21.15.70:0/273057488 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54032440 con 0x7f7f6806b5d0 2024-09-13T16:02:01.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.152+0000 7f7f65600640 1 -- 172.21.15.70:0/273057488 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f540325a0 con 0x7f7f6806b5d0 2024-09-13T16:02:01.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.152+0000 7f7f65600640 1 -- 172.21.15.70:0/273057488 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54032930 con 0x7f7f6806b5d0 2024-09-13T16:02:01.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.152+0000 7f7f67e00640 1 -- 172.21.15.70:0/273057488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6806b5d0 msgr2=0x7f7f680b22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:01.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.152+0000 7f7f67e00640 1 --2- 172.21.15.70:0/273057488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6806b5d0 0x7f7f680b22c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7f68071530 tx=0x7f7f5402a1e0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.153+0000 7f7f67e00640 1 -- 172.21.15.70:0/273057488 shutdown_connections 2024-09-13T16:02:01.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.153+0000 7f7f67e00640 1 --2- 172.21.15.70:0/273057488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6806b5d0 0x7f7f680b22c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.153+0000 7f7f67e00640 1 --2- 172.21.15.70:0/273057488 >> v2:172.21.15.107:3300/0 conn(0x7f7f6815c700 0x7f7f6806b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.153+0000 7f7f67e00640 1 -- 172.21.15.70:0/273057488 >> 172.21.15.70:0/273057488 conn(0x7f7f68069ed0 msgr2=0x7f7f6806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:01.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.153+0000 7f7f67e00640 1 -- 172.21.15.70:0/273057488 shutdown_connections 2024-09-13T16:02:01.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.153+0000 7f7f67e00640 1 -- 172.21.15.70:0/273057488 wait complete. 2024-09-13T16:02:01.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.154+0000 7f7f67e00640 1 Processor -- start 2024-09-13T16:02:01.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.154+0000 7f7f67e00640 1 -- start start 2024-09-13T16:02:01.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.155+0000 7f7f67e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f6806b5d0 0x7f7f6814c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:01.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.155+0000 7f7f67e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6806cbd0 0x7f7f6814f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:01.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.155+0000 7f7f67e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f6815c700 0x7f7f680c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:01.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.155+0000 7f7f67e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6815fdb0 con 0x7f7f6806cbd0 2024-09-13T16:02:01.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.155+0000 7f7f67e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6815d800 con 0x7f7f6815c700 2024-09-13T16:02:01.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.155+0000 7f7f67e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f680ca610 con 0x7f7f6806b5d0 2024-09-13T16:02:01.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.155+0000 7f7f66000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6806cbd0 0x7f7f6814f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:01.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.156+0000 7f7f66000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6806cbd0 0x7f7f6814f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60964/0 (socket says 172.21.15.70:60964) 2024-09-13T16:02:01.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.156+0000 7f7f66000640 1 -- 172.21.15.70:0/853750432 learned_addr learned my addr 172.21.15.70:0/853750432 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:01.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.156+0000 7f7f66000640 1 -- 172.21.15.70:0/853750432 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f6806b5d0 msgr2=0x7f7f6814c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:01.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.156+0000 7f7f66000640 1 --2- 172.21.15.70:0/853750432 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f6806b5d0 0x7f7f6814c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.156+0000 7f7f66000640 1 -- 172.21.15.70:0/853750432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f6815c700 msgr2=0x7f7f680c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:01.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.156+0000 7f7f67400640 1 --2- 172.21.15.70:0/853750432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f6815c700 0x7f7f680c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:01.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.156+0000 7f7f66000640 1 --2- 172.21.15.70:0/853750432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f6815c700 0x7f7f680c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.156+0000 7f7f66000640 1 -- 172.21.15.70:0/853750432 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f540094d0 con 0x7f7f6806cbd0 2024-09-13T16:02:01.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.156+0000 7f7f67400640 1 --2- 172.21.15.70:0/853750432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f6815c700 0x7f7f680c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:01.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.156+0000 7f7f66000640 1 --2- 172.21.15.70:0/853750432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6806cbd0 0x7f7f6814f520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7f5402a220 tx=0x7f7f540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:01.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.157+0000 7f7f5f400640 1 -- 172.21.15.70:0/853750432 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54032440 con 0x7f7f6806cbd0 2024-09-13T16:02:01.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.157+0000 7f7f5f400640 1 -- 172.21.15.70:0/853750432 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f54030ba0 con 0x7f7f6806cbd0 2024-09-13T16:02:01.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.157+0000 7f7f5f400640 1 -- 172.21.15.70:0/853750432 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5403d440 con 0x7f7f6806cbd0 2024-09-13T16:02:01.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.157+0000 7f7f67e00640 1 -- 172.21.15.70:0/853750432 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f6815cc60 con 0x7f7f6806cbd0 2024-09-13T16:02:01.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.157+0000 7f7f67e00640 1 -- 172.21.15.70:0/853750432 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f680cabd0 con 0x7f7f6806cbd0 2024-09-13T16:02:01.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.158+0000 7f7f67e00640 1 -- 172.21.15.70:0/853750432 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6806b090 con 0x7f7f6806cbd0 2024-09-13T16:02:01.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.159+0000 7f7f5f400640 1 -- 172.21.15.70:0/853750432 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7f54039040 con 0x7f7f6806cbd0 2024-09-13T16:02:01.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.159+0000 7f7f5f400640 1 --2- 172.21.15.70:0/853750432 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7f4806ac00 0x7f7f4806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:01.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.160+0000 7f7f5f400640 1 -- 172.21.15.70:0/853750432 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7f540a9ff0 con 0x7f7f6806cbd0 2024-09-13T16:02:01.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.160+0000 7f7f66a00640 1 --2- 172.21.15.70:0/853750432 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7f4806ac00 0x7f7f4806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:01.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.160+0000 7f7f66a00640 1 --2- 172.21.15.70:0/853750432 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7f4806ac00 0x7f7f4806d0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7f58006fd0 tx=0x7f7f58008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:01.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.163+0000 7f7f5f400640 1 -- 172.21.15.70:0/853750432 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7f540dd9c0 con 0x7f7f6806cbd0 2024-09-13T16:02:01.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.331+0000 7f7f67e00640 1 -- 172.21.15.70:0/853750432 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f6815d9d0 con 0x7f7f6806cbd0 2024-09-13T16:02:01.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.331+0000 7f7f5f400640 1 -- 172.21.15.70:0/853750432 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f540410a0 con 0x7f7f6806cbd0 2024-09-13T16:02:01.333 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-13T16:02:01.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.334+0000 7f7f67e00640 1 -- 172.21.15.70:0/853750432 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7f4806ac00 msgr2=0x7f7f4806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:01.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.334+0000 7f7f67e00640 1 --2- 172.21.15.70:0/853750432 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7f4806ac00 0x7f7f4806d0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7f58006fd0 tx=0x7f7f58008040 comp rx=0 tx=0).stop 2024-09-13T16:02:01.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.334+0000 7f7f67e00640 1 -- 172.21.15.70:0/853750432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6806cbd0 msgr2=0x7f7f6814f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:01.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.334+0000 7f7f67e00640 1 --2- 172.21.15.70:0/853750432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6806cbd0 0x7f7f6814f520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7f5402a220 tx=0x7f7f540046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.334+0000 7f7f67e00640 1 -- 172.21.15.70:0/853750432 shutdown_connections 2024-09-13T16:02:01.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.334+0000 7f7f67e00640 1 --2- 172.21.15.70:0/853750432 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7f4806ac00 0x7f7f4806d0c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.334+0000 7f7f67e00640 1 --2- 172.21.15.70:0/853750432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f6815c700 0x7f7f680c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.334+0000 7f7f67e00640 1 --2- 172.21.15.70:0/853750432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6806cbd0 0x7f7f6814f520 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.334+0000 7f7f67e00640 1 --2- 172.21.15.70:0/853750432 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f6806b5d0 0x7f7f6814c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.334+0000 7f7f67e00640 1 -- 172.21.15.70:0/853750432 >> 172.21.15.70:0/853750432 conn(0x7f7f68069ed0 msgr2=0x7f7f6806d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:01.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.334+0000 7f7f67e00640 1 -- 172.21.15.70:0/853750432 shutdown_connections 2024-09-13T16:02:01.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.334+0000 7f7f67e00640 1 -- 172.21.15.70:0/853750432 wait complete. 2024-09-13T16:02:01.350 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:02:01.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.505+0000 7f06e7a00640 1 Processor -- start 2024-09-13T16:02:01.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.505+0000 7f06e7a00640 1 -- start start 2024-09-13T16:02:01.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.506+0000 7f06e7a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f06e0070170 0x7f06e00ad950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:01.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.506+0000 7f06e7a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06e00ade90 0x7f06e015c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:01.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.506+0000 7f06e7a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e006fce0 con 0x7f06e01566f0 2024-09-13T16:02:01.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.506+0000 7f06e7a00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e00ae320 con 0x7f06e0070170 2024-09-13T16:02:01.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.506+0000 7f06e7a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e006c550 con 0x7f06e00ade90 2024-09-13T16:02:01.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.506+0000 7f06dfe00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f06e0070170 0x7f06e00ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:01.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.507+0000 7f06dfe00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f06e0070170 0x7f06e00ad950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60978/0 (socket says 172.21.15.70:60978) 2024-09-13T16:02:01.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.507+0000 7f06dfe00640 1 -- 172.21.15.70:0/2404244352 learned_addr learned my addr 172.21.15.70:0/2404244352 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:01.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.507+0000 7f06e5a00640 1 --2- 172.21.15.70:0/2404244352 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06e00ade90 0x7f06e015c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:01.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.507+0000 7f06dfe00640 1 -- 172.21.15.70:0/2404244352 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06e00ade90 msgr2=0x7f06e015c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:01.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.507+0000 7f06dfe00640 1 --2- 172.21.15.70:0/2404244352 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06e00ade90 0x7f06e015c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.507+0000 7f06dfe00640 1 -- 172.21.15.70:0/2404244352 >> v1:172.21.15.107:6789/0 conn(0x7f06e01566f0 legacy=0x7f06e006be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:01.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.507+0000 7f06dfe00640 1 -- 172.21.15.70:0/2404244352 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e006c820 con 0x7f06e0070170 2024-09-13T16:02:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.508+0000 7f06dfe00640 1 --2- 172.21.15.70:0/2404244352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06e0070170 0x7f06e00ad950 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009870 tx=0x7f06cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5fbc1e0ef26b57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.508+0000 7f06df400640 1 -- 172.21.15.70:0/2404244352 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc032440 con 0x7f06e0070170 2024-09-13T16:02:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.508+0000 7f06df400640 1 -- 172.21.15.70:0/2404244352 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc0325a0 con 0x7f06e0070170 2024-09-13T16:02:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.508+0000 7f06df400640 1 -- 172.21.15.70:0/2404244352 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc032930 con 0x7f06e0070170 2024-09-13T16:02:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.509+0000 7f06e7a00640 1 -- 172.21.15.70:0/2404244352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06e0070170 msgr2=0x7f06e00ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.509+0000 7f06e7a00640 1 --2- 172.21.15.70:0/2404244352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06e0070170 0x7f06e00ad950 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009870 tx=0x7f06cc02a270 comp rx=0 tx=0).stop 2024-09-13T16:02:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.509+0000 7f06e7a00640 1 -- 172.21.15.70:0/2404244352 shutdown_connections 2024-09-13T16:02:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.509+0000 7f06e7a00640 1 --2- 172.21.15.70:0/2404244352 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06e00ade90 0x7f06e015c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.509+0000 7f06e7a00640 1 --2- 172.21.15.70:0/2404244352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06e0070170 0x7f06e00ad950 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.509+0000 7f06e7a00640 1 -- 172.21.15.70:0/2404244352 >> 172.21.15.70:0/2404244352 conn(0x7f06e00b0580 msgr2=0x7f06e00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.509+0000 7f06e7a00640 1 -- 172.21.15.70:0/2404244352 shutdown_connections 2024-09-13T16:02:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.509+0000 7f06e7a00640 1 -- 172.21.15.70:0/2404244352 wait complete. 2024-09-13T16:02:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.510+0000 7f06e7a00640 1 Processor -- start 2024-09-13T16:02:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.511+0000 7f06e7a00640 1 -- start start 2024-09-13T16:02:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.511+0000 7f06e7a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06e0070170 0x7f06e0140410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.512+0000 7f06e7a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06e00ade90 0x7f06e01558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.512+0000 7f06e7a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06e01566f0 0x7f06e0141c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.512+0000 7f06e7a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e014bcf0 con 0x7f06e00ade90 2024-09-13T16:02:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.512+0000 7f06e7a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e00cca30 con 0x7f06e01566f0 2024-09-13T16:02:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.512+0000 7f06e7a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e0155e20 con 0x7f06e0070170 2024-09-13T16:02:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.512+0000 7f06dfe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06e00ade90 0x7f06e01558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.512+0000 7f06dfe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06e00ade90 0x7f06e01558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60986/0 (socket says 172.21.15.70:60986) 2024-09-13T16:02:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.512+0000 7f06dfe00640 1 -- 172.21.15.70:0/1969007006 learned_addr learned my addr 172.21.15.70:0/1969007006 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.512+0000 7f06e5a00640 1 --2- 172.21.15.70:0/1969007006 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06e01566f0 0x7f06e0141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.512+0000 7f06e5000640 1 --2- 172.21.15.70:0/1969007006 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06e0070170 0x7f06e0140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.512+0000 7f06dfe00640 1 -- 172.21.15.70:0/1969007006 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06e0070170 msgr2=0x7f06e0140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.512+0000 7f06dfe00640 1 --2- 172.21.15.70:0/1969007006 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06e0070170 0x7f06e0140410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.512+0000 7f06dfe00640 1 -- 172.21.15.70:0/1969007006 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06e01566f0 msgr2=0x7f06e0141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.512+0000 7f06dfe00640 1 --2- 172.21.15.70:0/1969007006 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06e01566f0 0x7f06e0141c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.512+0000 7f06dfe00640 1 -- 172.21.15.70:0/1969007006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc0094d0 con 0x7f06e00ade90 2024-09-13T16:02:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.512+0000 7f06e5000640 1 --2- 172.21.15.70:0/1969007006 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06e0070170 0x7f06e0140410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.513+0000 7f06dfe00640 1 --2- 172.21.15.70:0/1969007006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06e00ade90 0x7f06e01558e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f06cc000c00 tx=0x7f06cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.513+0000 7f06dcc00640 1 -- 172.21.15.70:0/1969007006 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc032440 con 0x7f06e00ade90 2024-09-13T16:02:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.513+0000 7f06dcc00640 1 -- 172.21.15.70:0/1969007006 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc030b80 con 0x7f06e00ade90 2024-09-13T16:02:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.513+0000 7f06dcc00640 1 -- 172.21.15.70:0/1969007006 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc03d440 con 0x7f06e00ade90 2024-09-13T16:02:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.513+0000 7f06e7a00640 1 -- 172.21.15.70:0/1969007006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e0142a30 con 0x7f06e00ade90 2024-09-13T16:02:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.513+0000 7f06e7a00640 1 -- 172.21.15.70:0/1969007006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e0142470 con 0x7f06e00ade90 2024-09-13T16:02:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.514+0000 7f06e7a00640 1 -- 172.21.15.70:0/1969007006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e00b2cf0 con 0x7f06e00ade90 2024-09-13T16:02:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.515+0000 7f06dcc00640 1 -- 172.21.15.70:0/1969007006 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f06cc039040 con 0x7f06e00ade90 2024-09-13T16:02:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.516+0000 7f06dcc00640 1 --2- 172.21.15.70:0/1969007006 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f06c006ac30 0x7f06c006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.516+0000 7f06dcc00640 1 -- 172.21.15.70:0/1969007006 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f06cc0a9ec0 con 0x7f06e00ade90 2024-09-13T16:02:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.516+0000 7f06e5000640 1 --2- 172.21.15.70:0/1969007006 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f06c006ac30 0x7f06c006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.516+0000 7f06e5000640 1 --2- 172.21.15.70:0/1969007006 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f06c006ac30 0x7f06c006d0f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f06d4007fd0 tx=0x7f06d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:01.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.520+0000 7f06dcc00640 1 -- 172.21.15.70:0/1969007006 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f06cc074f80 con 0x7f06e00ade90 2024-09-13T16:02:01.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.689+0000 7f06e7a00640 1 -- 172.21.15.70:0/1969007006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06e00b3820 con 0x7f06e00ade90 2024-09-13T16:02:01.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.689+0000 7f06dcc00640 1 -- 172.21.15.70:0/1969007006 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06cc0785a0 con 0x7f06e00ade90 2024-09-13T16:02:01.691 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-13T16:02:01.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.692+0000 7f06e7a00640 1 -- 172.21.15.70:0/1969007006 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f06c006ac30 msgr2=0x7f06c006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:01.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.692+0000 7f06e7a00640 1 --2- 172.21.15.70:0/1969007006 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f06c006ac30 0x7f06c006d0f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f06d4007fd0 tx=0x7f06d4009040 comp rx=0 tx=0).stop 2024-09-13T16:02:01.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.692+0000 7f06e7a00640 1 -- 172.21.15.70:0/1969007006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06e00ade90 msgr2=0x7f06e01558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:01.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.692+0000 7f06e7a00640 1 --2- 172.21.15.70:0/1969007006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06e00ade90 0x7f06e01558e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f06cc000c00 tx=0x7f06cc0046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.692+0000 7f06e7a00640 1 -- 172.21.15.70:0/1969007006 shutdown_connections 2024-09-13T16:02:01.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.692+0000 7f06e7a00640 1 --2- 172.21.15.70:0/1969007006 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f06c006ac30 0x7f06c006d0f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.692+0000 7f06e7a00640 1 --2- 172.21.15.70:0/1969007006 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06e01566f0 0x7f06e0141c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.692+0000 7f06e7a00640 1 --2- 172.21.15.70:0/1969007006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06e00ade90 0x7f06e01558e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.692+0000 7f06e7a00640 1 --2- 172.21.15.70:0/1969007006 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06e0070170 0x7f06e0140410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.692+0000 7f06e7a00640 1 -- 172.21.15.70:0/1969007006 >> 172.21.15.70:0/1969007006 conn(0x7f06e00b0580 msgr2=0x7f06e0070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:01.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.692+0000 7f06e7a00640 1 -- 172.21.15.70:0/1969007006 shutdown_connections 2024-09-13T16:02:01.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.692+0000 7f06e7a00640 1 -- 172.21.15.70:0/1969007006 wait complete. 2024-09-13T16:02:01.709 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T16:02:01.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.862+0000 7f1c51800640 1 Processor -- start 2024-09-13T16:02:01.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.862+0000 7f1c51800640 1 -- start start 2024-09-13T16:02:01.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.863+0000 7f1c51800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1c4c15ca90 0x7f1c4c0cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:01.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.863+0000 7f1c51800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c4c0cda80 0x7f1c4c0b2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:01.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.863+0000 7f1c51800640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4c0d0a10 con 0x7f1c4c0b2d90 2024-09-13T16:02:01.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.863+0000 7f1c51800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c0b3980 con 0x7f1c4c15ca90 2024-09-13T16:02:01.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.863+0000 7f1c51800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c1608a0 con 0x7f1c4c0cda80 2024-09-13T16:02:01.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.863+0000 7f1c4aa00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1c4c15ca90 0x7f1c4c0cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:01.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.863+0000 7f1c4b400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f1c4c0b2d90 0x7f1c4c0d26d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41818/0 (socket says 172.21.15.70:41818) 2024-09-13T16:02:01.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.863+0000 7f1c4aa00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1c4c15ca90 0x7f1c4c0cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32768/0 (socket says 172.21.15.70:32768) 2024-09-13T16:02:01.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.863+0000 7f1c4b400640 1 -- 172.21.15.70:0/670053296 learned_addr learned my addr 172.21.15.70:0/670053296 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:01.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.864+0000 7f1c4a000640 1 --2- 172.21.15.70:0/670053296 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c4c0cda80 0x7f1c4c0b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:01.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.864+0000 7f1c4aa00640 1 -- 172.21.15.70:0/670053296 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c4c0cda80 msgr2=0x7f1c4c0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:01.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.864+0000 7f1c4aa00640 1 --2- 172.21.15.70:0/670053296 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c4c0cda80 0x7f1c4c0b2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.864+0000 7f1c4aa00640 1 -- 172.21.15.70:0/670053296 >> v1:172.21.15.70:6789/0 conn(0x7f1c4c0b2d90 legacy=0x7f1c4c0d26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:01.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.864+0000 7f1c4aa00640 1 -- 172.21.15.70:0/670053296 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c0b33c0 con 0x7f1c4c15ca90 2024-09-13T16:02:01.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.864+0000 7f1c49600640 1 -- 172.21.15.70:0/670053296 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560394785 0 0) 0x7f1c4c0d0a10 con 0x7f1c4c0b2d90 2024-09-13T16:02:01.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.865+0000 7f1c4aa00640 1 --2- 172.21.15.70:0/670053296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c4c15ca90 0x7f1c4c0cd540 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0097a0 tx=0x7f1c3c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c2e9792fd312e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:01.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.865+0000 7f1c49600640 1 -- 172.21.15.70:0/670053296 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c02ae50 con 0x7f1c4c15ca90 2024-09-13T16:02:01.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.865+0000 7f1c49600640 1 -- 172.21.15.70:0/670053296 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c032440 con 0x7f1c4c15ca90 2024-09-13T16:02:01.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.865+0000 7f1c49600640 1 -- 172.21.15.70:0/670053296 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c0327d0 con 0x7f1c4c15ca90 2024-09-13T16:02:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.866+0000 7f1c51800640 1 -- 172.21.15.70:0/670053296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c4c15ca90 msgr2=0x7f1c4c0cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.866+0000 7f1c51800640 1 --2- 172.21.15.70:0/670053296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c4c15ca90 0x7f1c4c0cd540 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0097a0 tx=0x7f1c3c02a100 comp rx=0 tx=0).stop 2024-09-13T16:02:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.866+0000 7f1c51800640 1 -- 172.21.15.70:0/670053296 shutdown_connections 2024-09-13T16:02:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.866+0000 7f1c51800640 1 --2- 172.21.15.70:0/670053296 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c4c0cda80 0x7f1c4c0b2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.866+0000 7f1c51800640 1 --2- 172.21.15.70:0/670053296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c4c15ca90 0x7f1c4c0cd540 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.866+0000 7f1c51800640 1 -- 172.21.15.70:0/670053296 >> 172.21.15.70:0/670053296 conn(0x7f1c4c08bf90 msgr2=0x7f1c4c08c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.866+0000 7f1c51800640 1 -- 172.21.15.70:0/670053296 shutdown_connections 2024-09-13T16:02:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.866+0000 7f1c51800640 1 -- 172.21.15.70:0/670053296 wait complete. 2024-09-13T16:02:01.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.867+0000 7f1c51800640 1 Processor -- start 2024-09-13T16:02:01.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.868+0000 7f1c51800640 1 -- start start 2024-09-13T16:02:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.868+0000 7f1c51800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c4c0b2d90 0x7f1c4c1efbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.868+0000 7f1c51800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c4c0cda80 0x7f1c4c149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.869+0000 7f1c51800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c4c15ca90 0x7f1c4c0c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.869+0000 7f1c51800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c0caac0 con 0x7f1c4c0cda80 2024-09-13T16:02:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.869+0000 7f1c51800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c0cb320 con 0x7f1c4c15ca90 2024-09-13T16:02:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.869+0000 7f1c51800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c1f3370 con 0x7f1c4c0b2d90 2024-09-13T16:02:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.869+0000 7f1c4a000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c4c0cda80 0x7f1c4c149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.869+0000 7f1c4a000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c4c0cda80 0x7f1c4c149c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32770/0 (socket says 172.21.15.70:32770) 2024-09-13T16:02:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.869+0000 7f1c4a000640 1 -- 172.21.15.70:0/3311401458 learned_addr learned my addr 172.21.15.70:0/3311401458 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.869+0000 7f1c4aa00640 1 --2- 172.21.15.70:0/3311401458 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c4c0b2d90 0x7f1c4c1efbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.869+0000 7f1c4b400640 1 --2- 172.21.15.70:0/3311401458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c4c15ca90 0x7f1c4c0c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.869+0000 7f1c4a000640 1 -- 172.21.15.70:0/3311401458 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c4c0b2d90 msgr2=0x7f1c4c1efbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.869+0000 7f1c4a000640 1 --2- 172.21.15.70:0/3311401458 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c4c0b2d90 0x7f1c4c1efbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.869+0000 7f1c4a000640 1 -- 172.21.15.70:0/3311401458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c4c15ca90 msgr2=0x7f1c4c0c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.869+0000 7f1c4a000640 1 --2- 172.21.15.70:0/3311401458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c4c15ca90 0x7f1c4c0c6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.869+0000 7f1c4a000640 1 -- 172.21.15.70:0/3311401458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c009400 con 0x7f1c4c0cda80 2024-09-13T16:02:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.869+0000 7f1c4b400640 1 --2- 172.21.15.70:0/3311401458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c4c15ca90 0x7f1c4c0c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.870+0000 7f1c4a000640 1 --2- 172.21.15.70:0/3311401458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c4c0cda80 0x7f1c4c149c40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800e850 tx=0x7f1c3800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.870+0000 7f1c42a00640 1 -- 172.21.15.70:0/3311401458 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3800c940 con 0x7f1c4c0cda80 2024-09-13T16:02:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.870+0000 7f1c42a00640 1 -- 172.21.15.70:0/3311401458 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3800caa0 con 0x7f1c4c0cda80 2024-09-13T16:02:01.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.870+0000 7f1c42a00640 1 -- 172.21.15.70:0/3311401458 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3800ce10 con 0x7f1c4c0cda80 2024-09-13T16:02:01.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.870+0000 7f1c51800640 1 -- 172.21.15.70:0/3311401458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4c0cacd0 con 0x7f1c4c0cda80 2024-09-13T16:02:01.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.870+0000 7f1c51800640 1 -- 172.21.15.70:0/3311401458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4c0c6bd0 con 0x7f1c4c0cda80 2024-09-13T16:02:01.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.871+0000 7f1c51800640 1 -- 172.21.15.70:0/3311401458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c4c0b2850 con 0x7f1c4c0cda80 2024-09-13T16:02:01.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.872+0000 7f1c42a00640 1 -- 172.21.15.70:0/3311401458 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1c38013470 con 0x7f1c4c0cda80 2024-09-13T16:02:01.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.872+0000 7f1c42a00640 1 --2- 172.21.15.70:0/3311401458 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f1c2c06ac00 0x7f1c2c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:01.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.873+0000 7f1c42a00640 1 -- 172.21.15.70:0/3311401458 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1c38089560 con 0x7f1c4c0cda80 2024-09-13T16:02:01.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.873+0000 7f1c4aa00640 1 --2- 172.21.15.70:0/3311401458 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f1c2c06ac00 0x7f1c2c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:01.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.874+0000 7f1c4aa00640 1 --2- 172.21.15.70:0/3311401458 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f1c2c06ac00 0x7f1c2c06d0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c034000 tx=0x7f1c3c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:01.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:01.877+0000 7f1c42a00640 1 -- 172.21.15.70:0/3311401458 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1c380546d0 con 0x7f1c4c0cda80 2024-09-13T16:02:02.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.056+0000 7f1c51800640 1 -- 172.21.15.70:0/3311401458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1c4c0d34d0 con 0x7f1c4c0cda80 2024-09-13T16:02:02.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.056+0000 7f1c42a00640 1 -- 172.21.15.70:0/3311401458 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1c38057cf0 con 0x7f1c4c0cda80 2024-09-13T16:02:02.058 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2024-09-13T16:02:02.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.058+0000 7f1c51800640 1 -- 172.21.15.70:0/3311401458 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f1c2c06ac00 msgr2=0x7f1c2c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:02.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.058+0000 7f1c51800640 1 --2- 172.21.15.70:0/3311401458 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f1c2c06ac00 0x7f1c2c06d0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c034000 tx=0x7f1c3c02e000 comp rx=0 tx=0).stop 2024-09-13T16:02:02.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.058+0000 7f1c51800640 1 -- 172.21.15.70:0/3311401458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c4c0cda80 msgr2=0x7f1c4c149c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:02.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.058+0000 7f1c51800640 1 --2- 172.21.15.70:0/3311401458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c4c0cda80 0x7f1c4c149c40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800e850 tx=0x7f1c3800ed10 comp rx=0 tx=0).stop 2024-09-13T16:02:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.059+0000 7f1c51800640 1 -- 172.21.15.70:0/3311401458 shutdown_connections 2024-09-13T16:02:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.059+0000 7f1c51800640 1 --2- 172.21.15.70:0/3311401458 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f1c2c06ac00 0x7f1c2c06d0c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.059+0000 7f1c51800640 1 --2- 172.21.15.70:0/3311401458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c4c15ca90 0x7f1c4c0c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.059+0000 7f1c51800640 1 --2- 172.21.15.70:0/3311401458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c4c0cda80 0x7f1c4c149c40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.059+0000 7f1c51800640 1 --2- 172.21.15.70:0/3311401458 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c4c0b2d90 0x7f1c4c1efbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.059+0000 7f1c51800640 1 -- 172.21.15.70:0/3311401458 >> 172.21.15.70:0/3311401458 conn(0x7f1c4c08bf90 msgr2=0x7f1c4c08c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.059+0000 7f1c51800640 1 -- 172.21.15.70:0/3311401458 shutdown_connections 2024-09-13T16:02:02.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.059+0000 7f1c51800640 1 -- 172.21.15.70:0/3311401458 wait complete. 2024-09-13T16:02:02.075 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-13T16:02:02.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:02.075 DEBUG:teuthology.orchestra.run.smithi107:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-13T16:02:02.141 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2024-09-13T16:02:02.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:02.142 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T16:02:02.181 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T16:02:02.181 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:02:02.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.335+0000 7fb06be00640 1 Processor -- start 2024-09-13T16:02:02.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.335+0000 7fb06be00640 1 -- start start 2024-09-13T16:02:02.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.336+0000 7fb06be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb06415a520 0x7fb06406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:02.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.336+0000 7fb06be00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb0640ce020 0x7fb06415a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:02.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.336+0000 7fb06be00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06406bc00 con 0x7fb0640b1b00 2024-09-13T16:02:02.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.336+0000 7fb06be00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06406bea0 con 0x7fb0640ce020 2024-09-13T16:02:02.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.336+0000 7fb06be00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06406c180 con 0x7fb06415a520 2024-09-13T16:02:02.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.337+0000 7fb069400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb06415a520 0x7fb06406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:02.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.337+0000 7fb068a00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fb0640b1b00 0x7fb0640cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:48060/0 (socket says 172.21.15.70:48060) 2024-09-13T16:02:02.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.337+0000 7fb068a00640 1 -- 172.21.15.70:0/1759371390 learned_addr learned my addr 172.21.15.70:0/1759371390 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:02.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.337+0000 7fb069e00640 1 --2- 172.21.15.70:0/1759371390 >> v2:172.21.15.107:3300/0 conn(0x7fb0640ce020 0x7fb06415a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:02.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.337+0000 7fb069400640 1 -- 172.21.15.70:0/1759371390 >> v2:172.21.15.107:3300/0 conn(0x7fb0640ce020 msgr2=0x7fb06415a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:02.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.337+0000 7fb069400640 1 --2- 172.21.15.70:0/1759371390 >> v2:172.21.15.107:3300/0 conn(0x7fb0640ce020 0x7fb06415a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.337+0000 7fb069400640 1 -- 172.21.15.70:0/1759371390 >> v1:172.21.15.107:6789/0 conn(0x7fb0640b1b00 legacy=0x7fb0640cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:02.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.337+0000 7fb069400640 1 -- 172.21.15.70:0/1759371390 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06406c460 con 0x7fb06415a520 2024-09-13T16:02:02.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.338+0000 7fb069400640 1 --2- 172.21.15.70:0/1759371390 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb06415a520 0x7fb06406b6c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb0580097a0 tx=0x7fb05802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52a659dd8413ade7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:02.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.339+0000 7fb063e00640 1 -- 172.21.15.70:0/1759371390 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058032440 con 0x7fb06415a520 2024-09-13T16:02:02.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.339+0000 7fb063e00640 1 -- 172.21.15.70:0/1759371390 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0580325a0 con 0x7fb06415a520 2024-09-13T16:02:02.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.339+0000 7fb063e00640 1 -- 172.21.15.70:0/1759371390 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058032930 con 0x7fb06415a520 2024-09-13T16:02:02.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.339+0000 7fb06be00640 1 -- 172.21.15.70:0/1759371390 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb06415a520 msgr2=0x7fb06406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:02.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.339+0000 7fb06be00640 1 --2- 172.21.15.70:0/1759371390 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb06415a520 0x7fb06406b6c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb0580097a0 tx=0x7fb05802a180 comp rx=0 tx=0).stop 2024-09-13T16:02:02.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.339+0000 7fb06be00640 1 -- 172.21.15.70:0/1759371390 shutdown_connections 2024-09-13T16:02:02.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.339+0000 7fb06be00640 1 --2- 172.21.15.70:0/1759371390 >> v2:172.21.15.107:3300/0 conn(0x7fb0640ce020 0x7fb06415a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.339+0000 7fb06be00640 1 --2- 172.21.15.70:0/1759371390 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb06415a520 0x7fb06406b6c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.339+0000 7fb06be00640 1 -- 172.21.15.70:0/1759371390 >> 172.21.15.70:0/1759371390 conn(0x7fb0640b0510 msgr2=0x7fb0640b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:02.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.339+0000 7fb06be00640 1 -- 172.21.15.70:0/1759371390 shutdown_connections 2024-09-13T16:02:02.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.339+0000 7fb06be00640 1 -- 172.21.15.70:0/1759371390 wait complete. 2024-09-13T16:02:02.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.341+0000 7fb06be00640 1 Processor -- start 2024-09-13T16:02:02.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.341+0000 7fb06be00640 1 -- start start 2024-09-13T16:02:02.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.342+0000 7fb06be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0640b1b00 0x7fb064154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:02.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.342+0000 7fb06be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb0640ce020 0x7fb064150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:02.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.342+0000 7fb06be00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb06415a520 0x7fb0640ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:02.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.342+0000 7fb06be00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb064152780 con 0x7fb06415a520 2024-09-13T16:02:02.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.342+0000 7fb06be00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb064152a60 con 0x7fb0640b1b00 2024-09-13T16:02:02.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.342+0000 7fb06be00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb064152d40 con 0x7fb0640ce020 2024-09-13T16:02:02.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.342+0000 7fb069400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0640b1b00 0x7fb064154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:02.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.342+0000 7fb069e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb06415a520 0x7fb0640ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:02.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.342+0000 7fb069400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0640b1b00 0x7fb064154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.70:39766/0 (socket says 172.21.15.70:39766) 2024-09-13T16:02:02.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.342+0000 7fb069400640 1 -- 172.21.15.70:0/2531462904 learned_addr learned my addr 172.21.15.70:0/2531462904 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:02.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.343+0000 7fb068a00640 1 --2- 172.21.15.70:0/2531462904 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb0640ce020 0x7fb064150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:02.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.343+0000 7fb069400640 1 -- 172.21.15.70:0/2531462904 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb0640ce020 msgr2=0x7fb064150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:02.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.343+0000 7fb069400640 1 --2- 172.21.15.70:0/2531462904 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb0640ce020 0x7fb064150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.343+0000 7fb069400640 1 -- 172.21.15.70:0/2531462904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb06415a520 msgr2=0x7fb0640ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:02.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.343+0000 7fb069400640 1 --2- 172.21.15.70:0/2531462904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb06415a520 0x7fb0640ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.343+0000 7fb069400640 1 -- 172.21.15.70:0/2531462904 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb058009400 con 0x7fb0640b1b00 2024-09-13T16:02:02.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.343+0000 7fb069e00640 1 --2- 172.21.15.70:0/2531462904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb06415a520 0x7fb0640ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:02.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.343+0000 7fb069400640 1 --2- 172.21.15.70:0/2531462904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0640b1b00 0x7fb064154080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb058000c00 tx=0x7fb0580046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:02.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.344+0000 7fb061600640 1 -- 172.21.15.70:0/2531462904 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058030b80 con 0x7fb0640b1b00 2024-09-13T16:02:02.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.344+0000 7fb061600640 1 -- 172.21.15.70:0/2531462904 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb058032e90 con 0x7fb0640b1b00 2024-09-13T16:02:02.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.344+0000 7fb06be00640 1 -- 172.21.15.70:0/2531462904 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb064153020 con 0x7fb0640b1b00 2024-09-13T16:02:02.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.344+0000 7fb061600640 1 -- 172.21.15.70:0/2531462904 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058006e10 con 0x7fb0640b1b00 2024-09-13T16:02:02.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.344+0000 7fb06be00640 1 -- 172.21.15.70:0/2531462904 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0641545c0 con 0x7fb0640b1b00 2024-09-13T16:02:02.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.345+0000 7fb06be00640 1 -- 172.21.15.70:0/2531462904 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06415a900 con 0x7fb0640b1b00 2024-09-13T16:02:02.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.346+0000 7fb061600640 1 -- 172.21.15.70:0/2531462904 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb058039040 con 0x7fb0640b1b00 2024-09-13T16:02:02.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.346+0000 7fb061600640 1 --2- 172.21.15.70:0/2531462904 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb04406ac00 0x7fb04406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:02.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.347+0000 7fb061600640 1 -- 172.21.15.70:0/2531462904 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb0580a9d80 con 0x7fb0640b1b00 2024-09-13T16:02:02.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.347+0000 7fb068a00640 1 --2- 172.21.15.70:0/2531462904 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb04406ac00 0x7fb04406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:02.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.347+0000 7fb068a00640 1 --2- 172.21.15.70:0/2531462904 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb04406ac00 0x7fb04406d0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb0640adb60 tx=0x7fb050009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:02.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.351+0000 7fb061600640 1 -- 172.21.15.70:0/2531462904 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb058074ef0 con 0x7fb0640b1b00 2024-09-13T16:02:02.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.565+0000 7fb06be00640 1 -- 172.21.15.70:0/2531462904 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb064159080 con 0x7fb0640b1b00 2024-09-13T16:02:02.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.566+0000 7fb061600640 1 -- 172.21.15.70:0/2531462904 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4728 (secure 0 0 0) 0x7fb058041090 con 0x7fb0640b1b00 2024-09-13T16:02:02.567 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:02.567 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2852595148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2852595148},{"type":"v1","addr":"172.21.15.107:6834","nonce":2852595148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2578992914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2578992914},{"type":"v1","addr":"172.21.15.70:6835","nonce":2578992914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/927553867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":927553867},{"type":"v1","addr":"172.21.15.70:6837","nonce":927553867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:01:18.592735+0000","modified":"2024-09-13T16:01:21.606407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6835/712016246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":712016246},{"type":"v1","addr":"172.21.15.107:6835","nonce":712016246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:02:02.568 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2024-09-13T16:02:02.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.568+0000 7fb06be00640 1 -- 172.21.15.70:0/2531462904 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb04406ac00 msgr2=0x7fb04406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:02.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.568+0000 7fb06be00640 1 --2- 172.21.15.70:0/2531462904 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb04406ac00 0x7fb04406d0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb0640adb60 tx=0x7fb050009040 comp rx=0 tx=0).stop 2024-09-13T16:02:02.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.568+0000 7fb06be00640 1 -- 172.21.15.70:0/2531462904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0640b1b00 msgr2=0x7fb064154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:02.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.568+0000 7fb06be00640 1 --2- 172.21.15.70:0/2531462904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0640b1b00 0x7fb064154080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb058000c00 tx=0x7fb0580046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.568+0000 7fb06be00640 1 -- 172.21.15.70:0/2531462904 shutdown_connections 2024-09-13T16:02:02.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.568+0000 7fb06be00640 1 --2- 172.21.15.70:0/2531462904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb06415a520 0x7fb0640ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.568+0000 7fb06be00640 1 --2- 172.21.15.70:0/2531462904 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb0640ce020 0x7fb064150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.568+0000 7fb06be00640 1 --2- 172.21.15.70:0/2531462904 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb04406ac00 0x7fb04406d0c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.568+0000 7fb06be00640 1 --2- 172.21.15.70:0/2531462904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0640b1b00 0x7fb064154080 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.568+0000 7fb06be00640 1 -- 172.21.15.70:0/2531462904 >> 172.21.15.70:0/2531462904 conn(0x7fb0640b0510 msgr2=0x7fb064157840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:02.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.569+0000 7fb06be00640 1 -- 172.21.15.70:0/2531462904 shutdown_connections 2024-09-13T16:02:02.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.569+0000 7fb06be00640 1 -- 172.21.15.70:0/2531462904 wait complete. 2024-09-13T16:02:02.585 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:02:02.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.745+0000 7f89e3a00640 1 Processor -- start 2024-09-13T16:02:02.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.745+0000 7f89e3a00640 1 -- start start 2024-09-13T16:02:02.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.746+0000 7f89e3a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89dc15a520 0x7f89dc06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:02.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.746+0000 7f89e3a00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc06bc00 con 0x7f89dc0b1b00 2024-09-13T16:02:02.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.746+0000 7f89e3a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc06bea0 con 0x7f89dc0ce020 2024-09-13T16:02:02.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.746+0000 7f89e3a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc06c180 con 0x7f89dc15a520 2024-09-13T16:02:02.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.746+0000 7f89d3e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f89dc0b1b00 0x7f89dc0cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41828/0 (socket says 172.21.15.70:41828) 2024-09-13T16:02:02.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.746+0000 7f89d3e00640 1 -- 172.21.15.70:0/1925871646 learned_addr learned my addr 172.21.15.70:0/1925871646 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:02.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.747+0000 7f89e1000640 1 --2- 172.21.15.70:0/1925871646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89dc15a520 0x7f89dc06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:02.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.747+0000 7f89dbe00640 1 -- 172.21.15.70:0/1925871646 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074425104 0 0) 0x7f89dc06bc00 con 0x7f89dc0b1b00 2024-09-13T16:02:02.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.747+0000 7f89dbe00640 1 -- 172.21.15.70:0/1925871646 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89c0003520 con 0x7f89dc0b1b00 2024-09-13T16:02:02.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.747+0000 7f89dbe00640 1 -- 172.21.15.70:0/1925871646 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232836336 0 0) 0x7f89dc06bea0 con 0x7f89dc0ce020 2024-09-13T16:02:02.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.747+0000 7f89e1000640 1 -- 172.21.15.70:0/1925871646 >> v1:172.21.15.107:6789/0 conn(0x7f89dc0ce020 legacy=0x7f89dc15a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:02.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.747+0000 7f89e1000640 1 -- 172.21.15.70:0/1925871646 >> v1:172.21.15.70:6789/0 conn(0x7f89dc0b1b00 legacy=0x7f89dc0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:02.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.747+0000 7f89e1000640 1 -- 172.21.15.70:0/1925871646 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc06c460 con 0x7f89dc15a520 2024-09-13T16:02:02.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.748+0000 7f89e1000640 1 --2- 172.21.15.70:0/1925871646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89dc15a520 0x7f89dc06b6c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0097d0 tx=0x7f89cc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=730f8e40b84c200f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:02.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.748+0000 7f89dbe00640 1 -- 172.21.15.70:0/1925871646 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc032440 con 0x7f89dc15a520 2024-09-13T16:02:02.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.749+0000 7f89dbe00640 1 -- 172.21.15.70:0/1925871646 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc0325a0 con 0x7f89dc15a520 2024-09-13T16:02:02.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.749+0000 7f89dbe00640 1 -- 172.21.15.70:0/1925871646 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc032930 con 0x7f89dc15a520 2024-09-13T16:02:02.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.749+0000 7f89e3a00640 1 -- 172.21.15.70:0/1925871646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89dc15a520 msgr2=0x7f89dc06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:02.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.749+0000 7f89e3a00640 1 --2- 172.21.15.70:0/1925871646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89dc15a520 0x7f89dc06b6c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0097d0 tx=0x7f89cc02a210 comp rx=0 tx=0).stop 2024-09-13T16:02:02.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.749+0000 7f89e3a00640 1 -- 172.21.15.70:0/1925871646 shutdown_connections 2024-09-13T16:02:02.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.749+0000 7f89e3a00640 1 --2- 172.21.15.70:0/1925871646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89dc15a520 0x7f89dc06b6c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.749+0000 7f89e3a00640 1 -- 172.21.15.70:0/1925871646 >> 172.21.15.70:0/1925871646 conn(0x7f89dc0b0510 msgr2=0x7f89dc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:02.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.749+0000 7f89e3a00640 1 -- 172.21.15.70:0/1925871646 shutdown_connections 2024-09-13T16:02:02.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.749+0000 7f89e3a00640 1 -- 172.21.15.70:0/1925871646 wait complete. 2024-09-13T16:02:02.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.751+0000 7f89e3a00640 1 Processor -- start 2024-09-13T16:02:02.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.751+0000 7f89e3a00640 1 -- start start 2024-09-13T16:02:02.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.752+0000 7f89e3a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89dc0b1b00 0x7f89dc1562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:02.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.752+0000 7f89e3a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89dc0ce020 0x7f89dc1f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:02.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.752+0000 7f89e3a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89dc15a520 0x7f89dc0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:02.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.752+0000 7f89e3a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc06f660 con 0x7f89dc0b1b00 2024-09-13T16:02:02.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.752+0000 7f89e3a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc06f8b0 con 0x7f89dc15a520 2024-09-13T16:02:02.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.752+0000 7f89e3a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc06fb90 con 0x7f89dc0ce020 2024-09-13T16:02:02.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.752+0000 7f89e1000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89dc0b1b00 0x7f89dc1562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:02.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.752+0000 7f89e1000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89dc0b1b00 0x7f89dc1562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32788/0 (socket says 172.21.15.70:32788) 2024-09-13T16:02:02.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.752+0000 7f89e1000640 1 -- 172.21.15.70:0/262368266 learned_addr learned my addr 172.21.15.70:0/262368266 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.752+0000 7f89d3e00640 1 --2- 172.21.15.70:0/262368266 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89dc0ce020 0x7f89dc1f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.752+0000 7f89e1a00640 1 --2- 172.21.15.70:0/262368266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89dc15a520 0x7f89dc0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.753+0000 7f89e1000640 1 -- 172.21.15.70:0/262368266 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89dc0ce020 msgr2=0x7f89dc1f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.753+0000 7f89e1000640 1 --2- 172.21.15.70:0/262368266 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89dc0ce020 0x7f89dc1f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.753+0000 7f89e1000640 1 -- 172.21.15.70:0/262368266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89dc15a520 msgr2=0x7f89dc0ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.753+0000 7f89e1000640 1 --2- 172.21.15.70:0/262368266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89dc15a520 0x7f89dc0ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.753+0000 7f89e1000640 1 -- 172.21.15.70:0/262368266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc009400 con 0x7f89dc0b1b00 2024-09-13T16:02:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.753+0000 7f89e1a00640 1 --2- 172.21.15.70:0/262368266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89dc15a520 0x7f89dc0ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.753+0000 7f89e1000640 1 --2- 172.21.15.70:0/262368266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89dc0b1b00 0x7f89dc1562c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0097d0 tx=0x7f89cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:02.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.753+0000 7f89d9600640 1 -- 172.21.15.70:0/262368266 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc032440 con 0x7f89dc0b1b00 2024-09-13T16:02:02.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.753+0000 7f89d9600640 1 -- 172.21.15.70:0/262368266 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc004230 con 0x7f89dc0b1b00 2024-09-13T16:02:02.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.753+0000 7f89e3a00640 1 -- 172.21.15.70:0/262368266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc06fe70 con 0x7f89dc0b1b00 2024-09-13T16:02:02.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.753+0000 7f89d9600640 1 -- 172.21.15.70:0/262368266 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc006e10 con 0x7f89dc0b1b00 2024-09-13T16:02:02.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.754+0000 7f89e3a00640 1 -- 172.21.15.70:0/262368266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc070430 con 0x7f89dc0b1b00 2024-09-13T16:02:02.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.755+0000 7f89e3a00640 1 -- 172.21.15.70:0/262368266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc1e5e90 con 0x7f89dc0b1b00 2024-09-13T16:02:02.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.755+0000 7f89d9600640 1 -- 172.21.15.70:0/262368266 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f89cc030980 con 0x7f89dc0b1b00 2024-09-13T16:02:02.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.756+0000 7f89d9600640 1 --2- 172.21.15.70:0/262368266 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f89b806ac00 0x7f89b806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:02.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.756+0000 7f89d9600640 1 -- 172.21.15.70:0/262368266 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f89cc0aa5f0 con 0x7f89dc0b1b00 2024-09-13T16:02:02.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.757+0000 7f89d3e00640 1 --2- 172.21.15.70:0/262368266 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f89b806ac00 0x7f89b806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:02.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.757+0000 7f89d3e00640 1 --2- 172.21.15.70:0/262368266 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f89b806ac00 0x7f89b806d0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f89dc1581b0 tx=0x7f89c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:02.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.760+0000 7f89d9600640 1 -- 172.21.15.70:0/262368266 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f89cc075750 con 0x7f89dc0b1b00 2024-09-13T16:02:02.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.934+0000 7f89e3a00640 1 -- 172.21.15.70:0/262368266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89dc1e5bb0 con 0x7f89dc0b1b00 2024-09-13T16:02:02.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.935+0000 7f89d9600640 1 -- 172.21.15.70:0/262368266 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16663 (secure 0 0 0) 0x7f89cc078d70 con 0x7f89dc0b1b00 2024-09-13T16:02:02.937 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:02.937 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":22,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:59.137141+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:02:02.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.937+0000 7f89e3a00640 1 -- 172.21.15.70:0/262368266 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f89b806ac00 msgr2=0x7f89b806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:02.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.937+0000 7f89e3a00640 1 --2- 172.21.15.70:0/262368266 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f89b806ac00 0x7f89b806d0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f89dc1581b0 tx=0x7f89c4009040 comp rx=0 tx=0).stop 2024-09-13T16:02:02.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.937+0000 7f89e3a00640 1 -- 172.21.15.70:0/262368266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89dc0b1b00 msgr2=0x7f89dc1562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:02.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.937+0000 7f89e3a00640 1 --2- 172.21.15.70:0/262368266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89dc0b1b00 0x7f89dc1562c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0097d0 tx=0x7f89cc0046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.937+0000 7f89e3a00640 1 -- 172.21.15.70:0/262368266 shutdown_connections 2024-09-13T16:02:02.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.937+0000 7f89e3a00640 1 --2- 172.21.15.70:0/262368266 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f89b806ac00 0x7f89b806d0c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.937+0000 7f89e3a00640 1 --2- 172.21.15.70:0/262368266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89dc15a520 0x7f89dc0ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.937+0000 7f89e3a00640 1 --2- 172.21.15.70:0/262368266 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89dc0ce020 0x7f89dc1f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.937+0000 7f89e3a00640 1 --2- 172.21.15.70:0/262368266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89dc0b1b00 0x7f89dc1562c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:02.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.937+0000 7f89e3a00640 1 -- 172.21.15.70:0/262368266 >> 172.21.15.70:0/262368266 conn(0x7f89dc0b0510 msgr2=0x7f89dc06a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:02.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.938+0000 7f89e3a00640 1 -- 172.21.15.70:0/262368266 shutdown_connections 2024-09-13T16:02:02.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:02.938+0000 7f89e3a00640 1 -- 172.21.15.70:0/262368266 wait complete. 2024-09-13T16:02:02.956 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:01:06.070694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:01:16.922043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:01:17.580304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:02:02.956 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:02:03.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.114+0000 7f3fcca00640 1 Processor -- start 2024-09-13T16:02:03.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.114+0000 7f3fcca00640 1 -- start start 2024-09-13T16:02:03.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.115+0000 7f3fcca00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3fc815a6d0 0x7f3fc80b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.115+0000 7f3fcca00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc80b23e0 con 0x7f3fc80b0d20 2024-09-13T16:02:03.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.115+0000 7f3fcca00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc806cca0 con 0x7f3fc80cb640 2024-09-13T16:02:03.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.115+0000 7f3fcca00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc806d260 con 0x7f3fc815a6d0 2024-09-13T16:02:03.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.115+0000 7f3fc5e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3fc80b0d20 0x7f3fc806c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41832/0 (socket says 172.21.15.70:41832) 2024-09-13T16:02:03.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.116+0000 7f3fc6800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3fc815a6d0 0x7f3fc80b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.116+0000 7f3fc5e00640 1 -- 172.21.15.70:0/1999709140 learned_addr learned my addr 172.21.15.70:0/1999709140 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:03.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.116+0000 7f3fc6800640 1 -- 172.21.15.70:0/1999709140 >> v1:172.21.15.107:6789/0 conn(0x7f3fc80cb640 legacy=0x7f3fc80b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.116+0000 7f3fc6800640 1 -- 172.21.15.70:0/1999709140 >> v1:172.21.15.70:6789/0 conn(0x7f3fc80b0d20 legacy=0x7f3fc806c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.116+0000 7f3fc6800640 1 -- 172.21.15.70:0/1999709140 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc806cf80 con 0x7f3fc815a6d0 2024-09-13T16:02:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.117+0000 7f3fc6800640 1 --2- 172.21.15.70:0/1999709140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fc815a6d0 0x7f3fc80b1ea0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80097a0 tx=0x7f3fb802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2093a844f9fcdad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.117+0000 7f3fc5400640 1 -- 172.21.15.70:0/1999709140 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8032440 con 0x7f3fc815a6d0 2024-09-13T16:02:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.117+0000 7f3fc5400640 1 -- 172.21.15.70:0/1999709140 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb80325a0 con 0x7f3fc815a6d0 2024-09-13T16:02:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.117+0000 7f3fc5400640 1 -- 172.21.15.70:0/1999709140 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8032930 con 0x7f3fc815a6d0 2024-09-13T16:02:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.118+0000 7f3fcca00640 1 -- 172.21.15.70:0/1999709140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fc815a6d0 msgr2=0x7f3fc80b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.118+0000 7f3fcca00640 1 --2- 172.21.15.70:0/1999709140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fc815a6d0 0x7f3fc80b1ea0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80097a0 tx=0x7f3fb802a1a0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.118+0000 7f3fcca00640 1 -- 172.21.15.70:0/1999709140 shutdown_connections 2024-09-13T16:02:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.118+0000 7f3fcca00640 1 --2- 172.21.15.70:0/1999709140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fc815a6d0 0x7f3fc80b1ea0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.118+0000 7f3fcca00640 1 -- 172.21.15.70:0/1999709140 >> 172.21.15.70:0/1999709140 conn(0x7f3fc80b0200 msgr2=0x7f3fc80b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:03.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.118+0000 7f3fcca00640 1 -- 172.21.15.70:0/1999709140 shutdown_connections 2024-09-13T16:02:03.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.118+0000 7f3fcca00640 1 -- 172.21.15.70:0/1999709140 wait complete. 2024-09-13T16:02:03.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.120+0000 7f3fcca00640 1 Processor -- start 2024-09-13T16:02:03.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.120+0000 7f3fcca00640 1 -- start start 2024-09-13T16:02:03.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.121+0000 7f3fcca00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fc80b0d20 0x7f3fc815c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.121+0000 7f3fcca00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fc80cb640 0x7f3fc8154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.121+0000 7f3fcca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fc815a6d0 0x7f3fc8153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.121+0000 7f3fcca00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc8156920 con 0x7f3fc80cb640 2024-09-13T16:02:03.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.121+0000 7f3fcca00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc8155320 con 0x7f3fc815a6d0 2024-09-13T16:02:03.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.121+0000 7f3fcca00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc8154a80 con 0x7f3fc80b0d20 2024-09-13T16:02:03.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.121+0000 7f3fc5e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fc80cb640 0x7f3fc8154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.121+0000 7f3fc5e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fc80cb640 0x7f3fc8154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32806/0 (socket says 172.21.15.70:32806) 2024-09-13T16:02:03.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.121+0000 7f3fc5e00640 1 -- 172.21.15.70:0/3729782998 learned_addr learned my addr 172.21.15.70:0/3729782998 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:03.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.121+0000 7f3fc6800640 1 --2- 172.21.15.70:0/3729782998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fc80b0d20 0x7f3fc815c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.121+0000 7f3fc7200640 1 --2- 172.21.15.70:0/3729782998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fc815a6d0 0x7f3fc8153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.121+0000 7f3fc6800640 1 -- 172.21.15.70:0/3729782998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fc815a6d0 msgr2=0x7f3fc8153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.121+0000 7f3fc6800640 1 --2- 172.21.15.70:0/3729782998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fc815a6d0 0x7f3fc8153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.122+0000 7f3fc6800640 1 -- 172.21.15.70:0/3729782998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fc80cb640 msgr2=0x7f3fc8154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.122+0000 7f3fc6800640 1 --2- 172.21.15.70:0/3729782998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fc80cb640 0x7f3fc8154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.122+0000 7f3fc6800640 1 -- 172.21.15.70:0/3729782998 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb8009400 con 0x7f3fc80b0d20 2024-09-13T16:02:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.122+0000 7f3fc5e00640 1 --2- 172.21.15.70:0/3729782998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fc80cb640 0x7f3fc8154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.122+0000 7f3fc6800640 1 --2- 172.21.15.70:0/3729782998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fc80b0d20 0x7f3fc815c330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8031000 tx=0x7f3fb80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.122+0000 7f3fbea00640 1 -- 172.21.15.70:0/3729782998 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8030b00 con 0x7f3fc80b0d20 2024-09-13T16:02:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.122+0000 7f3fbea00640 1 -- 172.21.15.70:0/3729782998 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb8030c80 con 0x7f3fc80b0d20 2024-09-13T16:02:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.122+0000 7f3fbea00640 1 -- 172.21.15.70:0/3729782998 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb803d420 con 0x7f3fc80b0d20 2024-09-13T16:02:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.122+0000 7f3fcca00640 1 -- 172.21.15.70:0/3729782998 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc8154d60 con 0x7f3fc80b0d20 2024-09-13T16:02:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.122+0000 7f3fcca00640 1 -- 172.21.15.70:0/3729782998 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc80c39a0 con 0x7f3fc80b0d20 2024-09-13T16:02:03.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.123+0000 7f3fcca00640 1 -- 172.21.15.70:0/3729782998 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc8156a60 con 0x7f3fc80b0d20 2024-09-13T16:02:03.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.125+0000 7f3fbea00640 1 -- 172.21.15.70:0/3729782998 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3fb8039040 con 0x7f3fc80b0d20 2024-09-13T16:02:03.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.126+0000 7f3fbea00640 1 --2- 172.21.15.70:0/3729782998 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f3fa806ac00 0x7f3fa806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.126+0000 7f3fbea00640 1 -- 172.21.15.70:0/3729782998 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3fb80a9d20 con 0x7f3fc80b0d20 2024-09-13T16:02:03.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.126+0000 7f3fc5e00640 1 --2- 172.21.15.70:0/3729782998 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f3fa806ac00 0x7f3fa806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.127+0000 7f3fc5e00640 1 --2- 172.21.15.70:0/3729782998 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f3fa806ac00 0x7f3fa806d0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3fc80ad530 tx=0x7f3fb4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:03.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.129+0000 7f3fbea00640 1 -- 172.21.15.70:0/3729782998 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3fb80751c0 con 0x7f3fc80b0d20 2024-09-13T16:02:03.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.306+0000 7f3fcca00640 1 -- 172.21.15.70:0/3729782998 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3fc80c3b30 con 0x7f3fc80b0d20 2024-09-13T16:02:03.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.306+0000 7f3fbea00640 1 -- 172.21.15.70:0/3729782998 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3fb80787e0 con 0x7f3fc80b0d20 2024-09-13T16:02:03.308 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-13T16:02:03.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.309+0000 7f3fcca00640 1 -- 172.21.15.70:0/3729782998 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f3fa806ac00 msgr2=0x7f3fa806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.309+0000 7f3fcca00640 1 --2- 172.21.15.70:0/3729782998 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f3fa806ac00 0x7f3fa806d0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3fc80ad530 tx=0x7f3fb4009040 comp rx=0 tx=0).stop 2024-09-13T16:02:03.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.309+0000 7f3fcca00640 1 -- 172.21.15.70:0/3729782998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fc80b0d20 msgr2=0x7f3fc815c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.309+0000 7f3fcca00640 1 --2- 172.21.15.70:0/3729782998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fc80b0d20 0x7f3fc815c330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8031000 tx=0x7f3fb80046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.309+0000 7f3fcca00640 1 -- 172.21.15.70:0/3729782998 shutdown_connections 2024-09-13T16:02:03.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.309+0000 7f3fcca00640 1 --2- 172.21.15.70:0/3729782998 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f3fa806ac00 0x7f3fa806d0c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.309+0000 7f3fcca00640 1 --2- 172.21.15.70:0/3729782998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fc815a6d0 0x7f3fc8153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.309+0000 7f3fcca00640 1 --2- 172.21.15.70:0/3729782998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fc80cb640 0x7f3fc8154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.309+0000 7f3fcca00640 1 --2- 172.21.15.70:0/3729782998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fc80b0d20 0x7f3fc815c330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.309+0000 7f3fcca00640 1 -- 172.21.15.70:0/3729782998 >> 172.21.15.70:0/3729782998 conn(0x7f3fc80b0200 msgr2=0x7f3fc81599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:03.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.309+0000 7f3fcca00640 1 -- 172.21.15.70:0/3729782998 shutdown_connections 2024-09-13T16:02:03.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.309+0000 7f3fcca00640 1 -- 172.21.15.70:0/3729782998 wait complete. 2024-09-13T16:02:03.328 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:02:03.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.483+0000 7f50bca00640 1 Processor -- start 2024-09-13T16:02:03.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.483+0000 7f50bca00640 1 -- start start 2024-09-13T16:02:03.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.484+0000 7f50bca00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f50b815ca40 0x7f50b80d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.484+0000 7f50bca00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f50b80d1b90 0x7f50b80d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.484+0000 7f50bca00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b80d06e0 con 0x7f50b80ccf20 2024-09-13T16:02:03.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.484+0000 7f50bca00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b80b1ce0 con 0x7f50b815ca40 2024-09-13T16:02:03.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.484+0000 7f50bca00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b80d2510 con 0x7f50b80d1b90 2024-09-13T16:02:03.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.485+0000 7f50b6800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f50b815ca40 0x7f50b80d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.485+0000 7f50b7200640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f50b80ccf20 0x7f50b806bd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41842/0 (socket says 172.21.15.70:41842) 2024-09-13T16:02:03.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.485+0000 7f50b7200640 1 -- 172.21.15.70:0/463601572 learned_addr learned my addr 172.21.15.70:0/463601572 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:03.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.485+0000 7f50afe00640 1 --2- 172.21.15.70:0/463601572 >> v2:172.21.15.107:3300/0 conn(0x7f50b80d1b90 0x7f50b80d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.485+0000 7f50b6800640 1 -- 172.21.15.70:0/463601572 >> v2:172.21.15.107:3300/0 conn(0x7f50b80d1b90 msgr2=0x7f50b80d1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:03.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.485+0000 7f50b6800640 1 --2- 172.21.15.70:0/463601572 >> v2:172.21.15.107:3300/0 conn(0x7f50b80d1b90 0x7f50b80d1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.485+0000 7f50b6800640 1 -- 172.21.15.70:0/463601572 >> v1:172.21.15.70:6789/0 conn(0x7f50b80ccf20 legacy=0x7f50b806bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.485+0000 7f50b6800640 1 -- 172.21.15.70:0/463601572 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b80cdb30 con 0x7f50b815ca40 2024-09-13T16:02:03.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.485+0000 7f50b5e00640 1 -- 172.21.15.70:0/463601572 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681492029 0 0) 0x7f50b80d06e0 con 0x7f50b80ccf20 2024-09-13T16:02:03.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.486+0000 7f50b6800640 1 --2- 172.21.15.70:0/463601572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b815ca40 0x7f50b80d1410 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f50b80cec50 tx=0x7f50a802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb4890ba45495cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:03.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.486+0000 7f50b5e00640 1 -- 172.21.15.70:0/463601572 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a802ae60 con 0x7f50b815ca40 2024-09-13T16:02:03.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.486+0000 7f50b5e00640 1 -- 172.21.15.70:0/463601572 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a8032440 con 0x7f50b815ca40 2024-09-13T16:02:03.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.486+0000 7f50b5e00640 1 -- 172.21.15.70:0/463601572 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a80327d0 con 0x7f50b815ca40 2024-09-13T16:02:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.487+0000 7f50bca00640 1 -- 172.21.15.70:0/463601572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b815ca40 msgr2=0x7f50b80d1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.487+0000 7f50bca00640 1 --2- 172.21.15.70:0/463601572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b815ca40 0x7f50b80d1410 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f50b80cec50 tx=0x7f50a802a110 comp rx=0 tx=0).stop 2024-09-13T16:02:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.487+0000 7f50bca00640 1 -- 172.21.15.70:0/463601572 shutdown_connections 2024-09-13T16:02:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.487+0000 7f50bca00640 1 --2- 172.21.15.70:0/463601572 >> v2:172.21.15.107:3300/0 conn(0x7f50b80d1b90 0x7f50b80d1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.487+0000 7f50bca00640 1 --2- 172.21.15.70:0/463601572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b815ca40 0x7f50b80d1410 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.487+0000 7f50bca00640 1 -- 172.21.15.70:0/463601572 >> 172.21.15.70:0/463601572 conn(0x7f50b80cf560 msgr2=0x7f50b80cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.487+0000 7f50bca00640 1 -- 172.21.15.70:0/463601572 shutdown_connections 2024-09-13T16:02:03.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.487+0000 7f50bca00640 1 -- 172.21.15.70:0/463601572 wait complete. 2024-09-13T16:02:03.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.489+0000 7f50bca00640 1 Processor -- start 2024-09-13T16:02:03.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.489+0000 7f50bca00640 1 -- start start 2024-09-13T16:02:03.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.490+0000 7f50bca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50b80ccf20 0x7f50b8157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.490+0000 7f50bca00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b80d1b90 0x7f50b814c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.490+0000 7f50bca00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50b815ca40 0x7f50b80b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.490+0000 7f50bca00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b814cea0 con 0x7f50b80d1b90 2024-09-13T16:02:03.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.490+0000 7f50bca00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b815de70 con 0x7f50b80ccf20 2024-09-13T16:02:03.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.490+0000 7f50bca00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b815e150 con 0x7f50b815ca40 2024-09-13T16:02:03.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.490+0000 7f50afe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b80d1b90 0x7f50b814c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.490+0000 7f50afe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b80d1b90 0x7f50b814c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32818/0 (socket says 172.21.15.70:32818) 2024-09-13T16:02:03.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.490+0000 7f50afe00640 1 -- 172.21.15.70:0/2012370912 learned_addr learned my addr 172.21.15.70:0/2012370912 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:03.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.490+0000 7f50b6800640 1 --2- 172.21.15.70:0/2012370912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50b80ccf20 0x7f50b8157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.490+0000 7f50b7200640 1 --2- 172.21.15.70:0/2012370912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50b815ca40 0x7f50b80b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.490+0000 7f50afe00640 1 -- 172.21.15.70:0/2012370912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50b815ca40 msgr2=0x7f50b80b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.490+0000 7f50afe00640 1 --2- 172.21.15.70:0/2012370912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50b815ca40 0x7f50b80b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.490+0000 7f50afe00640 1 -- 172.21.15.70:0/2012370912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50b80ccf20 msgr2=0x7f50b8157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.490+0000 7f50afe00640 1 --2- 172.21.15.70:0/2012370912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50b80ccf20 0x7f50b8157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.490+0000 7f50afe00640 1 -- 172.21.15.70:0/2012370912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a8009400 con 0x7f50b80d1b90 2024-09-13T16:02:03.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.490+0000 7f50b6800640 1 --2- 172.21.15.70:0/2012370912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50b80ccf20 0x7f50b8157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:03.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.490+0000 7f50b7200640 1 --2- 172.21.15.70:0/2012370912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50b815ca40 0x7f50b80b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:03.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.491+0000 7f50afe00640 1 --2- 172.21.15.70:0/2012370912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b80d1b90 0x7f50b814c960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f50a000d7d0 tx=0x7f50a000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:03.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.491+0000 7f50aea00640 1 -- 172.21.15.70:0/2012370912 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a0018070 con 0x7f50b80d1b90 2024-09-13T16:02:03.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.491+0000 7f50aea00640 1 -- 172.21.15.70:0/2012370912 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a0004020 con 0x7f50b80d1b90 2024-09-13T16:02:03.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.491+0000 7f50bca00640 1 -- 172.21.15.70:0/2012370912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b815e430 con 0x7f50b80d1b90 2024-09-13T16:02:03.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.491+0000 7f50aea00640 1 -- 172.21.15.70:0/2012370912 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a00041b0 con 0x7f50b80d1b90 2024-09-13T16:02:03.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.491+0000 7f50bca00640 1 -- 172.21.15.70:0/2012370912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b815e9f0 con 0x7f50b80d1b90 2024-09-13T16:02:03.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.492+0000 7f50bca00640 1 -- 172.21.15.70:0/2012370912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b80cd700 con 0x7f50b80d1b90 2024-09-13T16:02:03.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.494+0000 7f50aea00640 1 -- 172.21.15.70:0/2012370912 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f50a0004310 con 0x7f50b80d1b90 2024-09-13T16:02:03.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.495+0000 7f50aea00640 1 --2- 172.21.15.70:0/2012370912 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f509406ac00 0x7f509406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.495+0000 7f50aea00640 1 -- 172.21.15.70:0/2012370912 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f50a00892c0 con 0x7f50b80d1b90 2024-09-13T16:02:03.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.495+0000 7f50b6800640 1 --2- 172.21.15.70:0/2012370912 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f509406ac00 0x7f509406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.496+0000 7f50b6800640 1 --2- 172.21.15.70:0/2012370912 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f509406ac00 0x7f509406d0c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f50a8034000 tx=0x7f50a802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:03.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.500+0000 7f50aea00640 1 -- 172.21.15.70:0/2012370912 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f50a0054410 con 0x7f50b80d1b90 2024-09-13T16:02:03.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.673+0000 7f50bca00640 1 -- 172.21.15.70:0/2012370912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f50b80b8640 con 0x7f50b80d1b90 2024-09-13T16:02:03.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.674+0000 7f50aea00640 1 -- 172.21.15.70:0/2012370912 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f50a0057a30 con 0x7f50b80d1b90 2024-09-13T16:02:03.675 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-13T16:02:03.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.676+0000 7f50bca00640 1 -- 172.21.15.70:0/2012370912 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f509406ac00 msgr2=0x7f509406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.676+0000 7f50bca00640 1 --2- 172.21.15.70:0/2012370912 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f509406ac00 0x7f509406d0c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f50a8034000 tx=0x7f50a802e000 comp rx=0 tx=0).stop 2024-09-13T16:02:03.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.676+0000 7f50bca00640 1 -- 172.21.15.70:0/2012370912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b80d1b90 msgr2=0x7f50b814c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.676+0000 7f50bca00640 1 --2- 172.21.15.70:0/2012370912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b80d1b90 0x7f50b814c960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f50a000d7d0 tx=0x7f50a000dc90 comp rx=0 tx=0).stop 2024-09-13T16:02:03.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.676+0000 7f50bca00640 1 -- 172.21.15.70:0/2012370912 shutdown_connections 2024-09-13T16:02:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.676+0000 7f50bca00640 1 --2- 172.21.15.70:0/2012370912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50b815ca40 0x7f50b80b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.676+0000 7f50bca00640 1 --2- 172.21.15.70:0/2012370912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b80d1b90 0x7f50b814c960 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.676+0000 7f50bca00640 1 --2- 172.21.15.70:0/2012370912 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f509406ac00 0x7f509406d0c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.676+0000 7f50bca00640 1 --2- 172.21.15.70:0/2012370912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50b80ccf20 0x7f50b8157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.676+0000 7f50bca00640 1 -- 172.21.15.70:0/2012370912 >> 172.21.15.70:0/2012370912 conn(0x7f50b80cf560 msgr2=0x7f50b80b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.676+0000 7f50bca00640 1 -- 172.21.15.70:0/2012370912 shutdown_connections 2024-09-13T16:02:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.676+0000 7f50bca00640 1 -- 172.21.15.70:0/2012370912 wait complete. 2024-09-13T16:02:03.693 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:02:03.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.846+0000 7fce4e600640 1 Processor -- start 2024-09-13T16:02:03.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.846+0000 7fce4e600640 1 -- start start 2024-09-13T16:02:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.847+0000 7fce4e600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce480cafa0 0x7fce4815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.847+0000 7fce4e600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4806f5f0 con 0x7fce48071690 2024-09-13T16:02:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.848+0000 7fce4e600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce48070450 con 0x7fce48156f60 2024-09-13T16:02:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.848+0000 7fce4e600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4815aa30 con 0x7fce480cafa0 2024-09-13T16:02:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.848+0000 7fce46a00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fce48071690 0x7fce480cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41858/0 (socket says 172.21.15.70:41858) 2024-09-13T16:02:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.848+0000 7fce46a00640 1 -- 172.21.15.70:0/2860664647 learned_addr learned my addr 172.21.15.70:0/2860664647 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:03.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.848+0000 7fce47e00640 1 --2- 172.21.15.70:0/2860664647 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce480cafa0 0x7fce4815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.848+0000 7fce46000640 1 -- 172.21.15.70:0/2860664647 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453731537 0 0) 0x7fce4806f5f0 con 0x7fce48071690 2024-09-13T16:02:03.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.848+0000 7fce46000640 1 -- 172.21.15.70:0/2860664647 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce2c003520 con 0x7fce48071690 2024-09-13T16:02:03.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46000640 1 -- 172.21.15.70:0/2860664647 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 561903160 0 0) 0x7fce2c003520 con 0x7fce48071690 2024-09-13T16:02:03.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46000640 1 -- 172.21.15.70:0/2860664647 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce480cafa0 msgr2=0x7fce4815a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:03.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46000640 1 --2- 172.21.15.70:0/2860664647 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce480cafa0 0x7fce4815a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46000640 1 -- 172.21.15.70:0/2860664647 >> v1:172.21.15.107:6789/0 conn(0x7fce48156f60 legacy=0x7fce48070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46000640 1 -- 172.21.15.70:0/2860664647 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4806f840 con 0x7fce48071690 2024-09-13T16:02:03.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46000640 1 -- 172.21.15.70:0/2860664647 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7fce34001670 con 0x7fce48071690 2024-09-13T16:02:03.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46000640 1 -- 172.21.15.70:0/2860664647 >> v1:172.21.15.70:6789/0 conn(0x7fce48071690 legacy=0x7fce480cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46000640 1 --2- 172.21.15.70:0/2860664647 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce480cafa0 0x7fce2c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46000640 1 --2- 172.21.15.70:0/2860664647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce2c003ee0 0x7fce2c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46000640 1 --2- 172.21.15.70:0/2860664647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce2c004d00 0x7fce2c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46000640 1 -- 172.21.15.70:0/2860664647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4815aa30 con 0x7fce2c003ee0 2024-09-13T16:02:03.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46000640 1 -- 172.21.15.70:0/2860664647 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c00b9e0 con 0x7fce2c004d00 2024-09-13T16:02:03.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46000640 1 -- 172.21.15.70:0/2860664647 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c00ddb0 con 0x7fce480cafa0 2024-09-13T16:02:03.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46a00640 1 --2- 172.21.15.70:0/2860664647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce2c003ee0 0x7fce2c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce47400640 1 --2- 172.21.15.70:0/2860664647 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce480cafa0 0x7fce2c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce47e00640 1 --2- 172.21.15.70:0/2860664647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce2c004d00 0x7fce2c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46a00640 1 -- 172.21.15.70:0/2860664647 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce480cafa0 msgr2=0x7fce2c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:03.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46a00640 1 --2- 172.21.15.70:0/2860664647 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce480cafa0 0x7fce2c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46a00640 1 -- 172.21.15.70:0/2860664647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce2c004d00 msgr2=0x7fce2c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:03.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46a00640 1 --2- 172.21.15.70:0/2860664647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce2c004d00 0x7fce2c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce46a00640 1 -- 172.21.15.70:0/2860664647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c003520 con 0x7fce2c003ee0 2024-09-13T16:02:03.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.849+0000 7fce47e00640 1 --2- 172.21.15.70:0/2860664647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce2c004d00 0x7fce2c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:03.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.850+0000 7fce46a00640 1 --2- 172.21.15.70:0/2860664647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce2c003ee0 0x7fce2c0047c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fce3400c210 tx=0x7fce2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d934bf4c4726e0e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:03.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.851+0000 7fce46000640 1 -- 172.21.15.70:0/2860664647 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34005ad0 con 0x7fce2c003ee0 2024-09-13T16:02:03.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.851+0000 7fce46000640 1 -- 172.21.15.70:0/2860664647 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3402d070 con 0x7fce2c003ee0 2024-09-13T16:02:03.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.851+0000 7fce46000640 1 -- 172.21.15.70:0/2860664647 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34007070 con 0x7fce2c003ee0 2024-09-13T16:02:03.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.851+0000 7fce4e600640 1 -- 172.21.15.70:0/2860664647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce2c003ee0 msgr2=0x7fce2c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.851+0000 7fce4e600640 1 --2- 172.21.15.70:0/2860664647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce2c003ee0 0x7fce2c0047c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fce3400c210 tx=0x7fce2c0057f0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.851+0000 7fce47e00640 1 -- 172.21.15.70:0/2860664647 reap_dead start 2024-09-13T16:02:03.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.851+0000 7fce4e600640 1 -- 172.21.15.70:0/2860664647 shutdown_connections 2024-09-13T16:02:03.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.851+0000 7fce4e600640 1 -- 172.21.15.70:0/2860664647 >> 172.21.15.70:0/2860664647 conn(0x7fce480b0580 msgr2=0x7fce480b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:03.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.851+0000 7fce4e600640 1 -- 172.21.15.70:0/2860664647 shutdown_connections 2024-09-13T16:02:03.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.851+0000 7fce4e600640 1 -- 172.21.15.70:0/2860664647 wait complete. 2024-09-13T16:02:03.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.853+0000 7fce4e600640 1 Processor -- start 2024-09-13T16:02:03.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.853+0000 7fce4e600640 1 -- start start 2024-09-13T16:02:03.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.854+0000 7fce4e600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce2c003ee0 0x7fce481445f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.854+0000 7fce4e600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce48144b30 0x7fce481f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.854+0000 7fce4e600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce481f2390 0x7fce48150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.854+0000 7fce4e600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce481f29c0 con 0x7fce481f2390 2024-09-13T16:02:03.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.854+0000 7fce4e600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce481f2ca0 con 0x7fce2c003ee0 2024-09-13T16:02:03.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.854+0000 7fce4e600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce48154b20 con 0x7fce48144b30 2024-09-13T16:02:03.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.854+0000 7fce47e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce481f2390 0x7fce48150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.854+0000 7fce47e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce481f2390 0x7fce48150a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32836/0 (socket says 172.21.15.70:32836) 2024-09-13T16:02:03.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.854+0000 7fce47e00640 1 -- 172.21.15.70:0/4244968397 learned_addr learned my addr 172.21.15.70:0/4244968397 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.854+0000 7fce46a00640 1 --2- 172.21.15.70:0/4244968397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce48144b30 0x7fce481f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.854+0000 7fce47400640 1 --2- 172.21.15.70:0/4244968397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce2c003ee0 0x7fce481445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.855+0000 7fce47e00640 1 -- 172.21.15.70:0/4244968397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce48144b30 msgr2=0x7fce481f1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.855+0000 7fce47e00640 1 --2- 172.21.15.70:0/4244968397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce48144b30 0x7fce481f1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.855+0000 7fce47e00640 1 -- 172.21.15.70:0/4244968397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce2c003ee0 msgr2=0x7fce481445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.855+0000 7fce47e00640 1 --2- 172.21.15.70:0/4244968397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce2c003ee0 0x7fce481445f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.855+0000 7fce47e00640 1 -- 172.21.15.70:0/4244968397 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce48154e00 con 0x7fce481f2390 2024-09-13T16:02:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.855+0000 7fce47e00640 1 --2- 172.21.15.70:0/4244968397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce481f2390 0x7fce48150a60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fce480cb3a0 tx=0x7fce40009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.855+0000 7fce3f400640 1 -- 172.21.15.70:0/4244968397 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000e030 con 0x7fce481f2390 2024-09-13T16:02:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.855+0000 7fce3f400640 1 -- 172.21.15.70:0/4244968397 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce40011e60 con 0x7fce481f2390 2024-09-13T16:02:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.855+0000 7fce4e600640 1 -- 172.21.15.70:0/4244968397 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce48154740 con 0x7fce481f2390 2024-09-13T16:02:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.855+0000 7fce3f400640 1 -- 172.21.15.70:0/4244968397 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce400166b0 con 0x7fce481f2390 2024-09-13T16:02:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.855+0000 7fce4e600640 1 -- 172.21.15.70:0/4244968397 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce48151180 con 0x7fce481f2390 2024-09-13T16:02:03.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.856+0000 7fce4e600640 1 -- 172.21.15.70:0/4244968397 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce48157340 con 0x7fce481f2390 2024-09-13T16:02:03.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.857+0000 7fce3f400640 1 -- 172.21.15.70:0/4244968397 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fce40016810 con 0x7fce481f2390 2024-09-13T16:02:03.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.858+0000 7fce3f400640 1 --2- 172.21.15.70:0/4244968397 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fce2806ac30 0x7fce2806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.858+0000 7fce3f400640 1 -- 172.21.15.70:0/4244968397 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fce4000f070 con 0x7fce481f2390 2024-09-13T16:02:03.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.858+0000 7fce47400640 1 --2- 172.21.15.70:0/4244968397 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fce2806ac30 0x7fce2806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.859+0000 7fce47400640 1 --2- 172.21.15.70:0/4244968397 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fce2806ac30 0x7fce2806d0f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce38001910 tx=0x7fce38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:03.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:03.862+0000 7fce3f400640 1 -- 172.21.15.70:0/4244968397 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fce40054dd0 con 0x7fce481f2390 2024-09-13T16:02:04.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.031+0000 7fce4e600640 1 -- 172.21.15.70:0/4244968397 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fce480b0c20 con 0x7fce481f2390 2024-09-13T16:02:04.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.032+0000 7fce3f400640 1 -- 172.21.15.70:0/4244968397 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fce400583f0 con 0x7fce481f2390 2024-09-13T16:02:04.033 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-13T16:02:04.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.034+0000 7fce4e600640 1 -- 172.21.15.70:0/4244968397 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fce2806ac30 msgr2=0x7fce2806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.034+0000 7fce4e600640 1 --2- 172.21.15.70:0/4244968397 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fce2806ac30 0x7fce2806d0f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce38001910 tx=0x7fce38009040 comp rx=0 tx=0).stop 2024-09-13T16:02:04.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.034+0000 7fce4e600640 1 -- 172.21.15.70:0/4244968397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce481f2390 msgr2=0x7fce48150a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.034+0000 7fce4e600640 1 --2- 172.21.15.70:0/4244968397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce481f2390 0x7fce48150a60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fce480cb3a0 tx=0x7fce40009f90 comp rx=0 tx=0).stop 2024-09-13T16:02:04.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.034+0000 7fce4e600640 1 -- 172.21.15.70:0/4244968397 shutdown_connections 2024-09-13T16:02:04.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.034+0000 7fce4e600640 1 --2- 172.21.15.70:0/4244968397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce481f2390 0x7fce48150a60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.034+0000 7fce4e600640 1 --2- 172.21.15.70:0/4244968397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce48144b30 0x7fce481f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.034+0000 7fce4e600640 1 --2- 172.21.15.70:0/4244968397 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fce2806ac30 0x7fce2806d0f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.034+0000 7fce4e600640 1 --2- 172.21.15.70:0/4244968397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce2c003ee0 0x7fce481445f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.034+0000 7fce4e600640 1 -- 172.21.15.70:0/4244968397 >> 172.21.15.70:0/4244968397 conn(0x7fce480b0580 msgr2=0x7fce4815a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:04.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.034+0000 7fce4e600640 1 -- 172.21.15.70:0/4244968397 shutdown_connections 2024-09-13T16:02:04.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.034+0000 7fce4e600640 1 -- 172.21.15.70:0/4244968397 wait complete. 2024-09-13T16:02:04.051 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:02:04.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.203+0000 7f7478e00640 1 Processor -- start 2024-09-13T16:02:04.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.203+0000 7f7478e00640 1 -- start start 2024-09-13T16:02:04.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.204+0000 7f7478e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f747406cae0 0x7f747406d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:04.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.204+0000 7f7478e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74740cbc70 0x7f747415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:04.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.204+0000 7f7478e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747415b750 con 0x7f7474158370 2024-09-13T16:02:04.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.204+0000 7f7478e00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747415ac10 con 0x7f747406cae0 2024-09-13T16:02:04.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.204+0000 7f7478e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747415bbe0 con 0x7f74740cbc70 2024-09-13T16:02:04.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.205+0000 7f7471400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f747406cae0 0x7f747406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:04.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.205+0000 7f7471400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f747406cae0 0x7f747406d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32842/0 (socket says 172.21.15.70:32842) 2024-09-13T16:02:04.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.205+0000 7f7471400640 1 -- 172.21.15.70:0/4225425593 learned_addr learned my addr 172.21.15.70:0/4225425593 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:04.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.205+0000 7f7472800640 1 --2- 172.21.15.70:0/4225425593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74740cbc70 0x7f747415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:04.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.205+0000 7f7471400640 1 -- 172.21.15.70:0/4225425593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74740cbc70 msgr2=0x7f747415bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:04.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.205+0000 7f7471400640 1 --2- 172.21.15.70:0/4225425593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74740cbc70 0x7f747415bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.205+0000 7f7471400640 1 -- 172.21.15.70:0/4225425593 >> v1:172.21.15.107:6789/0 conn(0x7f7474158370 legacy=0x7f747406c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.205+0000 7f7471400640 1 -- 172.21.15.70:0/4225425593 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74740cc3e0 con 0x7f747406cae0 2024-09-13T16:02:04.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.206+0000 7f7471400640 1 --2- 172.21.15.70:0/4225425593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f747406cae0 0x7f747406d480 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7460009870 tx=0x7f746002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7ec759f2ac71b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:04.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.206+0000 7f7470a00640 1 -- 172.21.15.70:0/4225425593 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460032440 con 0x7f747406cae0 2024-09-13T16:02:04.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.206+0000 7f7470a00640 1 -- 172.21.15.70:0/4225425593 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74600325a0 con 0x7f747406cae0 2024-09-13T16:02:04.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.206+0000 7f7470a00640 1 -- 172.21.15.70:0/4225425593 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460032930 con 0x7f747406cae0 2024-09-13T16:02:04.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.207+0000 7f7478e00640 1 -- 172.21.15.70:0/4225425593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f747406cae0 msgr2=0x7f747406d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.207+0000 7f7478e00640 1 --2- 172.21.15.70:0/4225425593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f747406cae0 0x7f747406d480 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7460009870 tx=0x7f746002a1c0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.207+0000 7f7478e00640 1 -- 172.21.15.70:0/4225425593 shutdown_connections 2024-09-13T16:02:04.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.207+0000 7f7478e00640 1 --2- 172.21.15.70:0/4225425593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74740cbc70 0x7f747415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.207+0000 7f7478e00640 1 --2- 172.21.15.70:0/4225425593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f747406cae0 0x7f747406d480 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.207+0000 7f7478e00640 1 -- 172.21.15.70:0/4225425593 >> 172.21.15.70:0/4225425593 conn(0x7f7474069ed0 msgr2=0x7f747406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:04.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.207+0000 7f7478e00640 1 -- 172.21.15.70:0/4225425593 shutdown_connections 2024-09-13T16:02:04.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.207+0000 7f7478e00640 1 -- 172.21.15.70:0/4225425593 wait complete. 2024-09-13T16:02:04.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.209+0000 7f7478e00640 1 Processor -- start 2024-09-13T16:02:04.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.209+0000 7f7478e00640 1 -- start start 2024-09-13T16:02:04.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.210+0000 7f7478e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f747406cae0 0x7f7474152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.210+0000 7f7478e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74740cbc70 0x7f7474150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.210+0000 7f7478e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7474158370 0x7f7474151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.210+0000 7f7478e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7474152300 con 0x7f74740cbc70 2024-09-13T16:02:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.210+0000 7f7478e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7474151680 con 0x7f7474158370 2024-09-13T16:02:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.210+0000 7f7478e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7474151960 con 0x7f747406cae0 2024-09-13T16:02:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.210+0000 7f7471400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74740cbc70 0x7f7474150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.210+0000 7f7471400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74740cbc70 0x7f7474150b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32848/0 (socket says 172.21.15.70:32848) 2024-09-13T16:02:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.210+0000 7f7471400640 1 -- 172.21.15.70:0/1165311537 learned_addr learned my addr 172.21.15.70:0/1165311537 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.210+0000 7f7472800640 1 --2- 172.21.15.70:0/1165311537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7474158370 0x7f7474151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.210+0000 7f7471e00640 1 --2- 172.21.15.70:0/1165311537 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f747406cae0 0x7f7474152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.210+0000 7f7471400640 1 -- 172.21.15.70:0/1165311537 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f747406cae0 msgr2=0x7f7474152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.210+0000 7f7471400640 1 --2- 172.21.15.70:0/1165311537 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f747406cae0 0x7f7474152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.210+0000 7f7471400640 1 -- 172.21.15.70:0/1165311537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7474158370 msgr2=0x7f7474151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.210+0000 7f7471400640 1 --2- 172.21.15.70:0/1165311537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7474158370 0x7f7474151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.210+0000 7f7471400640 1 -- 172.21.15.70:0/1165311537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74600094d0 con 0x7f74740cbc70 2024-09-13T16:02:04.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.211+0000 7f7471400640 1 --2- 172.21.15.70:0/1165311537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74740cbc70 0x7f7474150b10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7460000c00 tx=0x7f74600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.211+0000 7f746a000640 1 -- 172.21.15.70:0/1165311537 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460032440 con 0x7f74740cbc70 2024-09-13T16:02:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.211+0000 7f746a000640 1 -- 172.21.15.70:0/1165311537 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7460030980 con 0x7f74740cbc70 2024-09-13T16:02:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.211+0000 7f746a000640 1 -- 172.21.15.70:0/1165311537 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460030d30 con 0x7f74740cbc70 2024-09-13T16:02:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.211+0000 7f7478e00640 1 -- 172.21.15.70:0/1165311537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7474151c40 con 0x7f74740cbc70 2024-09-13T16:02:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.211+0000 7f7478e00640 1 -- 172.21.15.70:0/1165311537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747415d070 con 0x7f74740cbc70 2024-09-13T16:02:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.212+0000 7f7478e00640 1 -- 172.21.15.70:0/1165311537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7474151aa0 con 0x7f74740cbc70 2024-09-13T16:02:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.213+0000 7f746a000640 1 -- 172.21.15.70:0/1165311537 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7460039040 con 0x7f74740cbc70 2024-09-13T16:02:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.214+0000 7f746a000640 1 --2- 172.21.15.70:0/1165311537 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f745406ac00 0x7f745406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.214+0000 7f746a000640 1 -- 172.21.15.70:0/1165311537 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f74600a9c80 con 0x7f74740cbc70 2024-09-13T16:02:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.214+0000 7f7471e00640 1 --2- 172.21.15.70:0/1165311537 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f745406ac00 0x7f745406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:04.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.215+0000 7f7471e00640 1 --2- 172.21.15.70:0/1165311537 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f745406ac00 0x7f745406d0c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7464000f60 tx=0x7f7464009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:04.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.218+0000 7f746a000640 1 -- 172.21.15.70:0/1165311537 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7474151aa0 con 0x7f74740cbc70 2024-09-13T16:02:04.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.420+0000 7f7478e00640 1 -- 172.21.15.70:0/1165311537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7474151aa0 con 0x7f74740cbc70 2024-09-13T16:02:04.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.421+0000 7f746a000640 1 -- 172.21.15.70:0/1165311537 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4728 (secure 0 0 0) 0x7f7474151aa0 con 0x7f74740cbc70 2024-09-13T16:02:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:04.423 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2852595148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2852595148},{"type":"v1","addr":"172.21.15.107:6834","nonce":2852595148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2578992914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2578992914},{"type":"v1","addr":"172.21.15.70:6835","nonce":2578992914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/927553867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":927553867},{"type":"v1","addr":"172.21.15.70:6837","nonce":927553867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:01:18.592735+0000","modified":"2024-09-13T16:01:21.606407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6835/712016246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":712016246},{"type":"v1","addr":"172.21.15.107:6835","nonce":712016246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:02:04.423 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2024-09-13T16:02:04.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.423+0000 7f7478e00640 1 -- 172.21.15.70:0/1165311537 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f745406ac00 msgr2=0x7f745406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.423+0000 7f7478e00640 1 --2- 172.21.15.70:0/1165311537 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f745406ac00 0x7f745406d0c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7464000f60 tx=0x7f7464009040 comp rx=0 tx=0).stop 2024-09-13T16:02:04.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.423+0000 7f7478e00640 1 -- 172.21.15.70:0/1165311537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74740cbc70 msgr2=0x7f7474150b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.423+0000 7f7478e00640 1 --2- 172.21.15.70:0/1165311537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74740cbc70 0x7f7474150b10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7460000c00 tx=0x7f74600046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.423+0000 7f7478e00640 1 -- 172.21.15.70:0/1165311537 shutdown_connections 2024-09-13T16:02:04.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.423+0000 7f7478e00640 1 --2- 172.21.15.70:0/1165311537 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f745406ac00 0x7f745406d0c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.423+0000 7f7478e00640 1 --2- 172.21.15.70:0/1165311537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7474158370 0x7f7474151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.423+0000 7f7478e00640 1 --2- 172.21.15.70:0/1165311537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74740cbc70 0x7f7474150b10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.423+0000 7f7478e00640 1 --2- 172.21.15.70:0/1165311537 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f747406cae0 0x7f7474152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.423+0000 7f7478e00640 1 -- 172.21.15.70:0/1165311537 >> 172.21.15.70:0/1165311537 conn(0x7f7474069ed0 msgr2=0x7f7474156e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:04.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.423+0000 7f7478e00640 1 -- 172.21.15.70:0/1165311537 shutdown_connections 2024-09-13T16:02:04.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.424+0000 7f7478e00640 1 -- 172.21.15.70:0/1165311537 wait complete. 2024-09-13T16:02:04.440 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:02:04.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.592+0000 7f643b200640 1 Processor -- start 2024-09-13T16:02:04.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.592+0000 7f643b200640 1 -- start start 2024-09-13T16:02:04.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.593+0000 7f643b200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f643c071560 0x7f643c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:04.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.593+0000 7f643b200640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643c0cd850 con 0x7f643c06f4b0 2024-09-13T16:02:04.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.593+0000 7f643b200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643c0cd570 con 0x7f643c159480 2024-09-13T16:02:04.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.593+0000 7f643b200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643c0b1740 con 0x7f643c071560 2024-09-13T16:02:04.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.593+0000 7f6439400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f643c071560 0x7f643c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:04.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.593+0000 7f643a800640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f643c06f4b0 0x7f643c0b2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41860/0 (socket says 172.21.15.70:41860) 2024-09-13T16:02:04.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.593+0000 7f643a800640 1 -- 172.21.15.70:0/178246907 learned_addr learned my addr 172.21.15.70:0/178246907 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:04.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.594+0000 7f6439400640 1 -- 172.21.15.70:0/178246907 >> v1:172.21.15.107:6789/0 conn(0x7f643c159480 legacy=0x7f643c070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.594+0000 7f6439400640 1 -- 172.21.15.70:0/178246907 >> v1:172.21.15.70:6789/0 conn(0x7f643c06f4b0 legacy=0x7f643c0b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.594+0000 7f6439400640 1 -- 172.21.15.70:0/178246907 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c0b1a20 con 0x7f643c071560 2024-09-13T16:02:04.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.594+0000 7f6438a00640 1 -- 172.21.15.70:0/178246907 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934096448 0 0) 0x7f643c0cd850 con 0x7f643c06f4b0 2024-09-13T16:02:04.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.595+0000 7f6439400640 1 --2- 172.21.15.70:0/178246907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f643c071560 0x7f643c0ccf90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f64280097a0 tx=0x7f642802c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd97ab776a9886b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:04.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.595+0000 7f6438a00640 1 -- 172.21.15.70:0/178246907 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428034640 con 0x7f643c071560 2024-09-13T16:02:04.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.595+0000 7f6438a00640 1 -- 172.21.15.70:0/178246907 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64280347a0 con 0x7f643c071560 2024-09-13T16:02:04.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.595+0000 7f6438a00640 1 -- 172.21.15.70:0/178246907 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428034b30 con 0x7f643c071560 2024-09-13T16:02:04.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.595+0000 7f643b200640 1 -- 172.21.15.70:0/178246907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f643c071560 msgr2=0x7f643c0ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.595+0000 7f643b200640 1 --2- 172.21.15.70:0/178246907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f643c071560 0x7f643c0ccf90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f64280097a0 tx=0x7f642802c3b0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.596+0000 7f643b200640 1 -- 172.21.15.70:0/178246907 shutdown_connections 2024-09-13T16:02:04.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.596+0000 7f643b200640 1 --2- 172.21.15.70:0/178246907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f643c071560 0x7f643c0ccf90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.596+0000 7f643b200640 1 -- 172.21.15.70:0/178246907 >> 172.21.15.70:0/178246907 conn(0x7f643c0ae310 msgr2=0x7f643c0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:04.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.596+0000 7f643b200640 1 -- 172.21.15.70:0/178246907 shutdown_connections 2024-09-13T16:02:04.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.596+0000 7f643b200640 1 -- 172.21.15.70:0/178246907 wait complete. 2024-09-13T16:02:04.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.597+0000 7f643b200640 1 Processor -- start 2024-09-13T16:02:04.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.597+0000 7f643b200640 1 -- start start 2024-09-13T16:02:04.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.598+0000 7f643b200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f643c06f4b0 0x7f643c15b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:04.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.598+0000 7f643b200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f643c071560 0x7f643c06c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:04.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.598+0000 7f643b200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f643c159480 0x7f643c1531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:04.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.598+0000 7f643b200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c15a7e0 con 0x7f643c06f4b0 2024-09-13T16:02:04.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.598+0000 7f643b200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c15aac0 con 0x7f643c071560 2024-09-13T16:02:04.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.598+0000 7f643b200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643c15ada0 con 0x7f643c159480 2024-09-13T16:02:04.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.598+0000 7f6439e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f643c06f4b0 0x7f643c15b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:04.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.598+0000 7f6439e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f643c06f4b0 0x7f643c15b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32866/0 (socket says 172.21.15.70:32866) 2024-09-13T16:02:04.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.598+0000 7f6439e00640 1 -- 172.21.15.70:0/1475077777 learned_addr learned my addr 172.21.15.70:0/1475077777 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:04.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.599+0000 7f6439400640 1 --2- 172.21.15.70:0/1475077777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f643c071560 0x7f643c06c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:04.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.599+0000 7f643a800640 1 --2- 172.21.15.70:0/1475077777 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f643c159480 0x7f643c1531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:04.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.599+0000 7f6439e00640 1 -- 172.21.15.70:0/1475077777 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f643c159480 msgr2=0x7f643c1531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.599+0000 7f6439e00640 1 --2- 172.21.15.70:0/1475077777 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f643c159480 0x7f643c1531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.599+0000 7f6439e00640 1 -- 172.21.15.70:0/1475077777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f643c071560 msgr2=0x7f643c06c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.599+0000 7f6439e00640 1 --2- 172.21.15.70:0/1475077777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f643c071560 0x7f643c06c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.599+0000 7f6439e00640 1 -- 172.21.15.70:0/1475077777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6428009400 con 0x7f643c06f4b0 2024-09-13T16:02:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.599+0000 7f6439e00640 1 --2- 172.21.15.70:0/1475077777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f643c06f4b0 0x7f643c15b880 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f642c00c400 tx=0x7f642c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.599+0000 7f6432000640 1 -- 172.21.15.70:0/1475077777 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c0052d0 con 0x7f643c06f4b0 2024-09-13T16:02:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.599+0000 7f6432000640 1 -- 172.21.15.70:0/1475077777 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c005430 con 0x7f643c06f4b0 2024-09-13T16:02:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.599+0000 7f6432000640 1 -- 172.21.15.70:0/1475077777 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c003830 con 0x7f643c06f4b0 2024-09-13T16:02:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.599+0000 7f643b200640 1 -- 172.21.15.70:0/1475077777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643c15b080 con 0x7f643c06f4b0 2024-09-13T16:02:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.600+0000 7f643b200640 1 -- 172.21.15.70:0/1475077777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643c15bdc0 con 0x7f643c06f4b0 2024-09-13T16:02:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.601+0000 7f643b200640 1 -- 172.21.15.70:0/1475077777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f643c067360 con 0x7f643c06f4b0 2024-09-13T16:02:04.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.602+0000 7f6432000640 1 -- 172.21.15.70:0/1475077777 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f642c003990 con 0x7f643c06f4b0 2024-09-13T16:02:04.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.602+0000 7f6432000640 1 --2- 172.21.15.70:0/1475077777 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f641c06ac00 0x7f641c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:04.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.602+0000 7f6432000640 1 -- 172.21.15.70:0/1475077777 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f642c088a00 con 0x7f643c06f4b0 2024-09-13T16:02:04.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.603+0000 7f6439400640 1 --2- 172.21.15.70:0/1475077777 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f641c06ac00 0x7f641c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:04.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.603+0000 7f6439400640 1 --2- 172.21.15.70:0/1475077777 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f641c06ac00 0x7f641c06d0c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6428036000 tx=0x7f6428030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:04.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.606+0000 7f6432000640 1 -- 172.21.15.70:0/1475077777 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f642c053af0 con 0x7f643c06f4b0 2024-09-13T16:02:04.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.774+0000 7f643b200640 1 -- 172.21.15.70:0/1475077777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f643c15b5a0 con 0x7f643c06f4b0 2024-09-13T16:02:04.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.776+0000 7f6432000640 1 -- 172.21.15.70:0/1475077777 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16663 (secure 0 0 0) 0x7f642c057110 con 0x7f643c06f4b0 2024-09-13T16:02:04.777 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:04.777 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":22,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:59.137141+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:02:04.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.778+0000 7f643b200640 1 -- 172.21.15.70:0/1475077777 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f641c06ac00 msgr2=0x7f641c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.778+0000 7f643b200640 1 --2- 172.21.15.70:0/1475077777 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f641c06ac00 0x7f641c06d0c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6428036000 tx=0x7f6428030000 comp rx=0 tx=0).stop 2024-09-13T16:02:04.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.778+0000 7f643b200640 1 -- 172.21.15.70:0/1475077777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f643c06f4b0 msgr2=0x7f643c15b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.778+0000 7f643b200640 1 --2- 172.21.15.70:0/1475077777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f643c06f4b0 0x7f643c15b880 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f642c00c400 tx=0x7f642c00c8c0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.778+0000 7f643b200640 1 -- 172.21.15.70:0/1475077777 shutdown_connections 2024-09-13T16:02:04.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.778+0000 7f643b200640 1 --2- 172.21.15.70:0/1475077777 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f643c159480 0x7f643c1531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.778+0000 7f643b200640 1 --2- 172.21.15.70:0/1475077777 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f641c06ac00 0x7f641c06d0c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.778+0000 7f643b200640 1 --2- 172.21.15.70:0/1475077777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f643c071560 0x7f643c06c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.778+0000 7f643b200640 1 --2- 172.21.15.70:0/1475077777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f643c06f4b0 0x7f643c15b880 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.778+0000 7f643b200640 1 -- 172.21.15.70:0/1475077777 >> 172.21.15.70:0/1475077777 conn(0x7f643c0ae310 msgr2=0x7f643c154a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:04.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.778+0000 7f643b200640 1 -- 172.21.15.70:0/1475077777 shutdown_connections 2024-09-13T16:02:04.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.778+0000 7f643b200640 1 -- 172.21.15.70:0/1475077777 wait complete. 2024-09-13T16:02:04.794 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T16:02:04.795 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:02:04.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.945+0000 7fe8dfa00640 1 Processor -- start 2024-09-13T16:02:04.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.945+0000 7fe8dfa00640 1 -- start start 2024-09-13T16:02:04.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.946+0000 7fe8dfa00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe8d80b3990 0x7fe8d8159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:04.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.946+0000 7fe8dfa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe8d806f660 0x7fe8d806fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:04.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.946+0000 7fe8dfa00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d8159fc0 con 0x7fe8d8153b20 2024-09-13T16:02:04.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.946+0000 7fe8dfa00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d80ce600 con 0x7fe8d80b3990 2024-09-13T16:02:04.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.946+0000 7fe8dfa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d8070f90 con 0x7fe8d806f660 2024-09-13T16:02:04.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.946+0000 7fe8d7e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe8d80b3990 0x7fe8d8159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:04.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.947+0000 7fe8d7e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe8d80b3990 0x7fe8d8159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32870/0 (socket says 172.21.15.70:32870) 2024-09-13T16:02:04.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.947+0000 7fe8dd000640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe8d8153b20 0x7fe8d80b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:48116/0 (socket says 172.21.15.70:48116) 2024-09-13T16:02:04.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.947+0000 7fe8d7e00640 1 -- 172.21.15.70:0/2559201295 learned_addr learned my addr 172.21.15.70:0/2559201295 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:04.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.947+0000 7fe8dda00640 1 --2- 172.21.15.70:0/2559201295 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe8d806f660 0x7fe8d806fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:04.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.947+0000 7fe8d7e00640 1 -- 172.21.15.70:0/2559201295 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe8d806f660 msgr2=0x7fe8d806fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:04.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.947+0000 7fe8d7e00640 1 --2- 172.21.15.70:0/2559201295 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe8d806f660 0x7fe8d806fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.947+0000 7fe8d7e00640 1 -- 172.21.15.70:0/2559201295 >> v1:172.21.15.107:6789/0 conn(0x7fe8d8153b20 legacy=0x7fe8d80b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.947+0000 7fe8d7e00640 1 -- 172.21.15.70:0/2559201295 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d8153f00 con 0x7fe8d80b3990 2024-09-13T16:02:04.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.947+0000 7fe8d7400640 1 -- 172.21.15.70:0/2559201295 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989027007 0 0) 0x7fe8d8159fc0 con 0x7fe8d8153b20 2024-09-13T16:02:04.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.948+0000 7fe8d7e00640 1 --2- 172.21.15.70:0/2559201295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8d80b3990 0x7fe8d8159a80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400bb10 tx=0x7fe8c402c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a694b9b44223342 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:04.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.948+0000 7fe8d7400640 1 -- 172.21.15.70:0/2559201295 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4032820 con 0x7fe8d80b3990 2024-09-13T16:02:04.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.948+0000 7fe8d7400640 1 -- 172.21.15.70:0/2559201295 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c402e040 con 0x7fe8d80b3990 2024-09-13T16:02:04.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.948+0000 7fe8d7400640 1 -- 172.21.15.70:0/2559201295 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4032ba0 con 0x7fe8d80b3990 2024-09-13T16:02:04.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.949+0000 7fe8dfa00640 1 -- 172.21.15.70:0/2559201295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8d80b3990 msgr2=0x7fe8d8159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.949+0000 7fe8dfa00640 1 --2- 172.21.15.70:0/2559201295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8d80b3990 0x7fe8d8159a80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400bb10 tx=0x7fe8c402c920 comp rx=0 tx=0).stop 2024-09-13T16:02:04.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.949+0000 7fe8dfa00640 1 -- 172.21.15.70:0/2559201295 shutdown_connections 2024-09-13T16:02:04.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.949+0000 7fe8dfa00640 1 --2- 172.21.15.70:0/2559201295 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe8d806f660 0x7fe8d806fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.949+0000 7fe8dfa00640 1 --2- 172.21.15.70:0/2559201295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8d80b3990 0x7fe8d8159a80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.949+0000 7fe8dfa00640 1 -- 172.21.15.70:0/2559201295 >> 172.21.15.70:0/2559201295 conn(0x7fe8d80b0510 msgr2=0x7fe8d80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:04.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.949+0000 7fe8dfa00640 1 -- 172.21.15.70:0/2559201295 shutdown_connections 2024-09-13T16:02:04.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.949+0000 7fe8dfa00640 1 -- 172.21.15.70:0/2559201295 wait complete. 2024-09-13T16:02:04.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.951+0000 7fe8dfa00640 1 Processor -- start 2024-09-13T16:02:04.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.951+0000 7fe8dfa00640 1 -- start start 2024-09-13T16:02:04.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.952+0000 7fe8dfa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8d806f660 0x7fe8d8145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:04.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.952+0000 7fe8dfa00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8d80b3990 0x7fe8d80af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:04.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.952+0000 7fe8dfa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe8d8153b20 0x7fe8d80afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:04.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.952+0000 7fe8dfa00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80ad970 con 0x7fe8d80b3990 2024-09-13T16:02:04.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.952+0000 7fe8dfa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80ad4e0 con 0x7fe8d806f660 2024-09-13T16:02:04.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.952+0000 7fe8dfa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80ac910 con 0x7fe8d8153b20 2024-09-13T16:02:04.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.952+0000 7fe8d7e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8d80b3990 0x7fe8d80af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:04.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.952+0000 7fe8d7e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8d80b3990 0x7fe8d80af500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32872/0 (socket says 172.21.15.70:32872) 2024-09-13T16:02:04.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.952+0000 7fe8d7e00640 1 -- 172.21.15.70:0/3203931288 learned_addr learned my addr 172.21.15.70:0/3203931288 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:04.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.952+0000 7fe8dda00640 1 --2- 172.21.15.70:0/3203931288 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe8d8153b20 0x7fe8d80afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:04.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.952+0000 7fe8dd000640 1 --2- 172.21.15.70:0/3203931288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8d806f660 0x7fe8d8145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:04.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.952+0000 7fe8d7e00640 1 -- 172.21.15.70:0/3203931288 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe8d8153b20 msgr2=0x7fe8d80afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.952+0000 7fe8d7e00640 1 --2- 172.21.15.70:0/3203931288 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe8d8153b20 0x7fe8d80afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.952+0000 7fe8d7e00640 1 -- 172.21.15.70:0/3203931288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8d806f660 msgr2=0x7fe8d8145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.952+0000 7fe8d7e00640 1 --2- 172.21.15.70:0/3203931288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8d806f660 0x7fe8d8145020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.952+0000 7fe8d7e00640 1 -- 172.21.15.70:0/3203931288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c400b770 con 0x7fe8d80b3990 2024-09-13T16:02:04.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.952+0000 7fe8dda00640 1 --2- 172.21.15.70:0/3203931288 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe8d8153b20 0x7fe8d80afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:04.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.952+0000 7fe8dd000640 1 --2- 172.21.15.70:0/3203931288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8d806f660 0x7fe8d8145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:04.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.953+0000 7fe8d7e00640 1 --2- 172.21.15.70:0/3203931288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8d80b3990 0x7fe8d80af500 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400b2c0 tx=0x7fe8c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:04.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.953+0000 7fe8d4c00640 1 -- 172.21.15.70:0/3203931288 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4004230 con 0x7fe8d80b3990 2024-09-13T16:02:04.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.953+0000 7fe8d4c00640 1 -- 172.21.15.70:0/3203931288 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c403f070 con 0x7fe8d80b3990 2024-09-13T16:02:04.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.953+0000 7fe8dfa00640 1 -- 172.21.15.70:0/3203931288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d80acbb0 con 0x7fe8d80b3990 2024-09-13T16:02:04.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.953+0000 7fe8d4c00640 1 -- 172.21.15.70:0/3203931288 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c403a780 con 0x7fe8d80b3990 2024-09-13T16:02:04.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.953+0000 7fe8dfa00640 1 -- 172.21.15.70:0/3203931288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d80ad170 con 0x7fe8d80b3990 2024-09-13T16:02:04.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.954+0000 7fe8dfa00640 1 -- 172.21.15.70:0/3203931288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d80ad300 con 0x7fe8d80b3990 2024-09-13T16:02:04.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.955+0000 7fe8d4c00640 1 -- 172.21.15.70:0/3203931288 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe8c403a8e0 con 0x7fe8d80b3990 2024-09-13T16:02:04.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.956+0000 7fe8d4c00640 1 --2- 172.21.15.70:0/3203931288 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe8b806ac00 0x7fe8b806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:04.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.956+0000 7fe8d4c00640 1 -- 172.21.15.70:0/3203931288 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe8c40aa360 con 0x7fe8d80b3990 2024-09-13T16:02:04.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.956+0000 7fe8dd000640 1 --2- 172.21.15.70:0/3203931288 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe8b806ac00 0x7fe8b806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:04.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.956+0000 7fe8dd000640 1 --2- 172.21.15.70:0/3203931288 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe8b806ac00 0x7fe8b806d0c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc000f60 tx=0x7fe8cc007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:04.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:04.960+0000 7fe8d4c00640 1 -- 172.21.15.70:0/3203931288 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe8c40754c0 con 0x7fe8d80b3990 2024-09-13T16:02:05.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.165+0000 7fe8dfa00640 1 -- 172.21.15.70:0/3203931288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8d806fad0 con 0x7fe8d80b3990 2024-09-13T16:02:05.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.166+0000 7fe8d4c00640 1 -- 172.21.15.70:0/3203931288 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4728 (secure 0 0 0) 0x7fe8c4078ae0 con 0x7fe8d80b3990 2024-09-13T16:02:05.167 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:05.167 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2852595148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2852595148},{"type":"v1","addr":"172.21.15.107:6834","nonce":2852595148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2578992914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2578992914},{"type":"v1","addr":"172.21.15.70:6835","nonce":2578992914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/927553867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":927553867},{"type":"v1","addr":"172.21.15.70:6837","nonce":927553867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:01:18.592735+0000","modified":"2024-09-13T16:01:21.606407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6835/712016246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":712016246},{"type":"v1","addr":"172.21.15.107:6835","nonce":712016246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:02:05.167 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2024-09-13T16:02:05.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.169+0000 7fe8dfa00640 1 -- 172.21.15.70:0/3203931288 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe8b806ac00 msgr2=0x7fe8b806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.169+0000 7fe8dfa00640 1 --2- 172.21.15.70:0/3203931288 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe8b806ac00 0x7fe8b806d0c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc000f60 tx=0x7fe8cc007c10 comp rx=0 tx=0).stop 2024-09-13T16:02:05.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.169+0000 7fe8dfa00640 1 -- 172.21.15.70:0/3203931288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8d80b3990 msgr2=0x7fe8d80af500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.169+0000 7fe8dfa00640 1 --2- 172.21.15.70:0/3203931288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8d80b3990 0x7fe8d80af500 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400b2c0 tx=0x7fe8c4004730 comp rx=0 tx=0).stop 2024-09-13T16:02:05.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.169+0000 7fe8dfa00640 1 -- 172.21.15.70:0/3203931288 shutdown_connections 2024-09-13T16:02:05.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.169+0000 7fe8dfa00640 1 --2- 172.21.15.70:0/3203931288 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe8d8153b20 0x7fe8d80afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.169+0000 7fe8dfa00640 1 --2- 172.21.15.70:0/3203931288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8d80b3990 0x7fe8d80af500 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.169+0000 7fe8dfa00640 1 --2- 172.21.15.70:0/3203931288 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe8b806ac00 0x7fe8b806d0c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.169+0000 7fe8dfa00640 1 --2- 172.21.15.70:0/3203931288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8d806f660 0x7fe8d8145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.169+0000 7fe8dfa00640 1 -- 172.21.15.70:0/3203931288 >> 172.21.15.70:0/3203931288 conn(0x7fe8d80b0510 msgr2=0x7fe8d815d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:05.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.169+0000 7fe8dfa00640 1 -- 172.21.15.70:0/3203931288 shutdown_connections 2024-09-13T16:02:05.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.169+0000 7fe8dfa00640 1 -- 172.21.15.70:0/3203931288 wait complete. 2024-09-13T16:02:05.187 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:02:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.336+0000 7f0f72c00640 1 Processor -- start 2024-09-13T16:02:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.336+0000 7f0f72c00640 1 -- start start 2024-09-13T16:02:05.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.337+0000 7f0f72c00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0f6c15fdd0 0x7f0f6c0d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.337+0000 7f0f72c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f6c0d1fd0 0x7f0f6c160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.337+0000 7f0f72c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6c1601b0 con 0x7f0f6c0b1c50 2024-09-13T16:02:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.337+0000 7f0f72c00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6c0cd6a0 con 0x7f0f6c15fdd0 2024-09-13T16:02:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.337+0000 7f0f72c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c0d2400 con 0x7f0f6c0d1fd0 2024-09-13T16:02:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.337+0000 7f0f71800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0f6c15fdd0 0x7f0f6c0d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.337+0000 7f0f71800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0f6c15fdd0 0x7f0f6c0d1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32886/0 (socket says 172.21.15.70:32886) 2024-09-13T16:02:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.337+0000 7f0f71800640 1 -- 172.21.15.70:0/220924014 learned_addr learned my addr 172.21.15.70:0/220924014 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.337+0000 7f0f72200640 1 --2- 172.21.15.70:0/220924014 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f6c0d1fd0 0x7f0f6c160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.338+0000 7f0f71800640 1 -- 172.21.15.70:0/220924014 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f6c0d1fd0 msgr2=0x7f0f6c160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.338+0000 7f0f71800640 1 --2- 172.21.15.70:0/220924014 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f6c0d1fd0 0x7f0f6c160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.338+0000 7f0f71800640 1 -- 172.21.15.70:0/220924014 >> v1:172.21.15.107:6789/0 conn(0x7f0f6c0b1c50 legacy=0x7f0f6c1603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.338+0000 7f0f71800640 1 -- 172.21.15.70:0/220924014 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c0d17e0 con 0x7f0f6c15fdd0 2024-09-13T16:02:05.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.339+0000 7f0f71800640 1 --2- 172.21.15.70:0/220924014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f6c15fdd0 0x7f0f6c0d1a90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009870 tx=0x7f0f6002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf87850cd645821f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:05.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.339+0000 7f0f6be00640 1 -- 172.21.15.70:0/220924014 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f60032440 con 0x7f0f6c15fdd0 2024-09-13T16:02:05.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.339+0000 7f0f6be00640 1 -- 172.21.15.70:0/220924014 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f600325a0 con 0x7f0f6c15fdd0 2024-09-13T16:02:05.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.339+0000 7f0f6be00640 1 -- 172.21.15.70:0/220924014 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f60032930 con 0x7f0f6c15fdd0 2024-09-13T16:02:05.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.339+0000 7f0f72c00640 1 -- 172.21.15.70:0/220924014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f6c15fdd0 msgr2=0x7f0f6c0d1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.339+0000 7f0f72c00640 1 --2- 172.21.15.70:0/220924014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f6c15fdd0 0x7f0f6c0d1a90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009870 tx=0x7f0f6002a1c0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.340+0000 7f0f72c00640 1 -- 172.21.15.70:0/220924014 shutdown_connections 2024-09-13T16:02:05.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.340+0000 7f0f72c00640 1 --2- 172.21.15.70:0/220924014 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f6c0d1fd0 0x7f0f6c160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.340+0000 7f0f72c00640 1 --2- 172.21.15.70:0/220924014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f6c15fdd0 0x7f0f6c0d1a90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.340+0000 7f0f72c00640 1 -- 172.21.15.70:0/220924014 >> 172.21.15.70:0/220924014 conn(0x7f0f6c06a7c0 msgr2=0x7f0f6c06abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:05.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.340+0000 7f0f72c00640 1 -- 172.21.15.70:0/220924014 shutdown_connections 2024-09-13T16:02:05.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.340+0000 7f0f72c00640 1 -- 172.21.15.70:0/220924014 wait complete. 2024-09-13T16:02:05.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.341+0000 7f0f72c00640 1 Processor -- start 2024-09-13T16:02:05.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.341+0000 7f0f72c00640 1 -- start start 2024-09-13T16:02:05.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.342+0000 7f0f72c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f6c0b1c50 0x7f0f6c155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.342+0000 7f0f72c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f6c0d1fd0 0x7f0f6c15c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.342+0000 7f0f72c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f6c15fdd0 0x7f0f6c1f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.342+0000 7f0f72c00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c1579a0 con 0x7f0f6c0b1c50 2024-09-13T16:02:05.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.342+0000 7f0f72c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c157bf0 con 0x7f0f6c0d1fd0 2024-09-13T16:02:05.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.342+0000 7f0f72c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c157ed0 con 0x7f0f6c15fdd0 2024-09-13T16:02:05.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.342+0000 7f0f71800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f6c0b1c50 0x7f0f6c155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.342+0000 7f0f71800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f6c0b1c50 0x7f0f6c155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32900/0 (socket says 172.21.15.70:32900) 2024-09-13T16:02:05.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.342+0000 7f0f71800640 1 -- 172.21.15.70:0/430818552 learned_addr learned my addr 172.21.15.70:0/430818552 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:05.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.343+0000 7f0f72200640 1 --2- 172.21.15.70:0/430818552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f6c15fdd0 0x7f0f6c1f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.343+0000 7f0f70e00640 1 --2- 172.21.15.70:0/430818552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f6c0d1fd0 0x7f0f6c15c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.343+0000 7f0f71800640 1 -- 172.21.15.70:0/430818552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f6c15fdd0 msgr2=0x7f0f6c1f24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.343+0000 7f0f71800640 1 --2- 172.21.15.70:0/430818552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f6c15fdd0 0x7f0f6c1f24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.343+0000 7f0f71800640 1 -- 172.21.15.70:0/430818552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f6c0d1fd0 msgr2=0x7f0f6c15c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.343+0000 7f0f71800640 1 --2- 172.21.15.70:0/430818552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f6c0d1fd0 0x7f0f6c15c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.343+0000 7f0f71800640 1 -- 172.21.15.70:0/430818552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f600094d0 con 0x7f0f6c0b1c50 2024-09-13T16:02:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.343+0000 7f0f70e00640 1 --2- 172.21.15.70:0/430818552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f6c0d1fd0 0x7f0f6c15c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.343+0000 7f0f71800640 1 --2- 172.21.15.70:0/430818552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f6c0b1c50 0x7f0f6c155370 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0f60000c00 tx=0x7f0f600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.343+0000 7f0f69600640 1 -- 172.21.15.70:0/430818552 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f60032440 con 0x7f0f6c0b1c50 2024-09-13T16:02:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.343+0000 7f0f69600640 1 -- 172.21.15.70:0/430818552 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f60030b80 con 0x7f0f6c0b1c50 2024-09-13T16:02:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.343+0000 7f0f72c00640 1 -- 172.21.15.70:0/430818552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6c1581b0 con 0x7f0f6c0b1c50 2024-09-13T16:02:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.343+0000 7f0f69600640 1 -- 172.21.15.70:0/430818552 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6003d440 con 0x7f0f6c0b1c50 2024-09-13T16:02:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.344+0000 7f0f72c00640 1 -- 172.21.15.70:0/430818552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6c158770 con 0x7f0f6c0b1c50 2024-09-13T16:02:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.345+0000 7f0f72c00640 1 -- 172.21.15.70:0/430818552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6c0cd2f0 con 0x7f0f6c0b1c50 2024-09-13T16:02:05.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.345+0000 7f0f69600640 1 -- 172.21.15.70:0/430818552 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0f60039040 con 0x7f0f6c0b1c50 2024-09-13T16:02:05.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.347+0000 7f0f69600640 1 --2- 172.21.15.70:0/430818552 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0f4c06ac00 0x7f0f4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.347+0000 7f0f69600640 1 -- 172.21.15.70:0/430818552 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0f600a9f20 con 0x7f0f6c0b1c50 2024-09-13T16:02:05.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.347+0000 7f0f70e00640 1 --2- 172.21.15.70:0/430818552 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0f4c06ac00 0x7f0f4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.347+0000 7f0f70e00640 1 --2- 172.21.15.70:0/430818552 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0f4c06ac00 0x7f0f4c06d0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0f58000f60 tx=0x7f0f58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:05.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.351+0000 7f0f69600640 1 -- 172.21.15.70:0/430818552 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0f60075070 con 0x7f0f6c0b1c50 2024-09-13T16:02:05.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.553+0000 7f0f72c00640 1 -- 172.21.15.70:0/430818552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f6c0b4d50 con 0x7f0f6c0b1c50 2024-09-13T16:02:05.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.553+0000 7f0f69600640 1 -- 172.21.15.70:0/430818552 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4728 (secure 0 0 0) 0x7f0f60078690 con 0x7f0f6c0b1c50 2024-09-13T16:02:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:05.555 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2852595148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2852595148},{"type":"v1","addr":"172.21.15.107:6834","nonce":2852595148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2578992914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2578992914},{"type":"v1","addr":"172.21.15.70:6835","nonce":2578992914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/927553867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":927553867},{"type":"v1","addr":"172.21.15.70:6837","nonce":927553867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:01:18.592735+0000","modified":"2024-09-13T16:01:21.606407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6835/712016246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":712016246},{"type":"v1","addr":"172.21.15.107:6835","nonce":712016246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:02:05.555 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2024-09-13T16:02:05.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.555+0000 7f0f72c00640 1 -- 172.21.15.70:0/430818552 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0f4c06ac00 msgr2=0x7f0f4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.555+0000 7f0f72c00640 1 --2- 172.21.15.70:0/430818552 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0f4c06ac00 0x7f0f4c06d0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0f58000f60 tx=0x7f0f58009040 comp rx=0 tx=0).stop 2024-09-13T16:02:05.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.555+0000 7f0f72c00640 1 -- 172.21.15.70:0/430818552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f6c0b1c50 msgr2=0x7f0f6c155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.555+0000 7f0f72c00640 1 --2- 172.21.15.70:0/430818552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f6c0b1c50 0x7f0f6c155370 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0f60000c00 tx=0x7f0f600046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.555+0000 7f0f72c00640 1 -- 172.21.15.70:0/430818552 shutdown_connections 2024-09-13T16:02:05.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.555+0000 7f0f72c00640 1 --2- 172.21.15.70:0/430818552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f6c15fdd0 0x7f0f6c1f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.555+0000 7f0f72c00640 1 --2- 172.21.15.70:0/430818552 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f0f4c06ac00 0x7f0f4c06d0c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.555+0000 7f0f72c00640 1 --2- 172.21.15.70:0/430818552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f6c0d1fd0 0x7f0f6c15c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.555+0000 7f0f72c00640 1 --2- 172.21.15.70:0/430818552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f6c0b1c50 0x7f0f6c155370 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.555+0000 7f0f72c00640 1 -- 172.21.15.70:0/430818552 >> 172.21.15.70:0/430818552 conn(0x7f0f6c06a7c0 msgr2=0x7f0f6c15e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:05.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.555+0000 7f0f72c00640 1 -- 172.21.15.70:0/430818552 shutdown_connections 2024-09-13T16:02:05.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.556+0000 7f0f72c00640 1 -- 172.21.15.70:0/430818552 wait complete. 2024-09-13T16:02:05.573 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:02:05.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.723+0000 7f2155e00640 1 Processor -- start 2024-09-13T16:02:05.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.723+0000 7f2155e00640 1 -- start start 2024-09-13T16:02:05.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.724+0000 7f2155e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2150159210 0x7f21500b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.724+0000 7f2155e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f21500b3100 0x7f2150070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.724+0000 7f2155e00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21500b3550 con 0x7f21500b1e40 2024-09-13T16:02:05.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.724+0000 7f2155e00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215015a430 con 0x7f21500b3100 2024-09-13T16:02:05.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.724+0000 7f2155e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21500b2930 con 0x7f2150159210 2024-09-13T16:02:05.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.724+0000 7f214ea00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f21500b1e40 0x7f21500b2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41862/0 (socket says 172.21.15.70:41862) 2024-09-13T16:02:05.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.724+0000 7f214ea00640 1 -- 172.21.15.70:0/3326515951 learned_addr learned my addr 172.21.15.70:0/3326515951 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:05.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.724+0000 7f214f400640 1 --2- 172.21.15.70:0/3326515951 >> v2:172.21.15.70:3300/0 conn(0x7f21500b3100 0x7f2150070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.724+0000 7f214e000640 1 --2- 172.21.15.70:0/3326515951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2150159210 0x7f21500b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.725+0000 7f214d600640 1 -- 172.21.15.70:0/3326515951 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203285752 0 0) 0x7f2140001110 con 0x7f21500b1e40 2024-09-13T16:02:05.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.725+0000 7f214d600640 1 -- 172.21.15.70:0/3326515951 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2134003520 con 0x7f21500b1e40 2024-09-13T16:02:05.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.725+0000 7f214f400640 1 -- 172.21.15.70:0/3326515951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2150159210 msgr2=0x7f21500b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:05.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.725+0000 7f214f400640 1 --2- 172.21.15.70:0/3326515951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2150159210 0x7f21500b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.725+0000 7f214f400640 1 -- 172.21.15.70:0/3326515951 >> v1:172.21.15.70:6789/0 conn(0x7f21500b1e40 legacy=0x7f21500b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.725+0000 7f214f400640 1 -- 172.21.15.70:0/3326515951 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2150159650 con 0x7f21500b3100 2024-09-13T16:02:05.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.726+0000 7f214f400640 1 --2- 172.21.15.70:0/3326515951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21500b3100 0x7f2150070720 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2148009d90 tx=0x7f214802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa398158a234a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:05.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.726+0000 7f214d600640 1 -- 172.21.15.70:0/3326515951 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2148031600 con 0x7f21500b3100 2024-09-13T16:02:05.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.726+0000 7f214d600640 1 -- 172.21.15.70:0/3326515951 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214802d050 con 0x7f21500b3100 2024-09-13T16:02:05.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.726+0000 7f214d600640 1 -- 172.21.15.70:0/3326515951 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2148031960 con 0x7f21500b3100 2024-09-13T16:02:05.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.727+0000 7f2155e00640 1 -- 172.21.15.70:0/3326515951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21500b3100 msgr2=0x7f2150070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.727+0000 7f2155e00640 1 --2- 172.21.15.70:0/3326515951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21500b3100 0x7f2150070720 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2148009d90 tx=0x7f214802a5d0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.727+0000 7f2155e00640 1 -- 172.21.15.70:0/3326515951 shutdown_connections 2024-09-13T16:02:05.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.727+0000 7f2155e00640 1 --2- 172.21.15.70:0/3326515951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21500b3100 0x7f2150070720 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.727+0000 7f2155e00640 1 --2- 172.21.15.70:0/3326515951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2150159210 0x7f21500b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.727+0000 7f2155e00640 1 -- 172.21.15.70:0/3326515951 >> 172.21.15.70:0/3326515951 conn(0x7f21500b0510 msgr2=0x7f21500b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:05.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.727+0000 7f2155e00640 1 -- 172.21.15.70:0/3326515951 shutdown_connections 2024-09-13T16:02:05.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.727+0000 7f2155e00640 1 -- 172.21.15.70:0/3326515951 wait complete. 2024-09-13T16:02:05.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.728+0000 7f2155e00640 1 Processor -- start 2024-09-13T16:02:05.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.728+0000 7f2155e00640 1 -- start start 2024-09-13T16:02:05.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.729+0000 7f2155e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21500b1e40 0x7f215013eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.729+0000 7f2155e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21500b3100 0x7f2150137890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.729+0000 7f2155e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2150159210 0x7f2150158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.729+0000 7f2155e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21501367f0 con 0x7f21500b1e40 2024-09-13T16:02:05.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.729+0000 7f2155e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2150136ad0 con 0x7f2150159210 2024-09-13T16:02:05.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.729+0000 7f2155e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2150136db0 con 0x7f21500b3100 2024-09-13T16:02:05.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.730+0000 7f214ea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21500b1e40 0x7f215013eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.730+0000 7f214ea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21500b1e40 0x7f215013eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32924/0 (socket says 172.21.15.70:32924) 2024-09-13T16:02:05.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.730+0000 7f214ea00640 1 -- 172.21.15.70:0/924011346 learned_addr learned my addr 172.21.15.70:0/924011346 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:05.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.730+0000 7f214e000640 1 --2- 172.21.15.70:0/924011346 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21500b3100 0x7f2150137890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.730+0000 7f214ea00640 1 -- 172.21.15.70:0/924011346 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21500b3100 msgr2=0x7f2150137890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.730+0000 7f214ea00640 1 --2- 172.21.15.70:0/924011346 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21500b3100 0x7f2150137890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.730+0000 7f214f400640 1 --2- 172.21.15.70:0/924011346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2150159210 0x7f2150158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.730+0000 7f214ea00640 1 -- 172.21.15.70:0/924011346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2150159210 msgr2=0x7f2150158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.730+0000 7f214ea00640 1 --2- 172.21.15.70:0/924011346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2150159210 0x7f2150158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.730+0000 7f214ea00640 1 -- 172.21.15.70:0/924011346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2148009a70 con 0x7f21500b1e40 2024-09-13T16:02:05.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.730+0000 7f214e000640 1 --2- 172.21.15.70:0/924011346 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21500b3100 0x7f2150137890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:05.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.730+0000 7f214f400640 1 --2- 172.21.15.70:0/924011346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2150159210 0x7f2150158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:05.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.730+0000 7f214ea00640 1 --2- 172.21.15.70:0/924011346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21500b1e40 0x7f215013eb20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f214000c390 tx=0x7f214000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:05.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.731+0000 7f2147400640 1 -- 172.21.15.70:0/924011346 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140005ce0 con 0x7f21500b1e40 2024-09-13T16:02:05.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.731+0000 7f2147400640 1 -- 172.21.15.70:0/924011346 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2140005e60 con 0x7f21500b1e40 2024-09-13T16:02:05.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.731+0000 7f2147400640 1 -- 172.21.15.70:0/924011346 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140007310 con 0x7f21500b1e40 2024-09-13T16:02:05.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.731+0000 7f2155e00640 1 -- 172.21.15.70:0/924011346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2150137090 con 0x7f21500b1e40 2024-09-13T16:02:05.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.731+0000 7f2155e00640 1 -- 172.21.15.70:0/924011346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21501364a0 con 0x7f21500b1e40 2024-09-13T16:02:05.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.732+0000 7f2155e00640 1 -- 172.21.15.70:0/924011346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21500cdad0 con 0x7f21500b1e40 2024-09-13T16:02:05.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.733+0000 7f2147400640 1 -- 172.21.15.70:0/924011346 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2140007470 con 0x7f21500b1e40 2024-09-13T16:02:05.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.734+0000 7f2147400640 1 --2- 172.21.15.70:0/924011346 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f213006ac00 0x7f213006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.734+0000 7f2147400640 1 -- 172.21.15.70:0/924011346 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2140088850 con 0x7f21500b1e40 2024-09-13T16:02:05.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.734+0000 7f214e000640 1 --2- 172.21.15.70:0/924011346 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f213006ac00 0x7f213006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.735+0000 7f214e000640 1 --2- 172.21.15.70:0/924011346 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f213006ac00 0x7f213006d0c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f21500b2e80 tx=0x7f213c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:05.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.738+0000 7f2147400640 1 -- 172.21.15.70:0/924011346 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f21400539b0 con 0x7f21500b1e40 2024-09-13T16:02:05.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.909+0000 7f2155e00640 1 -- 172.21.15.70:0/924011346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21500b3550 con 0x7f21500b1e40 2024-09-13T16:02:05.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.910+0000 7f2147400640 1 -- 172.21.15.70:0/924011346 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16663 (secure 0 0 0) 0x7f21500b3550 con 0x7f21500b1e40 2024-09-13T16:02:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:05.912 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":22,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:01:59.137141+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:01:16.922043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:01:17.580304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:02:05.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.912+0000 7f2155e00640 1 -- 172.21.15.70:0/924011346 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f213006ac00 msgr2=0x7f213006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.912+0000 7f2155e00640 1 --2- 172.21.15.70:0/924011346 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f213006ac00 0x7f213006d0c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f21500b2e80 tx=0x7f213c008040 comp rx=0 tx=0).stop 2024-09-13T16:02:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.912+0000 7f2155e00640 1 -- 172.21.15.70:0/924011346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21500b1e40 msgr2=0x7f215013eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.912+0000 7f2155e00640 1 --2- 172.21.15.70:0/924011346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21500b1e40 0x7f215013eb20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f214000c390 tx=0x7f214000c850 comp rx=0 tx=0).stop 2024-09-13T16:02:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.912+0000 7f2155e00640 1 -- 172.21.15.70:0/924011346 shutdown_connections 2024-09-13T16:02:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.912+0000 7f2155e00640 1 --2- 172.21.15.70:0/924011346 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f213006ac00 0x7f213006d0c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.912+0000 7f2155e00640 1 --2- 172.21.15.70:0/924011346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2150159210 0x7f2150158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.912+0000 7f2155e00640 1 --2- 172.21.15.70:0/924011346 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21500b3100 0x7f2150137890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.912+0000 7f2155e00640 1 --2- 172.21.15.70:0/924011346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21500b1e40 0x7f215013eb20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.912+0000 7f2155e00640 1 -- 172.21.15.70:0/924011346 >> 172.21.15.70:0/924011346 conn(0x7f21500b0510 msgr2=0x7f21500cca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.912+0000 7f2155e00640 1 -- 172.21.15.70:0/924011346 shutdown_connections 2024-09-13T16:02:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:05.912+0000 7f2155e00640 1 -- 172.21.15.70:0/924011346 wait complete. 2024-09-13T16:02:05.929 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T16:02:06.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.082+0000 7fad4ea00640 1 Processor -- start 2024-09-13T16:02:06.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.082+0000 7fad4ea00640 1 -- start start 2024-09-13T16:02:06.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.083+0000 7fad4ea00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fad48159610 0x7fad48070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:06.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.083+0000 7fad4ea00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad480709e0 con 0x7fad480b3790 2024-09-13T16:02:06.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.083+0000 7fad4ea00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad48070cc0 con 0x7fad48070540 2024-09-13T16:02:06.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.083+0000 7fad4ea00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad481599f0 con 0x7fad48159610 2024-09-13T16:02:06.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.083+0000 7fad47e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fad48159610 0x7fad48070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:06.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.083+0000 7fad4ca00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fad480b3790 0x7fad480cd080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41870/0 (socket says 172.21.15.70:41870) 2024-09-13T16:02:06.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.083+0000 7fad4ca00640 1 -- 172.21.15.70:0/3781252266 learned_addr learned my addr 172.21.15.70:0/3781252266 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:06.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.084+0000 7fad47e00640 1 -- 172.21.15.70:0/3781252266 >> v1:172.21.15.107:6789/0 conn(0x7fad48070540 legacy=0x7fad480b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:06.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.084+0000 7fad47e00640 1 -- 172.21.15.70:0/3781252266 >> v1:172.21.15.70:6789/0 conn(0x7fad480b3790 legacy=0x7fad480cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:06.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.084+0000 7fad47400640 1 -- 172.21.15.70:0/3781252266 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196674276 0 0) 0x7fad480709e0 con 0x7fad480b3790 2024-09-13T16:02:06.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.084+0000 7fad47e00640 1 -- 172.21.15.70:0/3781252266 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad48070fa0 con 0x7fad48159610 2024-09-13T16:02:06.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.085+0000 7fad47e00640 1 --2- 172.21.15.70:0/3781252266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad48159610 0x7fad48070000 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fad380097a0 tx=0x7fad3802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440cc1e6b2ea4c87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:06.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.085+0000 7fad47400640 1 -- 172.21.15.70:0/3781252266 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38032440 con 0x7fad48159610 2024-09-13T16:02:06.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.085+0000 7fad47400640 1 -- 172.21.15.70:0/3781252266 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad380325a0 con 0x7fad48159610 2024-09-13T16:02:06.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.085+0000 7fad47400640 1 -- 172.21.15.70:0/3781252266 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38032930 con 0x7fad48159610 2024-09-13T16:02:06.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.086+0000 7fad4ea00640 1 -- 172.21.15.70:0/3781252266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad48159610 msgr2=0x7fad48070000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:06.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.086+0000 7fad4ea00640 1 --2- 172.21.15.70:0/3781252266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad48159610 0x7fad48070000 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fad380097a0 tx=0x7fad3802a230 comp rx=0 tx=0).stop 2024-09-13T16:02:06.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.086+0000 7fad4ea00640 1 -- 172.21.15.70:0/3781252266 shutdown_connections 2024-09-13T16:02:06.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.086+0000 7fad4ea00640 1 --2- 172.21.15.70:0/3781252266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad48159610 0x7fad48070000 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:06.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.086+0000 7fad4ea00640 1 -- 172.21.15.70:0/3781252266 >> 172.21.15.70:0/3781252266 conn(0x7fad480b0510 msgr2=0x7fad480b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:06.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.086+0000 7fad4ea00640 1 -- 172.21.15.70:0/3781252266 shutdown_connections 2024-09-13T16:02:06.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.086+0000 7fad4ea00640 1 -- 172.21.15.70:0/3781252266 wait complete. 2024-09-13T16:02:06.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.088+0000 7fad4ea00640 1 Processor -- start 2024-09-13T16:02:06.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.088+0000 7fad4ea00640 1 -- start start 2024-09-13T16:02:06.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.089+0000 7fad4ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad48070540 0x7fad4815bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:06.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.089+0000 7fad4ea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad480b3790 0x7fad481f2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:06.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.089+0000 7fad4ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad48159610 0x7fad481e25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:06.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.089+0000 7fad4ea00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad481e3030 con 0x7fad480b3790 2024-09-13T16:02:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.089+0000 7fad4ea00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4815ca50 con 0x7fad48159610 2024-09-13T16:02:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.089+0000 7fad4ea00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4815a3c0 con 0x7fad48070540 2024-09-13T16:02:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.089+0000 7fad3fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad480b3790 0x7fad481f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.089+0000 7fad3fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad480b3790 0x7fad481f2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32936/0 (socket says 172.21.15.70:32936) 2024-09-13T16:02:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.089+0000 7fad3fe00640 1 -- 172.21.15.70:0/3568998285 learned_addr learned my addr 172.21.15.70:0/3568998285 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.089+0000 7fad3fe00640 1 -- 172.21.15.70:0/3568998285 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad48070540 msgr2=0x7fad4815bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.089+0000 7fad3fe00640 1 --2- 172.21.15.70:0/3568998285 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad48070540 0x7fad4815bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.089+0000 7fad3fe00640 1 -- 172.21.15.70:0/3568998285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad48159610 msgr2=0x7fad481e25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.089+0000 7fad3fe00640 1 --2- 172.21.15.70:0/3568998285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad48159610 0x7fad481e25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.089+0000 7fad3fe00640 1 -- 172.21.15.70:0/3568998285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad38009400 con 0x7fad480b3790 2024-09-13T16:02:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.090+0000 7fad3fe00640 1 --2- 172.21.15.70:0/3568998285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad480b3790 0x7fad481f2500 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fad3000c430 tx=0x7fad3000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:06.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.090+0000 7fad44c00640 1 -- 172.21.15.70:0/3568998285 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad300052d0 con 0x7fad480b3790 2024-09-13T16:02:06.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.090+0000 7fad44c00640 1 -- 172.21.15.70:0/3568998285 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad30005430 con 0x7fad480b3790 2024-09-13T16:02:06.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.090+0000 7fad44c00640 1 -- 172.21.15.70:0/3568998285 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30003830 con 0x7fad480b3790 2024-09-13T16:02:06.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.090+0000 7fad4ea00640 1 -- 172.21.15.70:0/3568998285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad481f2a40 con 0x7fad480b3790 2024-09-13T16:02:06.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.090+0000 7fad4ea00640 1 -- 172.21.15.70:0/3568998285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad481e2af0 con 0x7fad480b3790 2024-09-13T16:02:06.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.091+0000 7fad4ea00640 1 -- 172.21.15.70:0/3568998285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4815a500 con 0x7fad480b3790 2024-09-13T16:02:06.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.092+0000 7fad44c00640 1 -- 172.21.15.70:0/3568998285 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fad30003990 con 0x7fad480b3790 2024-09-13T16:02:06.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.093+0000 7fad44c00640 1 --2- 172.21.15.70:0/3568998285 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fad2406ac00 0x7fad2406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:06.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.093+0000 7fad44c00640 1 -- 172.21.15.70:0/3568998285 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fad30088970 con 0x7fad480b3790 2024-09-13T16:02:06.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.093+0000 7fad47e00640 1 --2- 172.21.15.70:0/3568998285 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fad2406ac00 0x7fad2406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:06.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.094+0000 7fad47e00640 1 --2- 172.21.15.70:0/3568998285 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fad2406ac00 0x7fad2406d0c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fad38034000 tx=0x7fad3802c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:06.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.097+0000 7fad44c00640 1 -- 172.21.15.70:0/3568998285 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fad4815a500 con 0x7fad480b3790 2024-09-13T16:02:06.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.305+0000 7fad4ea00640 1 -- 172.21.15.70:0/3568998285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fad4815a500 con 0x7fad480b3790 2024-09-13T16:02:06.351 INFO:tasks.ceph.mds.d.smithi107.stderr: -7007> 2024-09-13T16:01:23.044+0000 7efed7000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T16:02:06.351 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-13T16:02:06.306+0000 7fe88e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T16:02:06.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.316+0000 7fad44c00640 1 -- 172.21.15.70:0/3568998285 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fad4815a500 con 0x7fad480b3790 2024-09-13T16:02:06.353 INFO:teuthology.orchestra.run.smithi070.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T16:02:06.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.318+0000 7fad4ea00640 1 -- 172.21.15.70:0/3568998285 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fad2406ac00 msgr2=0x7fad2406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:06.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.318+0000 7fad4ea00640 1 --2- 172.21.15.70:0/3568998285 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fad2406ac00 0x7fad2406d0c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fad38034000 tx=0x7fad3802c000 comp rx=0 tx=0).stop 2024-09-13T16:02:06.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.318+0000 7fad4ea00640 1 -- 172.21.15.70:0/3568998285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad480b3790 msgr2=0x7fad481f2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:06.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.318+0000 7fad4ea00640 1 --2- 172.21.15.70:0/3568998285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad480b3790 0x7fad481f2500 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fad3000c430 tx=0x7fad3000c8f0 comp rx=0 tx=0).stop 2024-09-13T16:02:06.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.319+0000 7fad4ea00640 1 -- 172.21.15.70:0/3568998285 shutdown_connections 2024-09-13T16:02:06.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.319+0000 7fad4ea00640 1 --2- 172.21.15.70:0/3568998285 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fad2406ac00 0x7fad2406d0c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:06.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.319+0000 7fad4ea00640 1 --2- 172.21.15.70:0/3568998285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad48159610 0x7fad481e25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:06.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.319+0000 7fad4ea00640 1 --2- 172.21.15.70:0/3568998285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad480b3790 0x7fad481f2500 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:06.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.319+0000 7fad4ea00640 1 --2- 172.21.15.70:0/3568998285 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad48070540 0x7fad4815bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:06.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.319+0000 7fad4ea00640 1 -- 172.21.15.70:0/3568998285 >> 172.21.15.70:0/3568998285 conn(0x7fad480b0510 msgr2=0x7fad480afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:06.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.319+0000 7fad4ea00640 1 -- 172.21.15.70:0/3568998285 shutdown_connections 2024-09-13T16:02:06.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.319+0000 7fad4ea00640 1 -- 172.21.15.70:0/3568998285 wait complete. 2024-09-13T16:02:06.354 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T16:02:06.380 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-09-13T16:02:06.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.510+0000 7f7b3e400640 1 Processor -- start 2024-09-13T16:02:06.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.510+0000 7f7b3e400640 1 -- start start 2024-09-13T16:02:06.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.512+0000 7f7b3e400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7b380b3990 0x7f7b38159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:06.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.512+0000 7f7b3e400640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b38159fc0 con 0x7f7b38153b20 2024-09-13T16:02:06.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.512+0000 7f7b3e400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b38153f00 con 0x7f7b3806f660 2024-09-13T16:02:06.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.512+0000 7f7b3e400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b380ce600 con 0x7f7b380b3990 2024-09-13T16:02:06.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.512+0000 7f7b37400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f7b38153b20 0x7f7b380b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41876/0 (socket says 172.21.15.70:41876) 2024-09-13T16:02:06.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.512+0000 7f7b37400640 1 -- 172.21.15.70:0/845757301 learned_addr learned my addr 172.21.15.70:0/845757301 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:06.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.512+0000 7f7b2ea00640 1 --2- 172.21.15.70:0/845757301 >> v2:172.21.15.107:3300/0 conn(0x7f7b380b3990 0x7f7b38159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:06.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.512+0000 7f7b36a00640 1 -- 172.21.15.70:0/845757301 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117241203 0 0) 0x7f7b38159fc0 con 0x7f7b38153b20 2024-09-13T16:02:06.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.512+0000 7f7b36a00640 1 -- 172.21.15.70:0/845757301 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b1c003520 con 0x7f7b38153b20 2024-09-13T16:02:06.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.512+0000 7f7b36a00640 1 -- 172.21.15.70:0/845757301 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119390208 0 0) 0x7f7b38153f00 con 0x7f7b3806f660 2024-09-13T16:02:06.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.512+0000 7f7b36a00640 1 -- 172.21.15.70:0/845757301 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b38159fc0 con 0x7f7b3806f660 2024-09-13T16:02:06.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.513+0000 7f7b2ea00640 1 -- 172.21.15.70:0/845757301 >> v1:172.21.15.107:6789/0 conn(0x7f7b3806f660 legacy=0x7f7b3806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:06.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.513+0000 7f7b2ea00640 1 -- 172.21.15.70:0/845757301 >> v1:172.21.15.70:6789/0 conn(0x7f7b38153b20 legacy=0x7f7b380b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:06.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.513+0000 7f7b2ea00640 1 -- 172.21.15.70:0/845757301 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b380b1a40 con 0x7f7b380b3990 2024-09-13T16:02:06.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.514+0000 7f7b2ea00640 1 --2- 172.21.15.70:0/845757301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b380b3990 0x7f7b38159a80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7b200097a0 tx=0x7f7b2002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1372434d177830db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:06.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.514+0000 7f7b36a00640 1 -- 172.21.15.70:0/845757301 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20032440 con 0x7f7b380b3990 2024-09-13T16:02:06.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.514+0000 7f7b36a00640 1 -- 172.21.15.70:0/845757301 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b200325a0 con 0x7f7b380b3990 2024-09-13T16:02:06.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.514+0000 7f7b36a00640 1 -- 172.21.15.70:0/845757301 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20032930 con 0x7f7b380b3990 2024-09-13T16:02:06.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.514+0000 7f7b3e400640 1 -- 172.21.15.70:0/845757301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b380b3990 msgr2=0x7f7b38159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:06.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.514+0000 7f7b3e400640 1 --2- 172.21.15.70:0/845757301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b380b3990 0x7f7b38159a80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7b200097a0 tx=0x7f7b2002a230 comp rx=0 tx=0).stop 2024-09-13T16:02:06.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.514+0000 7f7b3e400640 1 -- 172.21.15.70:0/845757301 shutdown_connections 2024-09-13T16:02:06.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.514+0000 7f7b3e400640 1 --2- 172.21.15.70:0/845757301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b380b3990 0x7f7b38159a80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:06.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.514+0000 7f7b3e400640 1 -- 172.21.15.70:0/845757301 >> 172.21.15.70:0/845757301 conn(0x7f7b380b0510 msgr2=0x7f7b380b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:06.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.515+0000 7f7b3e400640 1 -- 172.21.15.70:0/845757301 shutdown_connections 2024-09-13T16:02:06.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.515+0000 7f7b3e400640 1 -- 172.21.15.70:0/845757301 wait complete. 2024-09-13T16:02:06.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.516+0000 7f7b3e400640 1 Processor -- start 2024-09-13T16:02:06.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.516+0000 7f7b3e400640 1 -- start start 2024-09-13T16:02:06.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.517+0000 7f7b3e400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b3806f660 0x7f7b38147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:06.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.517+0000 7f7b3e400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b380b3990 0x7f7b38156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:06.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.517+0000 7f7b3e400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b38153b20 0x7f7b38156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:06.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.517+0000 7f7b3e400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b38159450 con 0x7f7b3806f660 2024-09-13T16:02:06.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.517+0000 7f7b3e400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b38154cc0 con 0x7f7b38153b20 2024-09-13T16:02:06.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.517+0000 7f7b3e400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b38154fa0 con 0x7f7b380b3990 2024-09-13T16:02:06.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.517+0000 7f7b37400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b3806f660 0x7f7b38147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:06.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.517+0000 7f7b37400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b3806f660 0x7f7b38147f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32946/0 (socket says 172.21.15.70:32946) 2024-09-13T16:02:06.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.517+0000 7f7b37400640 1 -- 172.21.15.70:0/354982003 learned_addr learned my addr 172.21.15.70:0/354982003 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:06.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.518+0000 7f7b2ea00640 1 --2- 172.21.15.70:0/354982003 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b380b3990 0x7f7b38156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:06.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.518+0000 7f7b37e00640 1 --2- 172.21.15.70:0/354982003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b38153b20 0x7f7b38156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:06.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.518+0000 7f7b37400640 1 -- 172.21.15.70:0/354982003 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b380b3990 msgr2=0x7f7b38156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:06.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.518+0000 7f7b37400640 1 --2- 172.21.15.70:0/354982003 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b380b3990 0x7f7b38156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:06.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.518+0000 7f7b37400640 1 -- 172.21.15.70:0/354982003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b38153b20 msgr2=0x7f7b38156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:06.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.518+0000 7f7b37400640 1 --2- 172.21.15.70:0/354982003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b38153b20 0x7f7b38156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:06.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.518+0000 7f7b37400640 1 -- 172.21.15.70:0/354982003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b20009400 con 0x7f7b3806f660 2024-09-13T16:02:06.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.518+0000 7f7b37e00640 1 --2- 172.21.15.70:0/354982003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b38153b20 0x7f7b38156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:06.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.518+0000 7f7b37400640 1 --2- 172.21.15.70:0/354982003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b3806f660 0x7f7b38147f90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7b2800c4d0 tx=0x7f7b2800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:06.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.518+0000 7f7b2fe00640 1 -- 172.21.15.70:0/354982003 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b28005ce0 con 0x7f7b3806f660 2024-09-13T16:02:06.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.518+0000 7f7b2fe00640 1 -- 172.21.15.70:0/354982003 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b28005e40 con 0x7f7b3806f660 2024-09-13T16:02:06.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.518+0000 7f7b3e400640 1 -- 172.21.15.70:0/354982003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b38155280 con 0x7f7b3806f660 2024-09-13T16:02:06.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.518+0000 7f7b2fe00640 1 -- 172.21.15.70:0/354982003 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b28007270 con 0x7f7b3806f660 2024-09-13T16:02:06.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.519+0000 7f7b3e400640 1 -- 172.21.15.70:0/354982003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b381484d0 con 0x7f7b3806f660 2024-09-13T16:02:06.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.520+0000 7f7b3e400640 1 -- 172.21.15.70:0/354982003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b38155bb0 con 0x7f7b3806f660 2024-09-13T16:02:06.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.520+0000 7f7b2fe00640 1 -- 172.21.15.70:0/354982003 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7b280073d0 con 0x7f7b3806f660 2024-09-13T16:02:06.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.522+0000 7f7b2fe00640 1 --2- 172.21.15.70:0/354982003 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7b1406ac30 0x7f7b1406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:06.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.522+0000 7f7b2fe00640 1 -- 172.21.15.70:0/354982003 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f7b280889c0 con 0x7f7b3806f660 2024-09-13T16:02:06.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.522+0000 7f7b2ea00640 1 --2- 172.21.15.70:0/354982003 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7b1406ac30 0x7f7b1406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:06.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.523+0000 7f7b2ea00640 1 --2- 172.21.15.70:0/354982003 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7b1406ac30 0x7f7b1406d0f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7b20034000 tx=0x7f7b2002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:06.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.526+0000 7f7b2fe00640 1 -- 172.21.15.70:0/354982003 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7b28053af0 con 0x7f7b3806f660 2024-09-13T16:02:06.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:06.742+0000 7f7b3e400640 1 -- 172.21.15.70:0/354982003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7b380b0a70 con 0x7f7b3806f660 2024-09-13T16:02:07.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.318+0000 7f7b2fe00640 1 -- 172.21.15.70:0/354982003 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7b28017020 con 0x7f7b3806f660 2024-09-13T16:02:07.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.320+0000 7f7b3e400640 1 -- 172.21.15.70:0/354982003 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7b1406ac30 msgr2=0x7f7b1406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:07.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.320+0000 7f7b3e400640 1 --2- 172.21.15.70:0/354982003 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7b1406ac30 0x7f7b1406d0f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7b20034000 tx=0x7f7b2002e000 comp rx=0 tx=0).stop 2024-09-13T16:02:07.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.320+0000 7f7b3e400640 1 -- 172.21.15.70:0/354982003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b3806f660 msgr2=0x7f7b38147f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:07.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.320+0000 7f7b3e400640 1 --2- 172.21.15.70:0/354982003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b3806f660 0x7f7b38147f90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7b2800c4d0 tx=0x7f7b2800c990 comp rx=0 tx=0).stop 2024-09-13T16:02:07.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.321+0000 7f7b3e400640 1 -- 172.21.15.70:0/354982003 shutdown_connections 2024-09-13T16:02:07.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.321+0000 7f7b3e400640 1 --2- 172.21.15.70:0/354982003 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7b1406ac30 0x7f7b1406d0f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:07.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.321+0000 7f7b3e400640 1 --2- 172.21.15.70:0/354982003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b38153b20 0x7f7b38156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:07.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.321+0000 7f7b3e400640 1 --2- 172.21.15.70:0/354982003 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b380b3990 0x7f7b38156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:07.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.321+0000 7f7b3e400640 1 --2- 172.21.15.70:0/354982003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b3806f660 0x7f7b38147f90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:07.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.321+0000 7f7b3e400640 1 -- 172.21.15.70:0/354982003 >> 172.21.15.70:0/354982003 conn(0x7f7b380b0510 msgr2=0x7f7b380cd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:07.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.321+0000 7f7b3e400640 1 -- 172.21.15.70:0/354982003 shutdown_connections 2024-09-13T16:02:07.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.321+0000 7f7b3e400640 1 -- 172.21.15.70:0/354982003 wait complete. 2024-09-13T16:02:07.338 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T16:02:07.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.494+0000 7fedfde00640 1 Processor -- start 2024-09-13T16:02:07.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.494+0000 7fedfde00640 1 -- start start 2024-09-13T16:02:07.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.495+0000 7fedfde00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedf81592f0 0x7fedf80b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:07.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.495+0000 7fedfde00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fedf80adeb0 0x7fedf80704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:07.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.495+0000 7fedfde00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf8070030 con 0x7fedf81596d0 2024-09-13T16:02:07.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.495+0000 7fedfde00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf8071110 con 0x7fedf80adeb0 2024-09-13T16:02:07.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.495+0000 7fedfde00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80b1d50 con 0x7fedf81592f0 2024-09-13T16:02:07.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.496+0000 7fedf6a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedf81592f0 0x7fedf80b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:07.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.496+0000 7fedf6a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedf81592f0 0x7fedf80b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:37308/0 (socket says 172.21.15.70:37308) 2024-09-13T16:02:07.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.496+0000 7fedf6a00640 1 -- 172.21.15.70:0/3128524367 learned_addr learned my addr 172.21.15.70:0/3128524367 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:07.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.496+0000 7fedee000640 1 --2- 172.21.15.70:0/3128524367 >> v2:172.21.15.107:3300/0 conn(0x7fedf80adeb0 0x7fedf80704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:07.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.496+0000 7fedf7400640 1 --1- 172.21.15.70:0/3128524367 >> v1:172.21.15.107:6789/0 conn(0x7fedf81596d0 0x7fedf8070a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:48138/0 (socket says 172.21.15.70:48138) 2024-09-13T16:02:07.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.496+0000 7fedee000640 1 -- 172.21.15.70:0/3128524367 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedf81592f0 msgr2=0x7fedf80b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:07.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.496+0000 7fedee000640 1 --2- 172.21.15.70:0/3128524367 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedf81592f0 0x7fedf80b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:07.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.496+0000 7fedee000640 1 -- 172.21.15.70:0/3128524367 >> v1:172.21.15.107:6789/0 conn(0x7fedf81596d0 legacy=0x7fedf8070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:07.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.497+0000 7fedee000640 1 -- 172.21.15.70:0/3128524367 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf8071870 con 0x7fedf80adeb0 2024-09-13T16:02:07.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.497+0000 7fedf6a00640 1 --2- 172.21.15.70:0/3128524367 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedf81592f0 0x7fedf80b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:07.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.497+0000 7fedf6000640 1 -- 172.21.15.70:0/3128524367 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637621929 0 0) 0x7fedf8070030 con 0x7fedf81596d0 2024-09-13T16:02:07.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.498+0000 7fedee000640 1 --2- 172.21.15.70:0/3128524367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedf80adeb0 0x7fedf80704c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fede00097a0 tx=0x7fede002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4f43fbe2b3c63e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:07.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.498+0000 7fedf6000640 1 -- 172.21.15.70:0/3128524367 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0032440 con 0x7fedf80adeb0 2024-09-13T16:02:07.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.498+0000 7fedf6000640 1 -- 172.21.15.70:0/3128524367 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede00325a0 con 0x7fedf80adeb0 2024-09-13T16:02:07.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.498+0000 7fedf6000640 1 -- 172.21.15.70:0/3128524367 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0032930 con 0x7fedf80adeb0 2024-09-13T16:02:07.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.498+0000 7fedfde00640 1 -- 172.21.15.70:0/3128524367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedf80adeb0 msgr2=0x7fedf80704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:07.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.498+0000 7fedfde00640 1 --2- 172.21.15.70:0/3128524367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedf80adeb0 0x7fedf80704c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fede00097a0 tx=0x7fede002a180 comp rx=0 tx=0).stop 2024-09-13T16:02:07.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.498+0000 7fedfde00640 1 -- 172.21.15.70:0/3128524367 shutdown_connections 2024-09-13T16:02:07.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.498+0000 7fedfde00640 1 --2- 172.21.15.70:0/3128524367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedf80adeb0 0x7fedf80704c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:07.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.498+0000 7fedfde00640 1 --2- 172.21.15.70:0/3128524367 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedf81592f0 0x7fedf80b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:07.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.498+0000 7fedfde00640 1 -- 172.21.15.70:0/3128524367 >> 172.21.15.70:0/3128524367 conn(0x7fedf80b0510 msgr2=0x7fedf80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:07.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.498+0000 7fedfde00640 1 -- 172.21.15.70:0/3128524367 shutdown_connections 2024-09-13T16:02:07.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.499+0000 7fedfde00640 1 -- 172.21.15.70:0/3128524367 wait complete. 2024-09-13T16:02:07.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.500+0000 7fedfde00640 1 Processor -- start 2024-09-13T16:02:07.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.500+0000 7fedfde00640 1 -- start start 2024-09-13T16:02:07.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.501+0000 7fedfde00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedf80adeb0 0x7fedf8144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:07.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.501+0000 7fedfde00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedf81592f0 0x7fedf8146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:07.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.501+0000 7fedfde00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedf81596d0 0x7fedf81471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:07.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.501+0000 7fedfde00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf8146a90 con 0x7fedf81596d0 2024-09-13T16:02:07.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.501+0000 7fedfde00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf81459f0 con 0x7fedf80adeb0 2024-09-13T16:02:07.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.501+0000 7fedfde00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf8145cd0 con 0x7fedf81592f0 2024-09-13T16:02:07.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.501+0000 7fedf7400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedf81596d0 0x7fedf81471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:07.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.501+0000 7fedf7400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedf81596d0 0x7fedf81471e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32958/0 (socket says 172.21.15.70:32958) 2024-09-13T16:02:07.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.501+0000 7fedf7400640 1 -- 172.21.15.70:0/3888742283 learned_addr learned my addr 172.21.15.70:0/3888742283 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:07.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.502+0000 7fedf6a00640 1 --2- 172.21.15.70:0/3888742283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedf80adeb0 0x7fedf8144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:07.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.502+0000 7fedee000640 1 --2- 172.21.15.70:0/3888742283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedf81592f0 0x7fedf8146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:07.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.502+0000 7fedf7400640 1 -- 172.21.15.70:0/3888742283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedf81592f0 msgr2=0x7fedf8146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:07.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.502+0000 7fedf7400640 1 --2- 172.21.15.70:0/3888742283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedf81592f0 0x7fedf8146ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:07.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.502+0000 7fedf7400640 1 -- 172.21.15.70:0/3888742283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedf80adeb0 msgr2=0x7fedf8144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:07.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.502+0000 7fedf7400640 1 --2- 172.21.15.70:0/3888742283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedf80adeb0 0x7fedf8144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:07.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.502+0000 7fedf7400640 1 -- 172.21.15.70:0/3888742283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede800b770 con 0x7fedf81596d0 2024-09-13T16:02:07.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.502+0000 7fedf6a00640 1 --2- 172.21.15.70:0/3888742283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedf80adeb0 0x7fedf8144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:07.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.502+0000 7fedee000640 1 --2- 172.21.15.70:0/3888742283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedf81592f0 0x7fedf8146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:07.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.502+0000 7fedf7400640 1 --2- 172.21.15.70:0/3888742283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedf81596d0 0x7fedf81471e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fedf000c780 tx=0x7fedf000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:07.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.502+0000 7fedefe00640 1 -- 172.21.15.70:0/3888742283 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf000ce30 con 0x7fedf81596d0 2024-09-13T16:02:07.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.502+0000 7fedefe00640 1 -- 172.21.15.70:0/3888742283 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf000a640 con 0x7fedf81596d0 2024-09-13T16:02:07.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.503+0000 7fedefe00640 1 -- 172.21.15.70:0/3888742283 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf000a9f0 con 0x7fedf81596d0 2024-09-13T16:02:07.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.503+0000 7fedfde00640 1 -- 172.21.15.70:0/3888742283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede0009400 con 0x7fedf81596d0 2024-09-13T16:02:07.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.503+0000 7fedfde00640 1 -- 172.21.15.70:0/3888742283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf8146290 con 0x7fedf81596d0 2024-09-13T16:02:07.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.503+0000 7fedfde00640 1 -- 172.21.15.70:0/3888742283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf80b1810 con 0x7fedf81596d0 2024-09-13T16:02:07.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.504+0000 7fedefe00640 1 -- 172.21.15.70:0/3888742283 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fedf000ab50 con 0x7fedf81596d0 2024-09-13T16:02:07.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.505+0000 7fedefe00640 1 --2- 172.21.15.70:0/3888742283 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fedd406ac00 0x7fedd406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:07.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.505+0000 7fedefe00640 1 -- 172.21.15.70:0/3888742283 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fedf0088980 con 0x7fedf81596d0 2024-09-13T16:02:07.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.506+0000 7fedf6a00640 1 --2- 172.21.15.70:0/3888742283 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fedd406ac00 0x7fedd406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:07.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.506+0000 7fedf6a00640 1 --2- 172.21.15.70:0/3888742283 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fedd406ac00 0x7fedd406d0c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fedf80a8600 tx=0x7fede800b450 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:07.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.509+0000 7fedefe00640 1 -- 172.21.15.70:0/3888742283 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fedf00539f0 con 0x7fedf81596d0 2024-09-13T16:02:07.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:07.677+0000 7fedfde00640 1 -- 172.21.15.70:0/3888742283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fedf80b02d0 con 0x7fedf81596d0 2024-09-13T16:02:08.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.328+0000 7fedefe00640 1 -- 172.21.15.70:0/3888742283 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7fedf0018070 con 0x7fedf81596d0 2024-09-13T16:02:08.329 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' removed 2024-09-13T16:02:08.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.332+0000 7fedfde00640 1 -- 172.21.15.70:0/3888742283 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fedd406ac00 msgr2=0x7fedd406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:08.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.332+0000 7fedfde00640 1 --2- 172.21.15.70:0/3888742283 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fedd406ac00 0x7fedd406d0c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fedf80a8600 tx=0x7fede800b450 comp rx=0 tx=0).stop 2024-09-13T16:02:08.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.332+0000 7fedfde00640 1 -- 172.21.15.70:0/3888742283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedf81596d0 msgr2=0x7fedf81471e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:08.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.332+0000 7fedfde00640 1 --2- 172.21.15.70:0/3888742283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedf81596d0 0x7fedf81471e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fedf000c780 tx=0x7fedf000cc40 comp rx=0 tx=0).stop 2024-09-13T16:02:08.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.333+0000 7fedfde00640 1 -- 172.21.15.70:0/3888742283 shutdown_connections 2024-09-13T16:02:08.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.333+0000 7fedfde00640 1 --2- 172.21.15.70:0/3888742283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedf81596d0 0x7fedf81471e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:08.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.333+0000 7fedfde00640 1 --2- 172.21.15.70:0/3888742283 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedf81592f0 0x7fedf8146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:08.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.333+0000 7fedfde00640 1 --2- 172.21.15.70:0/3888742283 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fedd406ac00 0x7fedd406d0c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:08.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.333+0000 7fedfde00640 1 --2- 172.21.15.70:0/3888742283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedf80adeb0 0x7fedf8144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:08.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.333+0000 7fedfde00640 1 -- 172.21.15.70:0/3888742283 >> 172.21.15.70:0/3888742283 conn(0x7fedf80b0510 msgr2=0x7fedf80cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:08.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.333+0000 7fedfde00640 1 -- 172.21.15.70:0/3888742283 shutdown_connections 2024-09-13T16:02:08.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.334+0000 7fedfde00640 1 -- 172.21.15.70:0/3888742283 wait complete. 2024-09-13T16:02:08.354 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T16:02:08.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.517+0000 7f4e27e00640 1 Processor -- start 2024-09-13T16:02:08.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.518+0000 7f4e27e00640 1 -- start start 2024-09-13T16:02:08.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.519+0000 7f4e27e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4e28144020 0x7f4e2806ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:08.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.519+0000 7f4e27e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4e28071320 0x7f4e2806cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:08.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.519+0000 7f4e27e00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e28144400 con 0x7f4e280adc30 2024-09-13T16:02:08.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.519+0000 7f4e27e00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e280cc4e0 con 0x7f4e28071320 2024-09-13T16:02:08.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.519+0000 7f4e27e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e2806d4d0 con 0x7f4e28144020 2024-09-13T16:02:08.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.519+0000 7f4e26000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4e28071320 0x7f4e2806cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:08.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.519+0000 7f4e27400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f4e280adc30 0x7f4e2815e140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41880/0 (socket says 172.21.15.70:41880) 2024-09-13T16:02:08.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.519+0000 7f4e26000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4e28071320 0x7f4e2806cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32962/0 (socket says 172.21.15.70:32962) 2024-09-13T16:02:08.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.519+0000 7f4e27400640 1 -- 172.21.15.70:0/2426360231 learned_addr learned my addr 172.21.15.70:0/2426360231 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:08.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.519+0000 7f4e26a00640 1 --2- 172.21.15.70:0/2426360231 >> v2:172.21.15.107:3300/0 conn(0x7f4e28144020 0x7f4e2806ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:08.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.520+0000 7f4e26000640 1 -- 172.21.15.70:0/2426360231 >> v2:172.21.15.107:3300/0 conn(0x7f4e28144020 msgr2=0x7f4e2806ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:08.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.520+0000 7f4e26000640 1 --2- 172.21.15.70:0/2426360231 >> v2:172.21.15.107:3300/0 conn(0x7f4e28144020 0x7f4e2806ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:08.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.520+0000 7f4e26000640 1 -- 172.21.15.70:0/2426360231 >> v1:172.21.15.70:6789/0 conn(0x7f4e280adc30 legacy=0x7f4e2815e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:08.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.520+0000 7f4e26000640 1 -- 172.21.15.70:0/2426360231 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2806fe50 con 0x7f4e28071320 2024-09-13T16:02:08.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.520+0000 7f4e25600640 1 -- 172.21.15.70:0/2426360231 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130708497 0 0) 0x7f4e28144400 con 0x7f4e280adc30 2024-09-13T16:02:08.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.521+0000 7f4e26000640 1 --2- 172.21.15.70:0/2426360231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e28071320 0x7f4e2806cf90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4e28067df0 tx=0x7f4e1402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83cb2a3b0f90e1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:08.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.521+0000 7f4e25600640 1 -- 172.21.15.70:0/2426360231 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1402ae60 con 0x7f4e28071320 2024-09-13T16:02:08.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.521+0000 7f4e25600640 1 -- 172.21.15.70:0/2426360231 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e14032440 con 0x7f4e28071320 2024-09-13T16:02:08.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.521+0000 7f4e25600640 1 -- 172.21.15.70:0/2426360231 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140327d0 con 0x7f4e28071320 2024-09-13T16:02:08.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.522+0000 7f4e27e00640 1 -- 172.21.15.70:0/2426360231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e28071320 msgr2=0x7f4e2806cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:08.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.522+0000 7f4e27e00640 1 --2- 172.21.15.70:0/2426360231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e28071320 0x7f4e2806cf90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4e28067df0 tx=0x7f4e1402a110 comp rx=0 tx=0).stop 2024-09-13T16:02:08.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.522+0000 7f4e27e00640 1 -- 172.21.15.70:0/2426360231 shutdown_connections 2024-09-13T16:02:08.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.522+0000 7f4e27e00640 1 --2- 172.21.15.70:0/2426360231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e28071320 0x7f4e2806cf90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.522+0000 7f4e27e00640 1 --2- 172.21.15.70:0/2426360231 >> v2:172.21.15.107:3300/0 conn(0x7f4e28144020 0x7f4e2806ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.522+0000 7f4e27e00640 1 -- 172.21.15.70:0/2426360231 >> 172.21.15.70:0/2426360231 conn(0x7f4e280b0300 msgr2=0x7f4e280b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.522+0000 7f4e27e00640 1 -- 172.21.15.70:0/2426360231 shutdown_connections 2024-09-13T16:02:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.522+0000 7f4e27e00640 1 -- 172.21.15.70:0/2426360231 wait complete. 2024-09-13T16:02:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.523+0000 7f4e27e00640 1 Processor -- start 2024-09-13T16:02:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.523+0000 7f4e27e00640 1 -- start start 2024-09-13T16:02:08.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.524+0000 7f4e27e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e28071320 0x7f4e281326a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:08.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.524+0000 7f4e27e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e280adc30 0x7f4e280ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:08.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.524+0000 7f4e27e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e28144020 0x7f4e280b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:08.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.524+0000 7f4e27e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2812fc00 con 0x7f4e280adc30 2024-09-13T16:02:08.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.524+0000 7f4e27e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e28132be0 con 0x7f4e28144020 2024-09-13T16:02:08.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.524+0000 7f4e27e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e280cad70 con 0x7f4e28071320 2024-09-13T16:02:08.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.525+0000 7f4e26000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e280adc30 0x7f4e280ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:08.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.525+0000 7f4e26000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e280adc30 0x7f4e280ca830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32976/0 (socket says 172.21.15.70:32976) 2024-09-13T16:02:08.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.525+0000 7f4e26000640 1 -- 172.21.15.70:0/3853255046 learned_addr learned my addr 172.21.15.70:0/3853255046 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:08.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.525+0000 7f4e27400640 1 --2- 172.21.15.70:0/3853255046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e28144020 0x7f4e280b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:08.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.525+0000 7f4e26a00640 1 --2- 172.21.15.70:0/3853255046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e28071320 0x7f4e281326a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:08.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.525+0000 7f4e26000640 1 -- 172.21.15.70:0/3853255046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e28071320 msgr2=0x7f4e281326a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:08.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.525+0000 7f4e26000640 1 --2- 172.21.15.70:0/3853255046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e28071320 0x7f4e281326a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:08.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.525+0000 7f4e26000640 1 -- 172.21.15.70:0/3853255046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e28144020 msgr2=0x7f4e280b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:08.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.525+0000 7f4e26000640 1 --2- 172.21.15.70:0/3853255046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e28144020 0x7f4e280b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:08.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.525+0000 7f4e26000640 1 -- 172.21.15.70:0/3853255046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e14009400 con 0x7f4e280adc30 2024-09-13T16:02:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.525+0000 7f4e26000640 1 --2- 172.21.15.70:0/3853255046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e280adc30 0x7f4e280ca830 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009890 tx=0x7f4e140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.525+0000 7f4e1ea00640 1 -- 172.21.15.70:0/3853255046 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14004230 con 0x7f4e280adc30 2024-09-13T16:02:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.525+0000 7f4e1ea00640 1 -- 172.21.15.70:0/3853255046 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e140043b0 con 0x7f4e280adc30 2024-09-13T16:02:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.525+0000 7f4e1ea00640 1 -- 172.21.15.70:0/3853255046 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14004520 con 0x7f4e280adc30 2024-09-13T16:02:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.526+0000 7f4e27e00640 1 -- 172.21.15.70:0/3853255046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e280c36f0 con 0x7f4e280adc30 2024-09-13T16:02:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.526+0000 7f4e27e00640 1 -- 172.21.15.70:0/3853255046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2812fe50 con 0x7f4e280adc30 2024-09-13T16:02:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.527+0000 7f4e27e00640 1 -- 172.21.15.70:0/3853255046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2806ca50 con 0x7f4e280adc30 2024-09-13T16:02:08.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.528+0000 7f4e1ea00640 1 -- 172.21.15.70:0/3853255046 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4e14003850 con 0x7f4e280adc30 2024-09-13T16:02:08.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.529+0000 7f4e1ea00640 1 --2- 172.21.15.70:0/3853255046 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4e0806ac00 0x7f4e0806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:08.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.529+0000 7f4e1ea00640 1 -- 172.21.15.70:0/3853255046 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f4e140a9db0 con 0x7f4e280adc30 2024-09-13T16:02:08.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.529+0000 7f4e26a00640 1 --2- 172.21.15.70:0/3853255046 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4e0806ac00 0x7f4e0806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:08.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.530+0000 7f4e26a00640 1 --2- 172.21.15.70:0/3853255046 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4e0806ac00 0x7f4e0806d0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4e280725f0 tx=0x7f4e1800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:08.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.534+0000 7f4e1ea00640 1 -- 172.21.15.70:0/3853255046 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4e140ae070 con 0x7f4e280adc30 2024-09-13T16:02:08.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:08.704+0000 7f4e27e00640 1 -- 172.21.15.70:0/3853255046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4e280b20b0 con 0x7f4e280adc30 2024-09-13T16:02:09.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.331+0000 7f4e1ea00640 1 -- 172.21.15.70:0/3853255046 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4e140370d0 con 0x7f4e280adc30 2024-09-13T16:02:09.333 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' removed 2024-09-13T16:02:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.336+0000 7f4e27e00640 1 -- 172.21.15.70:0/3853255046 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4e0806ac00 msgr2=0x7f4e0806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.336+0000 7f4e27e00640 1 --2- 172.21.15.70:0/3853255046 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4e0806ac00 0x7f4e0806d0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4e280725f0 tx=0x7f4e1800b040 comp rx=0 tx=0).stop 2024-09-13T16:02:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.336+0000 7f4e27e00640 1 -- 172.21.15.70:0/3853255046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e280adc30 msgr2=0x7f4e280ca830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.336+0000 7f4e27e00640 1 --2- 172.21.15.70:0/3853255046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e280adc30 0x7f4e280ca830 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009890 tx=0x7f4e140046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:09.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.336+0000 7f4e27e00640 1 -- 172.21.15.70:0/3853255046 shutdown_connections 2024-09-13T16:02:09.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.336+0000 7f4e27e00640 1 --2- 172.21.15.70:0/3853255046 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4e0806ac00 0x7f4e0806d0c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:09.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.336+0000 7f4e27e00640 1 --2- 172.21.15.70:0/3853255046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e28144020 0x7f4e280b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:09.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.336+0000 7f4e27e00640 1 --2- 172.21.15.70:0/3853255046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e280adc30 0x7f4e280ca830 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:09.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.336+0000 7f4e27e00640 1 --2- 172.21.15.70:0/3853255046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e28071320 0x7f4e281326a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:09.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.336+0000 7f4e27e00640 1 -- 172.21.15.70:0/3853255046 >> 172.21.15.70:0/3853255046 conn(0x7f4e280b0300 msgr2=0x7f4e280ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:09.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.337+0000 7f4e27e00640 1 -- 172.21.15.70:0/3853255046 shutdown_connections 2024-09-13T16:02:09.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.337+0000 7f4e27e00640 1 -- 172.21.15.70:0/3853255046 wait complete. 2024-09-13T16:02:09.358 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T16:02:09.358 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T16:02:09.358 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T16:02:09.358 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:02:09.359 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T16:02:09.359 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T16:02:09.359 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T16:02:09.359 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:02:09.359 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T16:02:09.359 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T16:02:09.360 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T16:02:09.360 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:02:09.360 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T16:02:09.360 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T16:02:09.360 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T16:02:09.360 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:02:09.377 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T16:02:09.377 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T16:02:09.377 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T16:02:09.378 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T16:02:09.379 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T16:02:09.379 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T16:02:09.379 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T16:02:09.379 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T16:02:09.420 INFO:tasks.ceph.mds.d:Started 2024-09-13T16:02:09.421 DEBUG:teuthology.parallel:result is None 2024-09-13T16:02:09.421 INFO:tasks.ceph.mds.a:Started 2024-09-13T16:02:09.421 DEBUG:teuthology.parallel:result is None 2024-09-13T16:02:09.423 INFO:tasks.ceph.mds.b:Started 2024-09-13T16:02:09.423 DEBUG:teuthology.parallel:result is None 2024-09-13T16:02:09.423 INFO:tasks.ceph.mds.c:Started 2024-09-13T16:02:09.424 DEBUG:teuthology.parallel:result is None 2024-09-13T16:02:09.424 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T16:02:09.552 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-09-13T16:02:09.552 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-09-13T16:02:09.554 INFO:tasks.ceph.mds.a.smithi070.stdout:starting mds.a at 2024-09-13T16:02:09.554 INFO:tasks.ceph.mds.c.smithi070.stdout:starting mds.c at 2024-09-13T16:02:09.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.598+0000 7ff953600640 1 Processor -- start 2024-09-13T16:02:09.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.598+0000 7ff953600640 1 -- start start 2024-09-13T16:02:09.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.599+0000 7ff953600640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff94c0ce0c0 0x7ff94c0714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:09.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.599+0000 7ff953600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff94c0b26f0 0x7ff94c0b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:09.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.599+0000 7ff953600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94c071060 con 0x7ff94c164690 2024-09-13T16:02:09.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.599+0000 7ff953600640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff94c070450 con 0x7ff94c0ce0c0 2024-09-13T16:02:09.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.599+0000 7ff953600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff94c070730 con 0x7ff94c0b26f0 2024-09-13T16:02:09.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.599+0000 7ff950c00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff94c0ce0c0 0x7ff94c0714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:09.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.599+0000 7ff950c00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff94c0ce0c0 0x7ff94c0714f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33020/0 (socket says 172.21.15.70:33020) 2024-09-13T16:02:09.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.599+0000 7ff950c00640 1 -- 172.21.15.70:0/2759565928 learned_addr learned my addr 172.21.15.70:0/2759565928 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:09.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.599+0000 7ff951600640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7ff94c164690 0x7ff94c06b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41894/0 (socket says 172.21.15.70:41894) 2024-09-13T16:02:09.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.599+0000 7ff943e00640 1 --2- 172.21.15.70:0/2759565928 >> v2:172.21.15.107:3300/0 conn(0x7ff94c0b26f0 0x7ff94c0b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:09.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.600+0000 7ff950c00640 1 -- 172.21.15.70:0/2759565928 >> v2:172.21.15.107:3300/0 conn(0x7ff94c0b26f0 msgr2=0x7ff94c0b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:09.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.600+0000 7ff950c00640 1 --2- 172.21.15.70:0/2759565928 >> v2:172.21.15.107:3300/0 conn(0x7ff94c0b26f0 0x7ff94c0b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:09.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.600+0000 7ff950c00640 1 -- 172.21.15.70:0/2759565928 >> v1:172.21.15.70:6789/0 conn(0x7ff94c164690 legacy=0x7ff94c06b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:09.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.600+0000 7ff950c00640 1 -- 172.21.15.70:0/2759565928 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c070a10 con 0x7ff94c0ce0c0 2024-09-13T16:02:09.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.601+0000 7ff950c00640 1 --2- 172.21.15.70:0/2759565928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff94c0ce0c0 0x7ff94c0714f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009870 tx=0x7ff93c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952a3fefbcf2fed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:09.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.601+0000 7ff94be00640 1 -- 172.21.15.70:0/2759565928 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c032440 con 0x7ff94c0ce0c0 2024-09-13T16:02:09.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.601+0000 7ff94be00640 1 -- 172.21.15.70:0/2759565928 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c0325a0 con 0x7ff94c0ce0c0 2024-09-13T16:02:09.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.601+0000 7ff94be00640 1 -- 172.21.15.70:0/2759565928 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c032930 con 0x7ff94c0ce0c0 2024-09-13T16:02:09.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.601+0000 7ff953600640 1 -- 172.21.15.70:0/2759565928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff94c0ce0c0 msgr2=0x7ff94c0714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:09.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.601+0000 7ff953600640 1 --2- 172.21.15.70:0/2759565928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff94c0ce0c0 0x7ff94c0714f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009870 tx=0x7ff93c02a2a0 comp rx=0 tx=0).stop 2024-09-13T16:02:09.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.602+0000 7ff953600640 1 -- 172.21.15.70:0/2759565928 shutdown_connections 2024-09-13T16:02:09.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.602+0000 7ff953600640 1 --2- 172.21.15.70:0/2759565928 >> v2:172.21.15.107:3300/0 conn(0x7ff94c0b26f0 0x7ff94c0b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:09.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.602+0000 7ff953600640 1 --2- 172.21.15.70:0/2759565928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff94c0ce0c0 0x7ff94c0714f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:09.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.602+0000 7ff953600640 1 -- 172.21.15.70:0/2759565928 >> 172.21.15.70:0/2759565928 conn(0x7ff94c0b0510 msgr2=0x7ff94c0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:09.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.602+0000 7ff953600640 1 -- 172.21.15.70:0/2759565928 shutdown_connections 2024-09-13T16:02:09.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.602+0000 7ff953600640 1 -- 172.21.15.70:0/2759565928 wait complete. 2024-09-13T16:02:09.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.603+0000 7ff953600640 1 Processor -- start 2024-09-13T16:02:09.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.603+0000 7ff953600640 1 -- start start 2024-09-13T16:02:09.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.604+0000 7ff953600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff94c0b26f0 0x7ff94c15a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:09.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.604+0000 7ff953600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff94c0ce0c0 0x7ff94c0a8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:09.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.604+0000 7ff953600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff94c164690 0x7ff94c0a9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:09.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.604+0000 7ff953600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c15df50 con 0x7ff94c164690 2024-09-13T16:02:09.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.604+0000 7ff953600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c15ae50 con 0x7ff94c0b26f0 2024-09-13T16:02:09.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.604+0000 7ff953600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c15e3e0 con 0x7ff94c0ce0c0 2024-09-13T16:02:09.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.605+0000 7ff951600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff94c164690 0x7ff94c0a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:09.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.605+0000 7ff951600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff94c164690 0x7ff94c0a9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33036/0 (socket says 172.21.15.70:33036) 2024-09-13T16:02:09.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.605+0000 7ff951600640 1 -- 172.21.15.70:0/2991516181 learned_addr learned my addr 172.21.15.70:0/2991516181 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:09.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.605+0000 7ff950c00640 1 --2- 172.21.15.70:0/2991516181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff94c0b26f0 0x7ff94c15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:09.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.605+0000 7ff943e00640 1 --2- 172.21.15.70:0/2991516181 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff94c0ce0c0 0x7ff94c0a8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:09.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.605+0000 7ff951600640 1 -- 172.21.15.70:0/2991516181 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff94c0ce0c0 msgr2=0x7ff94c0a8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:09.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.605+0000 7ff951600640 1 --2- 172.21.15.70:0/2991516181 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff94c0ce0c0 0x7ff94c0a8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:09.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.605+0000 7ff951600640 1 -- 172.21.15.70:0/2991516181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff94c0b26f0 msgr2=0x7ff94c15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:09.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.605+0000 7ff951600640 1 --2- 172.21.15.70:0/2991516181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff94c0b26f0 0x7ff94c15a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:09.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.605+0000 7ff951600640 1 -- 172.21.15.70:0/2991516181 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c0094d0 con 0x7ff94c164690 2024-09-13T16:02:09.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.605+0000 7ff951600640 1 --2- 172.21.15.70:0/2991516181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff94c164690 0x7ff94c0a9290 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff94400c780 tx=0x7ff94400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:09.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.606+0000 7ff949600640 1 -- 172.21.15.70:0/2991516181 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400ce90 con 0x7ff94c164690 2024-09-13T16:02:09.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.606+0000 7ff949600640 1 -- 172.21.15.70:0/2991516181 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94400a640 con 0x7ff94c164690 2024-09-13T16:02:09.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.606+0000 7ff953600640 1 -- 172.21.15.70:0/2991516181 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94c15d340 con 0x7ff94c164690 2024-09-13T16:02:09.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.606+0000 7ff949600640 1 -- 172.21.15.70:0/2991516181 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400a9f0 con 0x7ff94c164690 2024-09-13T16:02:09.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.606+0000 7ff953600640 1 -- 172.21.15.70:0/2991516181 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94c15d900 con 0x7ff94c164690 2024-09-13T16:02:09.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.607+0000 7ff953600640 1 -- 172.21.15.70:0/2991516181 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94c15e0c0 con 0x7ff94c164690 2024-09-13T16:02:09.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.608+0000 7ff949600640 1 -- 172.21.15.70:0/2991516181 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff94400ab50 con 0x7ff94c164690 2024-09-13T16:02:09.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.608+0000 7ff949600640 1 --2- 172.21.15.70:0/2991516181 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ff92806ac30 0x7ff92806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:09.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.608+0000 7ff949600640 1 -- 172.21.15.70:0/2991516181 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff944088870 con 0x7ff94c164690 2024-09-13T16:02:09.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.609+0000 7ff950c00640 1 --2- 172.21.15.70:0/2991516181 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ff92806ac30 0x7ff92806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:09.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.609+0000 7ff950c00640 1 --2- 172.21.15.70:0/2991516181 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ff92806ac30 0x7ff92806d0f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff93c034000 tx=0x7ff93c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:09.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.613+0000 7ff949600640 1 -- 172.21.15.70:0/2991516181 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff944053d60 con 0x7ff94c164690 2024-09-13T16:02:09.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:09.793+0000 7ff953600640 1 -- 172.21.15.70:0/2991516181 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff94c164ea0 con 0x7ff94c164690 2024-09-13T16:02:10.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.590+0000 7ff949600640 1 -- 172.21.15.70:0/2991516181 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff944017080 con 0x7ff94c164690 2024-09-13T16:02:10.592 INFO:teuthology.orchestra.run.smithi070.stderr: removed all blocklist entries 2024-09-13T16:02:10.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.592+0000 7ff953600640 1 -- 172.21.15.70:0/2991516181 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ff92806ac30 msgr2=0x7ff92806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:10.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.592+0000 7ff953600640 1 --2- 172.21.15.70:0/2991516181 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ff92806ac30 0x7ff92806d0f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff93c034000 tx=0x7ff93c02e000 comp rx=0 tx=0).stop 2024-09-13T16:02:10.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.592+0000 7ff953600640 1 -- 172.21.15.70:0/2991516181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff94c164690 msgr2=0x7ff94c0a9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:10.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.592+0000 7ff953600640 1 --2- 172.21.15.70:0/2991516181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff94c164690 0x7ff94c0a9290 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff94400c780 tx=0x7ff94400cc40 comp rx=0 tx=0).stop 2024-09-13T16:02:10.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.592+0000 7ff953600640 1 -- 172.21.15.70:0/2991516181 shutdown_connections 2024-09-13T16:02:10.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.592+0000 7ff953600640 1 --2- 172.21.15.70:0/2991516181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff94c164690 0x7ff94c0a9290 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:10.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.592+0000 7ff953600640 1 --2- 172.21.15.70:0/2991516181 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff94c0ce0c0 0x7ff94c0a8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:10.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.592+0000 7ff953600640 1 --2- 172.21.15.70:0/2991516181 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ff92806ac30 0x7ff92806d0f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:10.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.592+0000 7ff953600640 1 --2- 172.21.15.70:0/2991516181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff94c0b26f0 0x7ff94c15a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:10.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.592+0000 7ff953600640 1 -- 172.21.15.70:0/2991516181 >> 172.21.15.70:0/2991516181 conn(0x7ff94c0b0510 msgr2=0x7ff94c0cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:10.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.592+0000 7ff953600640 1 -- 172.21.15.70:0/2991516181 shutdown_connections 2024-09-13T16:02:10.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.592+0000 7ff953600640 1 -- 172.21.15.70:0/2991516181 wait complete. 2024-09-13T16:02:10.612 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T16:02:10.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.761+0000 7f4f9ca00640 1 Processor -- start 2024-09-13T16:02:10.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.762+0000 7f4f9ca00640 1 -- start start 2024-09-13T16:02:10.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.763+0000 7f4f9ca00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f980cf6c0 0x7f4f980b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:10.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.763+0000 7f4f9ca00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f980cd980 con 0x7f4f9815cd40 2024-09-13T16:02:10.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.763+0000 7f4f9ca00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f980b50a0 con 0x7f4f980cde10 2024-09-13T16:02:10.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.763+0000 7f4f9ca00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f980d2010 con 0x7f4f980cf6c0 2024-09-13T16:02:10.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.763+0000 7f4f97400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f4f9815cd40 0x7f4f980b13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:51978/0 (socket says 172.21.15.70:51978) 2024-09-13T16:02:10.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.763+0000 7f4f97400640 1 -- 172.21.15.70:0/3348848001 learned_addr learned my addr 172.21.15.70:0/3348848001 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:10.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.763+0000 7f4f97e00640 1 --2- 172.21.15.70:0/3348848001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f980cf6c0 0x7f4f980b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:10.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.763+0000 7f4f96a00640 1 -- 172.21.15.70:0/3348848001 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171861548 0 0) 0x7f4f980cd980 con 0x7f4f9815cd40 2024-09-13T16:02:10.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.763+0000 7f4f96a00640 1 -- 172.21.15.70:0/3348848001 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f7c003520 con 0x7f4f9815cd40 2024-09-13T16:02:10.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.764+0000 7f4f96a00640 1 -- 172.21.15.70:0/3348848001 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011588234 0 0) 0x7f4f980b50a0 con 0x7f4f980cde10 2024-09-13T16:02:10.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.764+0000 7f4f96a00640 1 -- 172.21.15.70:0/3348848001 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f980cd980 con 0x7f4f980cde10 2024-09-13T16:02:10.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.764+0000 7f4f97e00640 1 -- 172.21.15.70:0/3348848001 >> v1:172.21.15.107:6789/0 conn(0x7f4f980cde10 legacy=0x7f4f980cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:10.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.764+0000 7f4f97e00640 1 -- 172.21.15.70:0/3348848001 >> v1:172.21.15.70:6789/0 conn(0x7f4f9815cd40 legacy=0x7f4f980b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:10.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.764+0000 7f4f96a00640 1 -- 172.21.15.70:0/3348848001 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1033186841 0 0) 0x7f4f7c003520 con 0x7f4f9815cd40 2024-09-13T16:02:10.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.764+0000 7f4f97e00640 1 -- 172.21.15.70:0/3348848001 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f980d22f0 con 0x7f4f980cf6c0 2024-09-13T16:02:10.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.765+0000 7f4f97e00640 1 --2- 172.21.15.70:0/3348848001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f980cf6c0 0x7f4f980b5d40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009dc0 tx=0x7f4f9002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f41a9d32ae26149f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:10.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.765+0000 7f4f96a00640 1 -- 172.21.15.70:0/3348848001 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f88001670 con 0x7f4f980cf6c0 2024-09-13T16:02:10.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.765+0000 7f4f96a00640 1 -- 172.21.15.70:0/3348848001 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9002d050 con 0x7f4f980cf6c0 2024-09-13T16:02:10.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.765+0000 7f4f96a00640 1 -- 172.21.15.70:0/3348848001 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90007760 con 0x7f4f980cf6c0 2024-09-13T16:02:10.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.765+0000 7f4f9ca00640 1 -- 172.21.15.70:0/3348848001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f980cf6c0 msgr2=0x7f4f980b5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:10.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.765+0000 7f4f9ca00640 1 --2- 172.21.15.70:0/3348848001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f980cf6c0 0x7f4f980b5d40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009dc0 tx=0x7f4f9002a5d0 comp rx=0 tx=0).stop 2024-09-13T16:02:10.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.766+0000 7f4f9ca00640 1 -- 172.21.15.70:0/3348848001 shutdown_connections 2024-09-13T16:02:10.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.766+0000 7f4f9ca00640 1 --2- 172.21.15.70:0/3348848001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f980cf6c0 0x7f4f980b5d40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:10.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.766+0000 7f4f9ca00640 1 -- 172.21.15.70:0/3348848001 >> 172.21.15.70:0/3348848001 conn(0x7f4f980b4240 msgr2=0x7f4f980b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:10.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.766+0000 7f4f9ca00640 1 -- 172.21.15.70:0/3348848001 shutdown_connections 2024-09-13T16:02:10.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.766+0000 7f4f9ca00640 1 -- 172.21.15.70:0/3348848001 wait complete. 2024-09-13T16:02:10.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.767+0000 7f4f9ca00640 1 Processor -- start 2024-09-13T16:02:10.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.767+0000 7f4f9ca00640 1 -- start start 2024-09-13T16:02:10.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.768+0000 7f4f9ca00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f980cde10 0x7f4f980c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:10.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.768+0000 7f4f9ca00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f980cf6c0 0x7f4f980cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:10.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.768+0000 7f4f9ca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9815cd40 0x7f4f980cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:10.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.768+0000 7f4f9ca00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f981573d0 con 0x7f4f980cf6c0 2024-09-13T16:02:10.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.768+0000 7f4f9ca00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f980c70f0 con 0x7f4f9815cd40 2024-09-13T16:02:10.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.768+0000 7f4f9ca00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f981567c0 con 0x7f4f980cde10 2024-09-13T16:02:10.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.768+0000 7f4f8fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f980cf6c0 0x7f4f980cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:10.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.768+0000 7f4f8fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f980cf6c0 0x7f4f980cb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44976/0 (socket says 172.21.15.70:44976) 2024-09-13T16:02:10.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.768+0000 7f4f8fe00640 1 -- 172.21.15.70:0/31195952 learned_addr learned my addr 172.21.15.70:0/31195952 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:10.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.769+0000 7f4f8fe00640 1 -- 172.21.15.70:0/31195952 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f980cde10 msgr2=0x7f4f980c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:10.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.769+0000 7f4f8fe00640 1 --2- 172.21.15.70:0/31195952 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f980cde10 0x7f4f980c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:10.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.769+0000 7f4f8fe00640 1 -- 172.21.15.70:0/31195952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9815cd40 msgr2=0x7f4f980cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:10.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.769+0000 7f4f8fe00640 1 --2- 172.21.15.70:0/31195952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9815cd40 0x7f4f980cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:10.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.769+0000 7f4f8fe00640 1 -- 172.21.15.70:0/31195952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f90009a70 con 0x7f4f980cf6c0 2024-09-13T16:02:10.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.769+0000 7f4f8fe00640 1 --2- 172.21.15.70:0/31195952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f980cf6c0 0x7f4f980cb910 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000c490 tx=0x7f4f8000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:10.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.769+0000 7f4f8f400640 1 -- 172.21.15.70:0/31195952 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f800052d0 con 0x7f4f980cf6c0 2024-09-13T16:02:10.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.769+0000 7f4f8f400640 1 -- 172.21.15.70:0/31195952 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f80005430 con 0x7f4f980cf6c0 2024-09-13T16:02:10.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.769+0000 7f4f8f400640 1 -- 172.21.15.70:0/31195952 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80012870 con 0x7f4f980cf6c0 2024-09-13T16:02:10.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.769+0000 7f4f9ca00640 1 -- 172.21.15.70:0/31195952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f98156aa0 con 0x7f4f980cf6c0 2024-09-13T16:02:10.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.769+0000 7f4f9ca00640 1 -- 172.21.15.70:0/31195952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f98157060 con 0x7f4f980cf6c0 2024-09-13T16:02:10.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.770+0000 7f4f9ca00640 1 -- 172.21.15.70:0/31195952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9815d120 con 0x7f4f980cf6c0 2024-09-13T16:02:10.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.771+0000 7f4f8f400640 1 -- 172.21.15.70:0/31195952 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4f800129d0 con 0x7f4f980cf6c0 2024-09-13T16:02:10.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.772+0000 7f4f8f400640 1 --2- 172.21.15.70:0/31195952 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4f7406ac00 0x7f4f7406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:10.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.772+0000 7f4f8f400640 1 -- 172.21.15.70:0/31195952 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4f80088d00 con 0x7f4f980cf6c0 2024-09-13T16:02:10.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.772+0000 7f4f97400640 1 --2- 172.21.15.70:0/31195952 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4f7406ac00 0x7f4f7406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:10.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.773+0000 7f4f97400640 1 --2- 172.21.15.70:0/31195952 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4f7406ac00 0x7f4f7406d0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4f88001da0 tx=0x7f4f880010a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:10.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:10.776+0000 7f4f8f400640 1 -- 172.21.15.70:0/31195952 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4f80054100 con 0x7f4f980cf6c0 2024-09-13T16:02:11.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.004+0000 7f4f9ca00640 1 -- 172.21.15.70:0/31195952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4f98157510 con 0x7f4f980cf6c0 2024-09-13T16:02:11.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.005+0000 7f4f8f400640 1 -- 172.21.15.70:0/31195952 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f4f80057720 con 0x7f4f980cf6c0 2024-09-13T16:02:11.007 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:11.007 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-13T16:02:11.008 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_dump": [ 2024-09-13T16:02:11.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.008 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.a", 2024-09-13T16:02:11.008 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCTYeRmf0EeEBAANOwP4Rx6m7JQr0S+co+pbg==", 2024-09-13T16:02:11.008 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.008 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2024-09-13T16:02:11.009 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2024-09-13T16:02:11.009 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2024-09-13T16:02:11.009 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2024-09-13T16:02:11.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.010 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.b", 2024-09-13T16:02:11.010 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCTYeRmOzq6IxAAOTeumxLZLNyzPmRpXSMBNg==", 2024-09-13T16:02:11.010 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.010 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2024-09-13T16:02:11.010 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2024-09-13T16:02:11.011 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2024-09-13T16:02:11.011 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2024-09-13T16:02:11.011 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.011 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.c", 2024-09-13T16:02:11.012 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCTYeRmdzvuGRAA7i5QwfdmKJt//sbJl3gi2g==", 2024-09-13T16:02:11.012 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.012 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2024-09-13T16:02:11.012 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2024-09-13T16:02:11.013 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2024-09-13T16:02:11.013 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2024-09-13T16:02:11.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.013 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.d", 2024-09-13T16:02:11.014 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCTYeRmUkNvLRAAuacRjRLrybeG5Nq4QRYpSA==", 2024-09-13T16:02:11.014 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.014 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2024-09-13T16:02:11.014 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2024-09-13T16:02:11.014 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2024-09-13T16:02:11.015 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2024-09-13T16:02:11.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.015 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.0", 2024-09-13T16:02:11.015 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCVYeRmDV9lIBAA4dYsVKkrk5yU1UEtZQ7WBw==", 2024-09-13T16:02:11.016 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.016 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2024-09-13T16:02:11.016 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2024-09-13T16:02:11.016 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2024-09-13T16:02:11.016 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.017 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.1", 2024-09-13T16:02:11.017 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCYYeRmhJW7JRAA9IDJ1UsNzY7xB0EPEZqKPw==", 2024-09-13T16:02:11.017 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.018 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2024-09-13T16:02:11.018 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2024-09-13T16:02:11.018 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2024-09-13T16:02:11.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.019 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.2", 2024-09-13T16:02:11.019 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCbYeRmyghwKRAAICRndBNYIgljsFAVQ/IxUw==", 2024-09-13T16:02:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2024-09-13T16:02:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2024-09-13T16:02:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2024-09-13T16:02:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.3", 2024-09-13T16:02:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCeYeRmKCIjLhAA82aqewcz+IA6a5F/lSVphw==", 2024-09-13T16:02:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2024-09-13T16:02:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2024-09-13T16:02:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2024-09-13T16:02:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.4", 2024-09-13T16:02:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCkYeRmi7UrJhAAuyExOGdyt2XsCjMnMu3PuA==", 2024-09-13T16:02:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2024-09-13T16:02:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2024-09-13T16:02:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2024-09-13T16:02:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.5", 2024-09-13T16:02:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCnYeRmi04EKxAA1ugmJrtQTm0u+fDSfCFAQw==", 2024-09-13T16:02:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2024-09-13T16:02:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2024-09-13T16:02:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2024-09-13T16:02:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.6", 2024-09-13T16:02:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCqYeRmyaj8MBAATkdC1At+nAkXFz6Z23+rAg==", 2024-09-13T16:02:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2024-09-13T16:02:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2024-09-13T16:02:11.023 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2024-09-13T16:02:11.023 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.023 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.7", 2024-09-13T16:02:11.023 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCtYeRm+nO0NhAAnZYoojpcPIdkG316fKLNCA==", 2024-09-13T16:02:11.023 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.023 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2024-09-13T16:02:11.023 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2024-09-13T16:02:11.023 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2024-09-13T16:02:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.0", 2024-09-13T16:02:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCTYeRm1wjoNRAARZVmRL3tKm7pe0PP5XE64w==", 2024-09-13T16:02:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2024-09-13T16:02:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow r", 2024-09-13T16:02:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow rw", 2024-09-13T16:02:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rwx" 2024-09-13T16:02:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.1", 2024-09-13T16:02:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCUYeRmw9QzBxAA1rIpPA82YNNW53B3qn1ulQ==", 2024-09-13T16:02:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2024-09-13T16:02:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow r", 2024-09-13T16:02:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow rw", 2024-09-13T16:02:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rwx" 2024-09-13T16:02:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.2", 2024-09-13T16:02:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCUYeRmEJq0ABAAigg7mMIYxx3g8o7GUuQERg==", 2024-09-13T16:02:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2024-09-13T16:02:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow r", 2024-09-13T16:02:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow rw", 2024-09-13T16:02:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rwx" 2024-09-13T16:02:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.3", 2024-09-13T16:02:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCUYeRm+SGQDRAAyWXGqr8yOqIl174YyTUd6w==", 2024-09-13T16:02:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2024-09-13T16:02:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow r", 2024-09-13T16:02:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow rw", 2024-09-13T16:02:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rwx" 2024-09-13T16:02:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.admin", 2024-09-13T16:02:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCSYeRmpfFTHBAAFnB/XM/fnN1JYRDE4WnWUg==", 2024-09-13T16:02:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow *", 2024-09-13T16:02:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2024-09-13T16:02:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2024-09-13T16:02:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2024-09-13T16:02:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.bootstrap-mds", 2024-09-13T16:02:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQC1YeRmsDMTFhAAxPmZDrTNrFTI+dH6XlDUsA==", 2024-09-13T16:02:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile bootstrap-mds" 2024-09-13T16:02:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.bootstrap-mgr", 2024-09-13T16:02:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQC1YeRmDz0TFhAAmqn6nhiL1kujzUFYKDr3jg==", 2024-09-13T16:02:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-13T16:02:11.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.bootstrap-osd", 2024-09-13T16:02:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQC1YeRm0kUTFhAAai1FLZ1ihSoCcALhoi+t8w==", 2024-09-13T16:02:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile bootstrap-osd" 2024-09-13T16:02:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.bootstrap-rbd", 2024-09-13T16:02:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQC1YeRmFU4TFhAARIil4OiBmeFWZMeb0GuJBw==", 2024-09-13T16:02:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-13T16:02:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-13T16:02:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQC1YeRmV1YTFhAAyuUF1QG0AW9VWnFPWJZwOg==", 2024-09-13T16:02:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-13T16:02:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.bootstrap-rgw", 2024-09-13T16:02:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQC1YeRm7F4TFhAAGOw4gE6f45rw/5rOaRGSRw==", 2024-09-13T16:02:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-13T16:02:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mgr.x", 2024-09-13T16:02:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCTYeRmkeaWCRAAhsqaCBOmlWijduzPWf48hg==", 2024-09-13T16:02:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow *", 2024-09-13T16:02:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile mgr", 2024-09-13T16:02:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2024-09-13T16:02:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-13T16:02:11.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:11.033 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mgr.y", 2024-09-13T16:02:11.033 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQCTYeRmfdx6AhAA1qfblyX/kJpcJpTK/qWShg==", 2024-09-13T16:02:11.033 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2024-09-13T16:02:11.033 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow *", 2024-09-13T16:02:11.033 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile mgr", 2024-09-13T16:02:11.033 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2024-09-13T16:02:11.033 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.033 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:11.033 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-13T16:02:11.033 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-13T16:02:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.007+0000 7f4f9ca00640 1 -- 172.21.15.70:0/31195952 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4f7406ac00 msgr2=0x7f4f7406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.007+0000 7f4f9ca00640 1 --2- 172.21.15.70:0/31195952 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4f7406ac00 0x7f4f7406d0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4f88001da0 tx=0x7f4f880010a0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.007+0000 7f4f9ca00640 1 -- 172.21.15.70:0/31195952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f980cf6c0 msgr2=0x7f4f980cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.007+0000 7f4f9ca00640 1 --2- 172.21.15.70:0/31195952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f980cf6c0 0x7f4f980cb910 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000c490 tx=0x7f4f8000c950 comp rx=0 tx=0).stop 2024-09-13T16:02:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.007+0000 7f4f9ca00640 1 -- 172.21.15.70:0/31195952 shutdown_connections 2024-09-13T16:02:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.007+0000 7f4f9ca00640 1 --2- 172.21.15.70:0/31195952 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4f7406ac00 0x7f4f7406d0c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.007+0000 7f4f9ca00640 1 --2- 172.21.15.70:0/31195952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9815cd40 0x7f4f980cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.007+0000 7f4f9ca00640 1 --2- 172.21.15.70:0/31195952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f980cf6c0 0x7f4f980cb910 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.007+0000 7f4f9ca00640 1 --2- 172.21.15.70:0/31195952 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f980cde10 0x7f4f980c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.007+0000 7f4f9ca00640 1 -- 172.21.15.70:0/31195952 >> 172.21.15.70:0/31195952 conn(0x7f4f980b4240 msgr2=0x7f4f980b7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:11.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.007+0000 7f4f9ca00640 1 -- 172.21.15.70:0/31195952 shutdown_connections 2024-09-13T16:02:11.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.007+0000 7f4f9ca00640 1 -- 172.21.15.70:0/31195952 wait complete. 2024-09-13T16:02:11.037 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-13T16:02:11.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.188+0000 7f13ad200640 1 Processor -- start 2024-09-13T16:02:11.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.188+0000 7f13ad200640 1 -- start start 2024-09-13T16:02:11.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.189+0000 7f13ad200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f13a815a520 0x7f13a806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:11.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.189+0000 7f13ad200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f13a80b1b00 0x7f13a80cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:11.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.190+0000 7f13ad200640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a806bc00 con 0x7f13a80cde50 2024-09-13T16:02:11.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.190+0000 7f13ad200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a806bea0 con 0x7f13a80b1b00 2024-09-13T16:02:11.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.190+0000 7f13ad200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a806c180 con 0x7f13a815a520 2024-09-13T16:02:11.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.190+0000 7f139d400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f13a80b1b00 0x7f13a80cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:11.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.190+0000 7f139d400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f13a80b1b00 0x7f13a80cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44990/0 (socket says 172.21.15.70:44990) 2024-09-13T16:02:11.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.190+0000 7f139d400640 1 -- 172.21.15.70:0/2449507206 learned_addr learned my addr 172.21.15.70:0/2449507206 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:11.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.190+0000 7f13a6800640 1 --1- 172.21.15.70:0/2449507206 >> v1:172.21.15.70:6789/0 conn(0x7f13a80cde50 0x7f13a80b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:51984/0 (socket says 172.21.15.70:51984) 2024-09-13T16:02:11.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.190+0000 7f13a5e00640 1 --2- 172.21.15.70:0/2449507206 >> v2:172.21.15.107:3300/0 conn(0x7f13a815a520 0x7f13a806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:11.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.190+0000 7f139d400640 1 -- 172.21.15.70:0/2449507206 >> v2:172.21.15.107:3300/0 conn(0x7f13a815a520 msgr2=0x7f13a806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:11.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.190+0000 7f139d400640 1 --2- 172.21.15.70:0/2449507206 >> v2:172.21.15.107:3300/0 conn(0x7f13a815a520 0x7f13a806b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.190+0000 7f139d400640 1 -- 172.21.15.70:0/2449507206 >> v1:172.21.15.70:6789/0 conn(0x7f13a80cde50 legacy=0x7f13a80b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:11.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.190+0000 7f139d400640 1 -- 172.21.15.70:0/2449507206 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a806c460 con 0x7f13a80b1b00 2024-09-13T16:02:11.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.191+0000 7f139d400640 1 --2- 172.21.15.70:0/2449507206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a80b1b00 0x7f13a80cd910 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f13a80b14f0 tx=0x7f139002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e56518a90af2af5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:11.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.191+0000 7f13a5400640 1 -- 172.21.15.70:0/2449507206 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390032440 con 0x7f13a80b1b00 2024-09-13T16:02:11.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.192+0000 7f13a5400640 1 -- 172.21.15.70:0/2449507206 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13900325a0 con 0x7f13a80b1b00 2024-09-13T16:02:11.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.192+0000 7f13a5400640 1 -- 172.21.15.70:0/2449507206 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390032930 con 0x7f13a80b1b00 2024-09-13T16:02:11.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.192+0000 7f13ad200640 1 -- 172.21.15.70:0/2449507206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a80b1b00 msgr2=0x7f13a80cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:11.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.192+0000 7f13ad200640 1 --2- 172.21.15.70:0/2449507206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a80b1b00 0x7f13a80cd910 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f13a80b14f0 tx=0x7f139002a270 comp rx=0 tx=0).stop 2024-09-13T16:02:11.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.192+0000 7f13ad200640 1 -- 172.21.15.70:0/2449507206 shutdown_connections 2024-09-13T16:02:11.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.192+0000 7f13ad200640 1 --2- 172.21.15.70:0/2449507206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a80b1b00 0x7f13a80cd910 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.192+0000 7f13ad200640 1 --2- 172.21.15.70:0/2449507206 >> v2:172.21.15.107:3300/0 conn(0x7f13a815a520 0x7f13a806b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.192+0000 7f13ad200640 1 -- 172.21.15.70:0/2449507206 >> 172.21.15.70:0/2449507206 conn(0x7f13a80b0510 msgr2=0x7f13a80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:11.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.192+0000 7f13ad200640 1 -- 172.21.15.70:0/2449507206 shutdown_connections 2024-09-13T16:02:11.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.192+0000 7f13ad200640 1 -- 172.21.15.70:0/2449507206 wait complete. 2024-09-13T16:02:11.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.194+0000 7f13ad200640 1 Processor -- start 2024-09-13T16:02:11.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.194+0000 7f13ad200640 1 -- start start 2024-09-13T16:02:11.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.195+0000 7f13ad200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13a80b1b00 0x7f13a80acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:11.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.195+0000 7f13ad200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13a80cde50 0x7f13a8154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:11.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.195+0000 7f13ad200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a815a520 0x7f13a814d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:11.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.195+0000 7f13ad200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a806fd20 con 0x7f13a815a520 2024-09-13T16:02:11.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.195+0000 7f13ad200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a8070000 con 0x7f13a80cde50 2024-09-13T16:02:11.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.195+0000 7f13ad200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a80702e0 con 0x7f13a80b1b00 2024-09-13T16:02:11.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.195+0000 7f13a6800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a815a520 0x7f13a814d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:11.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.195+0000 7f13a6800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a815a520 0x7f13a814d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45004/0 (socket says 172.21.15.70:45004) 2024-09-13T16:02:11.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.195+0000 7f13a6800640 1 -- 172.21.15.70:0/4105720699 learned_addr learned my addr 172.21.15.70:0/4105720699 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:11.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.195+0000 7f139d400640 1 --2- 172.21.15.70:0/4105720699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13a80cde50 0x7f13a8154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:11.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.195+0000 7f13a6800640 1 -- 172.21.15.70:0/4105720699 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13a80b1b00 msgr2=0x7f13a80acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:11.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.195+0000 7f13a6800640 1 --2- 172.21.15.70:0/4105720699 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13a80b1b00 0x7f13a80acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.195+0000 7f13a6800640 1 -- 172.21.15.70:0/4105720699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13a80cde50 msgr2=0x7f13a8154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:11.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.195+0000 7f13a6800640 1 --2- 172.21.15.70:0/4105720699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13a80cde50 0x7f13a8154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.195+0000 7f13a6800640 1 -- 172.21.15.70:0/4105720699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13900094d0 con 0x7f13a815a520 2024-09-13T16:02:11.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.196+0000 7f13a6800640 1 --2- 172.21.15.70:0/4105720699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a815a520 0x7f13a814d8f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f13a000c780 tx=0x7f13a000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:11.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.196+0000 7f139ea00640 1 -- 172.21.15.70:0/4105720699 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a000ce90 con 0x7f13a815a520 2024-09-13T16:02:11.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.196+0000 7f139ea00640 1 -- 172.21.15.70:0/4105720699 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a000a640 con 0x7f13a815a520 2024-09-13T16:02:11.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.196+0000 7f13ad200640 1 -- 172.21.15.70:0/4105720699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a80705c0 con 0x7f13a815a520 2024-09-13T16:02:11.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.196+0000 7f139ea00640 1 -- 172.21.15.70:0/4105720699 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a000a9f0 con 0x7f13a815a520 2024-09-13T16:02:11.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.196+0000 7f13ad200640 1 -- 172.21.15.70:0/4105720699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a80ad020 con 0x7f13a815a520 2024-09-13T16:02:11.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.197+0000 7f13ad200640 1 -- 172.21.15.70:0/4105720699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a8070ae0 con 0x7f13a815a520 2024-09-13T16:02:11.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.198+0000 7f139ea00640 1 -- 172.21.15.70:0/4105720699 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f13a000ab50 con 0x7f13a815a520 2024-09-13T16:02:11.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.199+0000 7f139ea00640 1 --2- 172.21.15.70:0/4105720699 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f138406ac00 0x7f138406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:11.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.199+0000 7f139ea00640 1 -- 172.21.15.70:0/4105720699 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f13a0088730 con 0x7f13a815a520 2024-09-13T16:02:11.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.199+0000 7f13a5e00640 1 --2- 172.21.15.70:0/4105720699 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f138406ac00 0x7f138406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:11.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.200+0000 7f13a5e00640 1 --2- 172.21.15.70:0/4105720699 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f138406ac00 0x7f138406d0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1398006a90 tx=0x7f1398006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:11.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.203+0000 7f139ea00640 1 -- 172.21.15.70:0/4105720699 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f13a8070ae0 con 0x7f13a815a520 2024-09-13T16:02:11.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.435+0000 7f13ad200640 1 -- 172.21.15.70:0/4105720699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f13a8070ae0 con 0x7f13a815a520 2024-09-13T16:02:11.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.439+0000 7f139ea00640 1 -- 172.21.15.70:0/4105720699 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f13a8070ae0 con 0x7f13a815a520 2024-09-13T16:02:11.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.441+0000 7f13ad200640 1 -- 172.21.15.70:0/4105720699 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f138406ac00 msgr2=0x7f138406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:11.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.441+0000 7f13ad200640 1 --2- 172.21.15.70:0/4105720699 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f138406ac00 0x7f138406d0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1398006a90 tx=0x7f1398006a20 comp rx=0 tx=0).stop 2024-09-13T16:02:11.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.441+0000 7f13ad200640 1 -- 172.21.15.70:0/4105720699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a815a520 msgr2=0x7f13a814d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:11.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.441+0000 7f13ad200640 1 --2- 172.21.15.70:0/4105720699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a815a520 0x7f13a814d8f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f13a000c780 tx=0x7f13a000cc40 comp rx=0 tx=0).stop 2024-09-13T16:02:11.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.441+0000 7f13ad200640 1 -- 172.21.15.70:0/4105720699 shutdown_connections 2024-09-13T16:02:11.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.441+0000 7f13ad200640 1 --2- 172.21.15.70:0/4105720699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a815a520 0x7f13a814d8f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.442+0000 7f13ad200640 1 --2- 172.21.15.70:0/4105720699 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f138406ac00 0x7f138406d0c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.442+0000 7f13ad200640 1 --2- 172.21.15.70:0/4105720699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13a80cde50 0x7f13a8154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.442+0000 7f13ad200640 1 --2- 172.21.15.70:0/4105720699 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f13a80b1b00 0x7f13a80acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.442+0000 7f13ad200640 1 -- 172.21.15.70:0/4105720699 >> 172.21.15.70:0/4105720699 conn(0x7f13a80b0510 msgr2=0x7f13a80cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:11.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.442+0000 7f13ad200640 1 -- 172.21.15.70:0/4105720699 shutdown_connections 2024-09-13T16:02:11.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.442+0000 7f13ad200640 1 -- 172.21.15.70:0/4105720699 wait complete. 2024-09-13T16:02:11.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-13T16:02:11.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.610+0000 7f276bc00640 1 Processor -- start 2024-09-13T16:02:11.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.610+0000 7f276bc00640 1 -- start start 2024-09-13T16:02:11.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.611+0000 7f276bc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2764153b20 0x7f27640b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:11.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.611+0000 7f276bc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2764159a80 0x7f27640b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:11.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.611+0000 7f276bc00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f27640b2410 0x7f276406f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:11.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.611+0000 7f276bc00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27640ce600 con 0x7f27640b2410 2024-09-13T16:02:11.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.611+0000 7f276bc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2764070f90 con 0x7f2764159a80 2024-09-13T16:02:11.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.611+0000 7f276bc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2764153f00 con 0x7f2764153b20 2024-09-13T16:02:11.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.611+0000 7f2769c00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f27640b2410 0x7f276406f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:11.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.612+0000 7f2769c00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f27640b2410 0x7f276406f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45018/0 (socket says 172.21.15.70:45018) 2024-09-13T16:02:11.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.612+0000 7f2769c00640 1 -- 172.21.15.70:0/874894730 learned_addr learned my addr 172.21.15.70:0/874894730 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:11.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.612+0000 7f2763e00640 1 --2- 172.21.15.70:0/874894730 >> v2:172.21.15.107:3300/0 conn(0x7f2764159a80 0x7f27640b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:11.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.612+0000 7f2769200640 1 --2- 172.21.15.70:0/874894730 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2764153b20 0x7f27640b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:11.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.612+0000 7f2769c00640 1 -- 172.21.15.70:0/874894730 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2764153b20 msgr2=0x7f27640b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:11.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.612+0000 7f2769c00640 1 --2- 172.21.15.70:0/874894730 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2764153b20 0x7f27640b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.612+0000 7f2769c00640 1 -- 172.21.15.70:0/874894730 >> v2:172.21.15.107:3300/0 conn(0x7f2764159a80 msgr2=0x7f27640b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:11.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.612+0000 7f2769c00640 1 --2- 172.21.15.70:0/874894730 >> v2:172.21.15.107:3300/0 conn(0x7f2764159a80 0x7f27640b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.612+0000 7f2769c00640 1 -- 172.21.15.70:0/874894730 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27640b1a40 con 0x7f27640b2410 2024-09-13T16:02:11.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.612+0000 7f2769200640 1 --2- 172.21.15.70:0/874894730 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2764153b20 0x7f27640b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:11.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.613+0000 7f2769c00640 1 --2- 172.21.15.70:0/874894730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27640b2410 0x7f276406f660 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f276406b850 tx=0x7f275c02c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89958f6b4da18e99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:11.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.613+0000 7f2763400640 1 -- 172.21.15.70:0/874894730 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c02f070 con 0x7f27640b2410 2024-09-13T16:02:11.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.613+0000 7f2763400640 1 -- 172.21.15.70:0/874894730 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c00b2e0 con 0x7f27640b2410 2024-09-13T16:02:11.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.613+0000 7f2763400640 1 -- 172.21.15.70:0/874894730 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c009820 con 0x7f27640b2410 2024-09-13T16:02:11.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.614+0000 7f276bc00640 1 -- 172.21.15.70:0/874894730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27640b2410 msgr2=0x7f276406f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:11.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.614+0000 7f276bc00640 1 --2- 172.21.15.70:0/874894730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27640b2410 0x7f276406f660 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f276406b850 tx=0x7f275c02c8e0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.614+0000 7f276bc00640 1 -- 172.21.15.70:0/874894730 shutdown_connections 2024-09-13T16:02:11.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.614+0000 7f276bc00640 1 --2- 172.21.15.70:0/874894730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27640b2410 0x7f276406f660 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.614+0000 7f276bc00640 1 --2- 172.21.15.70:0/874894730 >> v2:172.21.15.107:3300/0 conn(0x7f2764159a80 0x7f27640b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.614+0000 7f276bc00640 1 --2- 172.21.15.70:0/874894730 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2764153b20 0x7f27640b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.614+0000 7f276bc00640 1 -- 172.21.15.70:0/874894730 >> 172.21.15.70:0/874894730 conn(0x7f27640b0510 msgr2=0x7f27640b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:11.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.614+0000 7f276bc00640 1 -- 172.21.15.70:0/874894730 shutdown_connections 2024-09-13T16:02:11.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.614+0000 7f276bc00640 1 -- 172.21.15.70:0/874894730 wait complete. 2024-09-13T16:02:11.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.615+0000 7f276bc00640 1 Processor -- start 2024-09-13T16:02:11.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.616+0000 7f276bc00640 1 -- start start 2024-09-13T16:02:11.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.616+0000 7f276bc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27640b2410 0x7f2764156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:11.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.616+0000 7f276bc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2764153b20 0x7f276414f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:11.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.616+0000 7f276bc00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2764159a80 0x7f276414f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:11.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.616+0000 7f276bc00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2764156fc0 con 0x7f2764159a80 2024-09-13T16:02:11.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.616+0000 7f276bc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2764151800 con 0x7f27640b2410 2024-09-13T16:02:11.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.616+0000 7f276bc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2764151ae0 con 0x7f2764153b20 2024-09-13T16:02:11.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.617+0000 7f2769c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2764159a80 0x7f276414f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:11.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.617+0000 7f2769200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27640b2410 0x7f2764156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:11.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.617+0000 7f2769c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2764159a80 0x7f276414f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45034/0 (socket says 172.21.15.70:45034) 2024-09-13T16:02:11.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.617+0000 7f2769c00640 1 -- 172.21.15.70:0/3293510962 learned_addr learned my addr 172.21.15.70:0/3293510962 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:11.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.617+0000 7f2763e00640 1 --2- 172.21.15.70:0/3293510962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2764153b20 0x7f276414f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:11.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.617+0000 7f2769c00640 1 -- 172.21.15.70:0/3293510962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2764153b20 msgr2=0x7f276414f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:11.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.617+0000 7f2769c00640 1 --2- 172.21.15.70:0/3293510962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2764153b20 0x7f276414f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.617+0000 7f2769c00640 1 -- 172.21.15.70:0/3293510962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27640b2410 msgr2=0x7f2764156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:11.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.617+0000 7f2769c00640 1 --2- 172.21.15.70:0/3293510962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27640b2410 0x7f2764156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.617+0000 7f2769c00640 1 -- 172.21.15.70:0/3293510962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c00bd40 con 0x7f2764159a80 2024-09-13T16:02:11.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.617+0000 7f2769200640 1 --2- 172.21.15.70:0/3293510962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27640b2410 0x7f2764156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:11.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.617+0000 7f2769c00640 1 --2- 172.21.15.70:0/3293510962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2764159a80 0x7f276414f5b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f275c00d270 tx=0x7f275c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:11.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.618+0000 7f2760c00640 1 -- 172.21.15.70:0/3293510962 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c034bc0 con 0x7f2764159a80 2024-09-13T16:02:11.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.618+0000 7f2760c00640 1 -- 172.21.15.70:0/3293510962 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c034d20 con 0x7f2764159a80 2024-09-13T16:02:11.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.618+0000 7f2760c00640 1 -- 172.21.15.70:0/3293510962 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c047630 con 0x7f2764159a80 2024-09-13T16:02:11.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.618+0000 7f276bc00640 1 -- 172.21.15.70:0/3293510962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2764156560 con 0x7f2764159a80 2024-09-13T16:02:11.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.618+0000 7f276bc00640 1 -- 172.21.15.70:0/3293510962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2764154450 con 0x7f2764159a80 2024-09-13T16:02:11.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.619+0000 7f276bc00640 1 -- 172.21.15.70:0/3293510962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2764156780 con 0x7f2764159a80 2024-09-13T16:02:11.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.620+0000 7f2760c00640 1 -- 172.21.15.70:0/3293510962 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f275c03d410 con 0x7f2764159a80 2024-09-13T16:02:11.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.620+0000 7f2760c00640 1 --2- 172.21.15.70:0/3293510962 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f274406ac30 0x7f274406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:11.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.621+0000 7f2760c00640 1 -- 172.21.15.70:0/3293510962 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f275c0ab8a0 con 0x7f2764159a80 2024-09-13T16:02:11.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.621+0000 7f2769200640 1 --2- 172.21.15.70:0/3293510962 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f274406ac30 0x7f274406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:11.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.621+0000 7f2769200640 1 --2- 172.21.15.70:0/3293510962 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f274406ac30 0x7f274406d0f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f275800b880 tx=0x7f2758008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:11.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.625+0000 7f2760c00640 1 -- 172.21.15.70:0/3293510962 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f275c076e70 con 0x7f2764159a80 2024-09-13T16:02:11.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.857+0000 7f276bc00640 1 -- 172.21.15.70:0/3293510962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f27640b3990 con 0x7f2764159a80 2024-09-13T16:02:11.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.861+0000 7f2760c00640 1 -- 172.21.15.70:0/3293510962 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f275c00b720 con 0x7f2764159a80 2024-09-13T16:02:11.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.864+0000 7f276bc00640 1 -- 172.21.15.70:0/3293510962 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f274406ac30 msgr2=0x7f274406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:11.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.864+0000 7f276bc00640 1 --2- 172.21.15.70:0/3293510962 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f274406ac30 0x7f274406d0f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f275800b880 tx=0x7f2758008040 comp rx=0 tx=0).stop 2024-09-13T16:02:11.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.864+0000 7f276bc00640 1 -- 172.21.15.70:0/3293510962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2764159a80 msgr2=0x7f276414f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:11.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.864+0000 7f276bc00640 1 --2- 172.21.15.70:0/3293510962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2764159a80 0x7f276414f5b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f275c00d270 tx=0x7f275c004a40 comp rx=0 tx=0).stop 2024-09-13T16:02:11.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.864+0000 7f276bc00640 1 -- 172.21.15.70:0/3293510962 shutdown_connections 2024-09-13T16:02:11.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.864+0000 7f276bc00640 1 --2- 172.21.15.70:0/3293510962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2764159a80 0x7f276414f5b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.864+0000 7f276bc00640 1 --2- 172.21.15.70:0/3293510962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2764153b20 0x7f276414f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.864+0000 7f276bc00640 1 --2- 172.21.15.70:0/3293510962 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f274406ac30 0x7f274406d0f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.864+0000 7f276bc00640 1 --2- 172.21.15.70:0/3293510962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27640b2410 0x7f2764156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:11.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.864+0000 7f276bc00640 1 -- 172.21.15.70:0/3293510962 >> 172.21.15.70:0/3293510962 conn(0x7f27640b0510 msgr2=0x7f27640cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:11.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.864+0000 7f276bc00640 1 -- 172.21.15.70:0/3293510962 shutdown_connections 2024-09-13T16:02:11.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:11.864+0000 7f276bc00640 1 -- 172.21.15.70:0/3293510962 wait complete. 2024-09-13T16:02:11.882 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-13T16:02:12.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.033+0000 7f842ae00640 1 Processor -- start 2024-09-13T16:02:12.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.033+0000 7f842ae00640 1 -- start start 2024-09-13T16:02:12.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.034+0000 7f842ae00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f842415a5c0 0x7f84240b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:12.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.034+0000 7f842ae00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84240cbac0 0x7f84240b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:12.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.034+0000 7f842ae00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84240cbfc0 con 0x7f84240afe10 2024-09-13T16:02:12.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.034+0000 7f842ae00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84240cce20 con 0x7f842415a5c0 2024-09-13T16:02:12.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.034+0000 7f842ae00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84240707a0 con 0x7f84240cbac0 2024-09-13T16:02:12.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.034+0000 7f8429a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f842415a5c0 0x7f84240b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:12.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.034+0000 7f8429a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f842415a5c0 0x7f84240b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45040/0 (socket says 172.21.15.70:45040) 2024-09-13T16:02:12.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.034+0000 7f8429a00640 1 -- 172.21.15.70:0/4031699276 learned_addr learned my addr 172.21.15.70:0/4031699276 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:12.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.034+0000 7f8429000640 1 --2- 172.21.15.70:0/4031699276 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84240cbac0 0x7f84240b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:12.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.035+0000 7f8429a00640 1 -- 172.21.15.70:0/4031699276 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84240cbac0 msgr2=0x7f84240b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:12.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.035+0000 7f8429a00640 1 --2- 172.21.15.70:0/4031699276 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84240cbac0 0x7f84240b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.035+0000 7f8429a00640 1 -- 172.21.15.70:0/4031699276 >> v1:172.21.15.107:6789/0 conn(0x7f84240afe10 legacy=0x7f842406f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:12.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.035+0000 7f8429a00640 1 -- 172.21.15.70:0/4031699276 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8424070a80 con 0x7f842415a5c0 2024-09-13T16:02:12.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.036+0000 7f8429a00640 1 --2- 172.21.15.70:0/4031699276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f842415a5c0 0x7f84240b39b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8418009870 tx=0x7f841802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5db25b8f5b12c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:12.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.036+0000 7f8423e00640 1 -- 172.21.15.70:0/4031699276 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418032440 con 0x7f842415a5c0 2024-09-13T16:02:12.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.036+0000 7f8423e00640 1 -- 172.21.15.70:0/4031699276 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84180325a0 con 0x7f842415a5c0 2024-09-13T16:02:12.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.036+0000 7f8423e00640 1 -- 172.21.15.70:0/4031699276 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418032930 con 0x7f842415a5c0 2024-09-13T16:02:12.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.037+0000 7f842ae00640 1 -- 172.21.15.70:0/4031699276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f842415a5c0 msgr2=0x7f84240b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:12.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.037+0000 7f842ae00640 1 --2- 172.21.15.70:0/4031699276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f842415a5c0 0x7f84240b39b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8418009870 tx=0x7f841802a270 comp rx=0 tx=0).stop 2024-09-13T16:02:12.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.037+0000 7f842ae00640 1 -- 172.21.15.70:0/4031699276 shutdown_connections 2024-09-13T16:02:12.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.037+0000 7f842ae00640 1 --2- 172.21.15.70:0/4031699276 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84240cbac0 0x7f84240b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.037+0000 7f842ae00640 1 --2- 172.21.15.70:0/4031699276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f842415a5c0 0x7f84240b39b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.037+0000 7f842ae00640 1 -- 172.21.15.70:0/4031699276 >> 172.21.15.70:0/4031699276 conn(0x7f84240ae310 msgr2=0x7f84240ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:12.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.037+0000 7f842ae00640 1 -- 172.21.15.70:0/4031699276 shutdown_connections 2024-09-13T16:02:12.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.037+0000 7f842ae00640 1 -- 172.21.15.70:0/4031699276 wait complete. 2024-09-13T16:02:12.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.038+0000 7f842ae00640 1 Processor -- start 2024-09-13T16:02:12.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.039+0000 7f842ae00640 1 -- start start 2024-09-13T16:02:12.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.039+0000 7f842ae00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84240afe10 0x7f842414bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:12.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.039+0000 7f842ae00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84240cbac0 0x7f84240b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:12.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.039+0000 7f842ae00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f842415a5c0 0x7f84240b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:12.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.039+0000 7f842ae00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842414e540 con 0x7f84240cbac0 2024-09-13T16:02:12.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.039+0000 7f842ae00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842414f0c0 con 0x7f84240afe10 2024-09-13T16:02:12.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.040+0000 7f842ae00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842414e790 con 0x7f842415a5c0 2024-09-13T16:02:12.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.040+0000 7f8429000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84240cbac0 0x7f84240b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:12.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.040+0000 7f8429000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84240cbac0 0x7f84240b2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45046/0 (socket says 172.21.15.70:45046) 2024-09-13T16:02:12.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.040+0000 7f8429000640 1 -- 172.21.15.70:0/1775726231 learned_addr learned my addr 172.21.15.70:0/1775726231 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:12.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.040+0000 7f842a400640 1 --2- 172.21.15.70:0/1775726231 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f842415a5c0 0x7f84240b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:12.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.040+0000 7f8429a00640 1 --2- 172.21.15.70:0/1775726231 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84240afe10 0x7f842414bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:12.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.040+0000 7f8429000640 1 -- 172.21.15.70:0/1775726231 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f842415a5c0 msgr2=0x7f84240b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:12.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.040+0000 7f8429000640 1 --2- 172.21.15.70:0/1775726231 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f842415a5c0 0x7f84240b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.040+0000 7f8429000640 1 -- 172.21.15.70:0/1775726231 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84240afe10 msgr2=0x7f842414bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:12.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.040+0000 7f8429000640 1 --2- 172.21.15.70:0/1775726231 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84240afe10 0x7f842414bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.040+0000 7f8429000640 1 -- 172.21.15.70:0/1775726231 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84180094d0 con 0x7f84240cbac0 2024-09-13T16:02:12.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.041+0000 7f8429000640 1 --2- 172.21.15.70:0/1775726231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84240cbac0 0x7f84240b2da0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f841000e9e0 tx=0x7f841000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:12.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.041+0000 7f8421600640 1 -- 172.21.15.70:0/1775726231 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8410009670 con 0x7f84240cbac0 2024-09-13T16:02:12.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.041+0000 7f8421600640 1 -- 172.21.15.70:0/1775726231 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841000c9d0 con 0x7f84240cbac0 2024-09-13T16:02:12.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.041+0000 7f8421600640 1 -- 172.21.15.70:0/1775726231 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841000cd80 con 0x7f84240cbac0 2024-09-13T16:02:12.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.041+0000 7f842ae00640 1 -- 172.21.15.70:0/1775726231 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842414ea70 con 0x7f84240cbac0 2024-09-13T16:02:12.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.041+0000 7f842ae00640 1 -- 172.21.15.70:0/1775726231 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842414bff0 con 0x7f84240cbac0 2024-09-13T16:02:12.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.042+0000 7f842ae00640 1 -- 172.21.15.70:0/1775726231 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8424067360 con 0x7f84240cbac0 2024-09-13T16:02:12.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.043+0000 7f8421600640 1 -- 172.21.15.70:0/1775726231 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8410013470 con 0x7f84240cbac0 2024-09-13T16:02:12.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.044+0000 7f8421600640 1 --2- 172.21.15.70:0/1775726231 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f840406ac00 0x7f840406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:12.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.044+0000 7f8421600640 1 -- 172.21.15.70:0/1775726231 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f84100892f0 con 0x7f84240cbac0 2024-09-13T16:02:12.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.044+0000 7f8429a00640 1 --2- 172.21.15.70:0/1775726231 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f840406ac00 0x7f840406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:12.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.045+0000 7f8429a00640 1 --2- 172.21.15.70:0/1775726231 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f840406ac00 0x7f840406d0c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8418034000 tx=0x7f841802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:12.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.048+0000 7f8421600640 1 -- 172.21.15.70:0/1775726231 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f84100547a0 con 0x7f84240cbac0 2024-09-13T16:02:12.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.278+0000 7f842ae00640 1 -- 172.21.15.70:0/1775726231 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f84240b39b0 con 0x7f84240cbac0 2024-09-13T16:02:12.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.282+0000 7f8421600640 1 -- 172.21.15.70:0/1775726231 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8410057dc0 con 0x7f84240cbac0 2024-09-13T16:02:12.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.284+0000 7f842ae00640 1 -- 172.21.15.70:0/1775726231 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f840406ac00 msgr2=0x7f840406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:12.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.284+0000 7f842ae00640 1 --2- 172.21.15.70:0/1775726231 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f840406ac00 0x7f840406d0c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8418034000 tx=0x7f841802e000 comp rx=0 tx=0).stop 2024-09-13T16:02:12.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.284+0000 7f842ae00640 1 -- 172.21.15.70:0/1775726231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84240cbac0 msgr2=0x7f84240b2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:12.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.284+0000 7f842ae00640 1 --2- 172.21.15.70:0/1775726231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84240cbac0 0x7f84240b2da0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f841000e9e0 tx=0x7f841000eea0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.285+0000 7f842ae00640 1 -- 172.21.15.70:0/1775726231 shutdown_connections 2024-09-13T16:02:12.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.285+0000 7f842ae00640 1 --2- 172.21.15.70:0/1775726231 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f842415a5c0 0x7f84240b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.285+0000 7f842ae00640 1 --2- 172.21.15.70:0/1775726231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84240cbac0 0x7f84240b2da0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.285+0000 7f842ae00640 1 --2- 172.21.15.70:0/1775726231 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f840406ac00 0x7f840406d0c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.285+0000 7f842ae00640 1 --2- 172.21.15.70:0/1775726231 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84240afe10 0x7f842414bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.285+0000 7f842ae00640 1 -- 172.21.15.70:0/1775726231 >> 172.21.15.70:0/1775726231 conn(0x7f84240ae310 msgr2=0x7f84240aedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:12.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.285+0000 7f842ae00640 1 -- 172.21.15.70:0/1775726231 shutdown_connections 2024-09-13T16:02:12.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.285+0000 7f842ae00640 1 -- 172.21.15.70:0/1775726231 wait complete. 2024-09-13T16:02:12.302 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-13T16:02:12.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.453+0000 7f3727c00640 1 Processor -- start 2024-09-13T16:02:12.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.453+0000 7f3727c00640 1 -- start start 2024-09-13T16:02:12.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.455+0000 7f3727c00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3720153b20 0x7f37200b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:12.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.455+0000 7f3727c00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3720153f00 con 0x7f3720159a80 2024-09-13T16:02:12.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.455+0000 7f3727c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37200b1a40 con 0x7f372006f660 2024-09-13T16:02:12.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.455+0000 7f3727c00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37200ce600 con 0x7f3720153b20 2024-09-13T16:02:12.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.455+0000 7f3725200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3720153b20 0x7f37200b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:12.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.455+0000 7f371fe00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3720159a80 0x7f37200b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:51986/0 (socket says 172.21.15.70:51986) 2024-09-13T16:02:12.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.455+0000 7f371fe00640 1 -- 172.21.15.70:0/2048151033 learned_addr learned my addr 172.21.15.70:0/2048151033 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:12.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.455+0000 7f3725200640 1 -- 172.21.15.70:0/2048151033 >> v1:172.21.15.107:6789/0 conn(0x7f372006f660 legacy=0x7f372006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:12.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.455+0000 7f3725200640 1 -- 172.21.15.70:0/2048151033 >> v1:172.21.15.70:6789/0 conn(0x7f3720159a80 legacy=0x7f37200b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:12.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.455+0000 7f3725200640 1 -- 172.21.15.70:0/2048151033 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372015a1f0 con 0x7f3720153b20 2024-09-13T16:02:12.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.455+0000 7f371f400640 1 -- 172.21.15.70:0/2048151033 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315586836 0 0) 0x7f3720153f00 con 0x7f3720159a80 2024-09-13T16:02:12.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.457+0000 7f3725200640 1 --2- 172.21.15.70:0/2048151033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3720153b20 0x7f37200b3990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f37140097a0 tx=0x7f371402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feca0d160b1e237e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:12.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.457+0000 7f371f400640 1 -- 172.21.15.70:0/2048151033 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3714032440 con 0x7f3720153b20 2024-09-13T16:02:12.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.457+0000 7f371f400640 1 -- 172.21.15.70:0/2048151033 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37140325a0 con 0x7f3720153b20 2024-09-13T16:02:12.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.457+0000 7f371f400640 1 -- 172.21.15.70:0/2048151033 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3714032930 con 0x7f3720153b20 2024-09-13T16:02:12.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.457+0000 7f3727c00640 1 -- 172.21.15.70:0/2048151033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3720153b20 msgr2=0x7f37200b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:12.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.457+0000 7f3727c00640 1 --2- 172.21.15.70:0/2048151033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3720153b20 0x7f37200b3990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f37140097a0 tx=0x7f371402a230 comp rx=0 tx=0).stop 2024-09-13T16:02:12.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.457+0000 7f3727c00640 1 -- 172.21.15.70:0/2048151033 shutdown_connections 2024-09-13T16:02:12.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.457+0000 7f3727c00640 1 --2- 172.21.15.70:0/2048151033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3720153b20 0x7f37200b3990 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.457+0000 7f3727c00640 1 -- 172.21.15.70:0/2048151033 >> 172.21.15.70:0/2048151033 conn(0x7f37200b0510 msgr2=0x7f37200b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:12.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.457+0000 7f3727c00640 1 -- 172.21.15.70:0/2048151033 shutdown_connections 2024-09-13T16:02:12.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.458+0000 7f3727c00640 1 -- 172.21.15.70:0/2048151033 wait complete. 2024-09-13T16:02:12.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.459+0000 7f3727c00640 1 Processor -- start 2024-09-13T16:02:12.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.459+0000 7f3727c00640 1 -- start start 2024-09-13T16:02:12.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.460+0000 7f3727c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f372006f660 0x7f3720152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:12.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.460+0000 7f3727c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3720153b20 0x7f37201540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:12.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.460+0000 7f3727c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3720159a80 0x7f372015d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:12.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.460+0000 7f3727c00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3720152fa0 con 0x7f3720153b20 2024-09-13T16:02:12.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.460+0000 7f3727c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37201f32e0 con 0x7f372006f660 2024-09-13T16:02:12.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.460+0000 7f3727c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37201545f0 con 0x7f3720159a80 2024-09-13T16:02:12.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.460+0000 7f371fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3720153b20 0x7f37201540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:12.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.460+0000 7f371fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3720153b20 0x7f37201540b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45064/0 (socket says 172.21.15.70:45064) 2024-09-13T16:02:12.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.460+0000 7f371fe00640 1 -- 172.21.15.70:0/1943081599 learned_addr learned my addr 172.21.15.70:0/1943081599 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:12.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.460+0000 7f3725200640 1 --2- 172.21.15.70:0/1943081599 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f372006f660 0x7f3720152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:12.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.460+0000 7f3725c00640 1 --2- 172.21.15.70:0/1943081599 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3720159a80 0x7f372015d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:12.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.461+0000 7f371fe00640 1 -- 172.21.15.70:0/1943081599 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3720159a80 msgr2=0x7f372015d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:12.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.461+0000 7f371fe00640 1 --2- 172.21.15.70:0/1943081599 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3720159a80 0x7f372015d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.461+0000 7f371fe00640 1 -- 172.21.15.70:0/1943081599 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f372006f660 msgr2=0x7f3720152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:12.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.461+0000 7f371fe00640 1 --2- 172.21.15.70:0/1943081599 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f372006f660 0x7f3720152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.461+0000 7f371fe00640 1 -- 172.21.15.70:0/1943081599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3714009400 con 0x7f3720153b20 2024-09-13T16:02:12.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.461+0000 7f371fe00640 1 --2- 172.21.15.70:0/1943081599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3720153b20 0x7f37201540b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f370c00c4a0 tx=0x7f370c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:12.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.461+0000 7f371cc00640 1 -- 172.21.15.70:0/1943081599 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c0074e0 con 0x7f3720153b20 2024-09-13T16:02:12.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.461+0000 7f371cc00640 1 -- 172.21.15.70:0/1943081599 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c007640 con 0x7f3720153b20 2024-09-13T16:02:12.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.461+0000 7f3727c00640 1 -- 172.21.15.70:0/1943081599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37201f2760 con 0x7f3720153b20 2024-09-13T16:02:12.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.461+0000 7f371cc00640 1 -- 172.21.15.70:0/1943081599 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c004a00 con 0x7f3720153b20 2024-09-13T16:02:12.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.461+0000 7f3727c00640 1 -- 172.21.15.70:0/1943081599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37201f2d20 con 0x7f3720153b20 2024-09-13T16:02:12.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.463+0000 7f3727c00640 1 -- 172.21.15.70:0/1943081599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372006d960 con 0x7f3720153b20 2024-09-13T16:02:12.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.463+0000 7f371cc00640 1 -- 172.21.15.70:0/1943081599 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f370c004b60 con 0x7f3720153b20 2024-09-13T16:02:12.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.464+0000 7f371cc00640 1 --2- 172.21.15.70:0/1943081599 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f370006ac30 0x7f370006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:12.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.464+0000 7f371cc00640 1 -- 172.21.15.70:0/1943081599 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f370c088150 con 0x7f3720153b20 2024-09-13T16:02:12.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.464+0000 7f3725200640 1 --2- 172.21.15.70:0/1943081599 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f370006ac30 0x7f370006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:12.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.465+0000 7f3725200640 1 --2- 172.21.15.70:0/1943081599 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f370006ac30 0x7f370006d0f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3714034000 tx=0x7f371402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:12.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.469+0000 7f371cc00640 1 -- 172.21.15.70:0/1943081599 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f370c0536a0 con 0x7f3720153b20 2024-09-13T16:02:12.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.704+0000 7f3727c00640 1 -- 172.21.15.70:0/1943081599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f37200b3990 con 0x7f3720153b20 2024-09-13T16:02:12.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.708+0000 7f371cc00640 1 -- 172.21.15.70:0/1943081599 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f370c0180a0 con 0x7f3720153b20 2024-09-13T16:02:12.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.710+0000 7f3727c00640 1 -- 172.21.15.70:0/1943081599 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f370006ac30 msgr2=0x7f370006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:12.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.710+0000 7f3727c00640 1 --2- 172.21.15.70:0/1943081599 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f370006ac30 0x7f370006d0f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3714034000 tx=0x7f371402e000 comp rx=0 tx=0).stop 2024-09-13T16:02:12.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.711+0000 7f3727c00640 1 -- 172.21.15.70:0/1943081599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3720153b20 msgr2=0x7f37201540b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:12.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.711+0000 7f3727c00640 1 --2- 172.21.15.70:0/1943081599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3720153b20 0x7f37201540b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f370c00c4a0 tx=0x7f370c00c960 comp rx=0 tx=0).stop 2024-09-13T16:02:12.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.711+0000 7f3727c00640 1 -- 172.21.15.70:0/1943081599 shutdown_connections 2024-09-13T16:02:12.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.711+0000 7f3727c00640 1 --2- 172.21.15.70:0/1943081599 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3720159a80 0x7f372015d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.711+0000 7f3727c00640 1 --2- 172.21.15.70:0/1943081599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3720153b20 0x7f37201540b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.711+0000 7f3727c00640 1 --2- 172.21.15.70:0/1943081599 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f370006ac30 0x7f370006d0f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.711+0000 7f3727c00640 1 --2- 172.21.15.70:0/1943081599 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f372006f660 0x7f3720152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.711+0000 7f3727c00640 1 -- 172.21.15.70:0/1943081599 >> 172.21.15.70:0/1943081599 conn(0x7f37200b0510 msgr2=0x7f37200b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:12.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.711+0000 7f3727c00640 1 -- 172.21.15.70:0/1943081599 shutdown_connections 2024-09-13T16:02:12.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.711+0000 7f3727c00640 1 -- 172.21.15.70:0/1943081599 wait complete. 2024-09-13T16:02:12.729 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-13T16:02:12.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.881+0000 7f68d5000640 1 Processor -- start 2024-09-13T16:02:12.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.881+0000 7f68d5000640 1 -- start start 2024-09-13T16:02:12.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.883+0000 7f68d5000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f68d015a520 0x7f68d006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:12.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.883+0000 7f68d5000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68d00ce020 0x7f68d015a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:12.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.883+0000 7f68d5000640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d006bc00 con 0x7f68d00b1b00 2024-09-13T16:02:12.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.883+0000 7f68d5000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d006bea0 con 0x7f68d015a520 2024-09-13T16:02:12.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.883+0000 7f68d5000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d006c180 con 0x7f68d00ce020 2024-09-13T16:02:12.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.883+0000 7f68c5400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f68d00b1b00 0x7f68d00cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:51992/0 (socket says 172.21.15.70:51992) 2024-09-13T16:02:12.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.883+0000 7f68c5400640 1 -- 172.21.15.70:0/2838340341 learned_addr learned my addr 172.21.15.70:0/2838340341 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:12.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.883+0000 7f68ce800640 1 --2- 172.21.15.70:0/2838340341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68d00ce020 0x7f68d015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:12.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.883+0000 7f68cde00640 1 --2- 172.21.15.70:0/2838340341 >> v2:172.21.15.107:3300/0 conn(0x7f68d015a520 0x7f68d006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:12.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.883+0000 7f68cd400640 1 -- 172.21.15.70:0/2838340341 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253775302 0 0) 0x7f68d006bc00 con 0x7f68d00b1b00 2024-09-13T16:02:12.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.883+0000 7f68cd400640 1 -- 172.21.15.70:0/2838340341 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68b4003520 con 0x7f68d00b1b00 2024-09-13T16:02:12.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.884+0000 7f68cde00640 1 -- 172.21.15.70:0/2838340341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68d00ce020 msgr2=0x7f68d015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:12.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.884+0000 7f68cde00640 1 --2- 172.21.15.70:0/2838340341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68d00ce020 0x7f68d015a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.884+0000 7f68cd400640 1 -- 172.21.15.70:0/2838340341 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 251340452 0 0) 0x7f68b4003520 con 0x7f68d00b1b00 2024-09-13T16:02:12.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.884+0000 7f68cde00640 1 -- 172.21.15.70:0/2838340341 >> v1:172.21.15.70:6789/0 conn(0x7f68d00b1b00 legacy=0x7f68d00cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:12.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.884+0000 7f68cde00640 1 -- 172.21.15.70:0/2838340341 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d006c460 con 0x7f68d015a520 2024-09-13T16:02:12.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.884+0000 7f68ce800640 1 --2- 172.21.15.70:0/2838340341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68d00ce020 0x7f68d015a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:12.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.885+0000 7f68cde00640 1 --2- 172.21.15.70:0/2838340341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d015a520 0x7f68d006b6c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f68c00097a0 tx=0x7f68c002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=813c751fcb6b49b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:12.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.885+0000 7f68cd400640 1 -- 172.21.15.70:0/2838340341 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8001670 con 0x7f68d015a520 2024-09-13T16:02:12.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.885+0000 7f68cd400640 1 -- 172.21.15.70:0/2838340341 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c002ab10 con 0x7f68d015a520 2024-09-13T16:02:12.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.885+0000 7f68cd400640 1 -- 172.21.15.70:0/2838340341 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c002aea0 con 0x7f68d015a520 2024-09-13T16:02:12.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.886+0000 7f68d5000640 1 -- 172.21.15.70:0/2838340341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d015a520 msgr2=0x7f68d006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:12.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.886+0000 7f68d5000640 1 --2- 172.21.15.70:0/2838340341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d015a520 0x7f68d006b6c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f68c00097a0 tx=0x7f68c002a080 comp rx=0 tx=0).stop 2024-09-13T16:02:12.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.886+0000 7f68d5000640 1 -- 172.21.15.70:0/2838340341 shutdown_connections 2024-09-13T16:02:12.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.886+0000 7f68d5000640 1 --2- 172.21.15.70:0/2838340341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68d00ce020 0x7f68d015a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.886+0000 7f68d5000640 1 --2- 172.21.15.70:0/2838340341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d015a520 0x7f68d006b6c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.886+0000 7f68d5000640 1 -- 172.21.15.70:0/2838340341 >> 172.21.15.70:0/2838340341 conn(0x7f68d00b0510 msgr2=0x7f68d00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:12.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.886+0000 7f68d5000640 1 -- 172.21.15.70:0/2838340341 shutdown_connections 2024-09-13T16:02:12.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.886+0000 7f68d5000640 1 -- 172.21.15.70:0/2838340341 wait complete. 2024-09-13T16:02:12.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.887+0000 7f68d5000640 1 Processor -- start 2024-09-13T16:02:12.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.887+0000 7f68d5000640 1 -- start start 2024-09-13T16:02:12.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.888+0000 7f68d5000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68d00b1b00 0x7f68d0152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:12.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.888+0000 7f68d5000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d00ce020 0x7f68d00ad160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:12.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.888+0000 7f68d5000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68d015a520 0x7f68d00ae450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:12.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.888+0000 7f68d5000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d01531f0 con 0x7f68d00b1b00 2024-09-13T16:02:12.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.888+0000 7f68d5000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d00ab2c0 con 0x7f68d00ce020 2024-09-13T16:02:12.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.888+0000 7f68d5000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d00ab5a0 con 0x7f68d015a520 2024-09-13T16:02:12.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.888+0000 7f68cde00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68d00b1b00 0x7f68d0152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:12.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.889+0000 7f68cde00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68d00b1b00 0x7f68d0152cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45078/0 (socket says 172.21.15.70:45078) 2024-09-13T16:02:12.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.889+0000 7f68cde00640 1 -- 172.21.15.70:0/2849353355 learned_addr learned my addr 172.21.15.70:0/2849353355 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:12.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.889+0000 7f68ce800640 1 --2- 172.21.15.70:0/2849353355 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68d015a520 0x7f68d00ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:12.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.889+0000 7f68c5400640 1 --2- 172.21.15.70:0/2849353355 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d00ce020 0x7f68d00ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:12.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.889+0000 7f68cde00640 1 -- 172.21.15.70:0/2849353355 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68d015a520 msgr2=0x7f68d00ae450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:12.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.889+0000 7f68cde00640 1 --2- 172.21.15.70:0/2849353355 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68d015a520 0x7f68d00ae450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.889+0000 7f68cde00640 1 -- 172.21.15.70:0/2849353355 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d00ce020 msgr2=0x7f68d00ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:12.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.889+0000 7f68cde00640 1 --2- 172.21.15.70:0/2849353355 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d00ce020 0x7f68d00ad160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:12.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.889+0000 7f68cde00640 1 -- 172.21.15.70:0/2849353355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c8009a70 con 0x7f68d00b1b00 2024-09-13T16:02:12.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.889+0000 7f68c5400640 1 --2- 172.21.15.70:0/2849353355 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d00ce020 0x7f68d00ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:12.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.889+0000 7f68cde00640 1 --2- 172.21.15.70:0/2849353355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68d00b1b00 0x7f68d0152cb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f68c0035040 tx=0x7f68c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:12.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.889+0000 7f68c6a00640 1 -- 172.21.15.70:0/2849353355 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c003d830 con 0x7f68d00b1b00 2024-09-13T16:02:12.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.889+0000 7f68c6a00640 1 -- 172.21.15.70:0/2849353355 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c003d990 con 0x7f68d00b1b00 2024-09-13T16:02:12.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.889+0000 7f68c6a00640 1 -- 172.21.15.70:0/2849353355 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c003dd20 con 0x7f68d00b1b00 2024-09-13T16:02:12.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.889+0000 7f68d5000640 1 -- 172.21.15.70:0/2849353355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c0009400 con 0x7f68d00b1b00 2024-09-13T16:02:12.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.890+0000 7f68d5000640 1 -- 172.21.15.70:0/2849353355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d00abb60 con 0x7f68d00b1b00 2024-09-13T16:02:12.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.891+0000 7f68d5000640 1 -- 172.21.15.70:0/2849353355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d015a900 con 0x7f68d00b1b00 2024-09-13T16:02:12.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.891+0000 7f68c6a00640 1 -- 172.21.15.70:0/2849353355 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f68c0039040 con 0x7f68d00b1b00 2024-09-13T16:02:12.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.892+0000 7f68c6a00640 1 --2- 172.21.15.70:0/2849353355 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f68ac06ac00 0x7f68ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:12.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.892+0000 7f68c6a00640 1 -- 172.21.15.70:0/2849353355 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f68c00a98c0 con 0x7f68d00b1b00 2024-09-13T16:02:12.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.892+0000 7f68c5400640 1 --2- 172.21.15.70:0/2849353355 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f68ac06ac00 0x7f68ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:12.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.893+0000 7f68c5400640 1 --2- 172.21.15.70:0/2849353355 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f68ac06ac00 0x7f68ac06d0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f68d015dca0 tx=0x7f68b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:12.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:12.896+0000 7f68c6a00640 1 -- 172.21.15.70:0/2849353355 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f68c0074de0 con 0x7f68d00b1b00 2024-09-13T16:02:13.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.135+0000 7f68d5000640 1 -- 172.21.15.70:0/2849353355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f68d0158e40 con 0x7f68d00b1b00 2024-09-13T16:02:13.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.139+0000 7f68c6a00640 1 -- 172.21.15.70:0/2849353355 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f68c0006e10 con 0x7f68d00b1b00 2024-09-13T16:02:13.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.141+0000 7f68d5000640 1 -- 172.21.15.70:0/2849353355 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f68ac06ac00 msgr2=0x7f68ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:13.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.141+0000 7f68d5000640 1 --2- 172.21.15.70:0/2849353355 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f68ac06ac00 0x7f68ac06d0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f68d015dca0 tx=0x7f68b8009040 comp rx=0 tx=0).stop 2024-09-13T16:02:13.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.141+0000 7f68d5000640 1 -- 172.21.15.70:0/2849353355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68d00b1b00 msgr2=0x7f68d0152cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:13.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.141+0000 7f68d5000640 1 --2- 172.21.15.70:0/2849353355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68d00b1b00 0x7f68d0152cb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f68c0035040 tx=0x7f68c00046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.141+0000 7f68d5000640 1 -- 172.21.15.70:0/2849353355 shutdown_connections 2024-09-13T16:02:13.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.141+0000 7f68d5000640 1 --2- 172.21.15.70:0/2849353355 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68d015a520 0x7f68d00ae450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.141+0000 7f68d5000640 1 --2- 172.21.15.70:0/2849353355 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f68ac06ac00 0x7f68ac06d0c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.141+0000 7f68d5000640 1 --2- 172.21.15.70:0/2849353355 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68d00ce020 0x7f68d00ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.141+0000 7f68d5000640 1 --2- 172.21.15.70:0/2849353355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68d00b1b00 0x7f68d0152cb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.141+0000 7f68d5000640 1 -- 172.21.15.70:0/2849353355 >> 172.21.15.70:0/2849353355 conn(0x7f68d00b0510 msgr2=0x7f68d006b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:13.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.141+0000 7f68d5000640 1 -- 172.21.15.70:0/2849353355 shutdown_connections 2024-09-13T16:02:13.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.141+0000 7f68d5000640 1 -- 172.21.15.70:0/2849353355 wait complete. 2024-09-13T16:02:13.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-13T16:02:13.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.312+0000 7f3513e00640 1 Processor -- start 2024-09-13T16:02:13.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.312+0000 7f3513e00640 1 -- start start 2024-09-13T16:02:13.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.313+0000 7f3513e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f35140b40c0 0x7f351415a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:13.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.313+0000 7f3513e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f35140cbac0 0x7f351415aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:13.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.313+0000 7f3513e00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35140cbfc0 con 0x7f351415a5c0 2024-09-13T16:02:13.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.313+0000 7f3513e00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35140cce20 con 0x7f35140cbac0 2024-09-13T16:02:13.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.313+0000 7f3513e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35140707a0 con 0x7f35140b40c0 2024-09-13T16:02:13.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.313+0000 7f3513400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f35140cbac0 0x7f351415aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:13.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.313+0000 7f3513400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f35140cbac0 0x7f351415aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45084/0 (socket says 172.21.15.70:45084) 2024-09-13T16:02:13.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.313+0000 7f3513400640 1 -- 172.21.15.70:0/2306638288 learned_addr learned my addr 172.21.15.70:0/2306638288 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:13.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.313+0000 7f3512a00640 1 --1- 172.21.15.70:0/2306638288 >> v1:172.21.15.70:6789/0 conn(0x7f351415a5c0 0x7f35140b39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:52006/0 (socket says 172.21.15.70:52006) 2024-09-13T16:02:13.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.313+0000 7f3512000640 1 --2- 172.21.15.70:0/2306638288 >> v2:172.21.15.107:3300/0 conn(0x7f35140b40c0 0x7f351415a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:13.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.314+0000 7f3513400640 1 -- 172.21.15.70:0/2306638288 >> v2:172.21.15.107:3300/0 conn(0x7f35140b40c0 msgr2=0x7f351415a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:13.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.314+0000 7f3513400640 1 --2- 172.21.15.70:0/2306638288 >> v2:172.21.15.107:3300/0 conn(0x7f35140b40c0 0x7f351415a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.314+0000 7f3513400640 1 -- 172.21.15.70:0/2306638288 >> v1:172.21.15.70:6789/0 conn(0x7f351415a5c0 legacy=0x7f35140b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:13.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.314+0000 7f3513400640 1 -- 172.21.15.70:0/2306638288 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3514070a80 con 0x7f35140cbac0 2024-09-13T16:02:13.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.315+0000 7f3513400640 1 --2- 172.21.15.70:0/2306638288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35140cbac0 0x7f351415aee0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3514061c10 tx=0x7f350c02eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d093c9d1eb82ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:13.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.315+0000 7f3511600640 1 -- 172.21.15.70:0/2306638288 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c032660 con 0x7f35140cbac0 2024-09-13T16:02:13.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.315+0000 7f3511600640 1 -- 172.21.15.70:0/2306638288 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c0327c0 con 0x7f35140cbac0 2024-09-13T16:02:13.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.315+0000 7f3511600640 1 -- 172.21.15.70:0/2306638288 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c032b50 con 0x7f35140cbac0 2024-09-13T16:02:13.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.316+0000 7f3513e00640 1 -- 172.21.15.70:0/2306638288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35140cbac0 msgr2=0x7f351415aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:13.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.316+0000 7f3513e00640 1 --2- 172.21.15.70:0/2306638288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35140cbac0 0x7f351415aee0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3514061c10 tx=0x7f350c02eab0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.316+0000 7f3513e00640 1 -- 172.21.15.70:0/2306638288 shutdown_connections 2024-09-13T16:02:13.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.316+0000 7f3513e00640 1 --2- 172.21.15.70:0/2306638288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35140cbac0 0x7f351415aee0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.316+0000 7f3513e00640 1 --2- 172.21.15.70:0/2306638288 >> v2:172.21.15.107:3300/0 conn(0x7f35140b40c0 0x7f351415a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.316+0000 7f3513e00640 1 -- 172.21.15.70:0/2306638288 >> 172.21.15.70:0/2306638288 conn(0x7f35140ae310 msgr2=0x7f35140ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:13.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.316+0000 7f3513e00640 1 -- 172.21.15.70:0/2306638288 shutdown_connections 2024-09-13T16:02:13.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.316+0000 7f3513e00640 1 -- 172.21.15.70:0/2306638288 wait complete. 2024-09-13T16:02:13.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.318+0000 7f3513e00640 1 Processor -- start 2024-09-13T16:02:13.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.318+0000 7f3513e00640 1 -- start start 2024-09-13T16:02:13.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.319+0000 7f3513e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f35140b40c0 0x7f3514149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:13.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.319+0000 7f3513e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35140cbac0 0x7f351415bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:13.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.319+0000 7f3513e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f351415a5c0 0x7f3514149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:13.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.319+0000 7f3513e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351415ab20 con 0x7f351415a5c0 2024-09-13T16:02:13.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.319+0000 7f3513e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351415ae00 con 0x7f35140cbac0 2024-09-13T16:02:13.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.319+0000 7f3513e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351415b0e0 con 0x7f35140b40c0 2024-09-13T16:02:13.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.319+0000 7f3513400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f351415a5c0 0x7f3514149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:13.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.319+0000 7f3513400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f351415a5c0 0x7f3514149ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45096/0 (socket says 172.21.15.70:45096) 2024-09-13T16:02:13.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.319+0000 7f3513400640 1 -- 172.21.15.70:0/3178235654 learned_addr learned my addr 172.21.15.70:0/3178235654 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:13.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.319+0000 7f3512a00640 1 --2- 172.21.15.70:0/3178235654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f35140b40c0 0x7f3514149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:13.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.319+0000 7f3512000640 1 --2- 172.21.15.70:0/3178235654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35140cbac0 0x7f351415bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:13.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.319+0000 7f3513400640 1 -- 172.21.15.70:0/3178235654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f35140b40c0 msgr2=0x7f3514149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:13.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.320+0000 7f3513400640 1 --2- 172.21.15.70:0/3178235654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f35140b40c0 0x7f3514149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.320+0000 7f3513400640 1 -- 172.21.15.70:0/3178235654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35140cbac0 msgr2=0x7f351415bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:13.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.320+0000 7f3513400640 1 --2- 172.21.15.70:0/3178235654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35140cbac0 0x7f351415bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.320+0000 7f3513400640 1 -- 172.21.15.70:0/3178235654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c009b30 con 0x7f351415a5c0 2024-09-13T16:02:13.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.320+0000 7f3513400640 1 --2- 172.21.15.70:0/3178235654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f351415a5c0 0x7f3514149ac0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f350c02f0a0 tx=0x7f350c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:13.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.320+0000 7f350aa00640 1 -- 172.21.15.70:0/3178235654 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c041070 con 0x7f351415a5c0 2024-09-13T16:02:13.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.320+0000 7f350aa00640 1 -- 172.21.15.70:0/3178235654 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c009510 con 0x7f351415a5c0 2024-09-13T16:02:13.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.320+0000 7f350aa00640 1 -- 172.21.15.70:0/3178235654 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c03c9d0 con 0x7f351415a5c0 2024-09-13T16:02:13.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.320+0000 7f3513e00640 1 -- 172.21.15.70:0/3178235654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351415b3c0 con 0x7f351415a5c0 2024-09-13T16:02:13.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.320+0000 7f3513e00640 1 -- 172.21.15.70:0/3178235654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3514149850 con 0x7f351415a5c0 2024-09-13T16:02:13.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.321+0000 7f3513e00640 1 -- 172.21.15.70:0/3178235654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3514067360 con 0x7f351415a5c0 2024-09-13T16:02:13.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.322+0000 7f350aa00640 1 -- 172.21.15.70:0/3178235654 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f350c045070 con 0x7f351415a5c0 2024-09-13T16:02:13.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.323+0000 7f350aa00640 1 --2- 172.21.15.70:0/3178235654 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f34f406ac00 0x7f34f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:13.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.324+0000 7f350aa00640 1 -- 172.21.15.70:0/3178235654 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f350c0addb0 con 0x7f351415a5c0 2024-09-13T16:02:13.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.324+0000 7f3512a00640 1 --2- 172.21.15.70:0/3178235654 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f34f406ac00 0x7f34f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:13.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.324+0000 7f3512a00640 1 --2- 172.21.15.70:0/3178235654 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f34f406ac00 0x7f34f406d0c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3504000f60 tx=0x7f3504000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:13.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.331+0000 7f350aa00640 1 -- 172.21.15.70:0/3178235654 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f350c0b2070 con 0x7f351415a5c0 2024-09-13T16:02:13.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.564+0000 7f3513e00640 1 -- 172.21.15.70:0/3178235654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f35140afe10 con 0x7f351415a5c0 2024-09-13T16:02:13.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.567+0000 7f350aa00640 1 -- 172.21.15.70:0/3178235654 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f350c0792f0 con 0x7f351415a5c0 2024-09-13T16:02:13.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.570+0000 7f3513e00640 1 -- 172.21.15.70:0/3178235654 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f34f406ac00 msgr2=0x7f34f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:13.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.570+0000 7f3513e00640 1 --2- 172.21.15.70:0/3178235654 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f34f406ac00 0x7f34f406d0c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3504000f60 tx=0x7f3504000ed0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.570+0000 7f3513e00640 1 -- 172.21.15.70:0/3178235654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f351415a5c0 msgr2=0x7f3514149ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:13.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.570+0000 7f3513e00640 1 --2- 172.21.15.70:0/3178235654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f351415a5c0 0x7f3514149ac0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f350c02f0a0 tx=0x7f350c004a40 comp rx=0 tx=0).stop 2024-09-13T16:02:13.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.570+0000 7f3513e00640 1 -- 172.21.15.70:0/3178235654 shutdown_connections 2024-09-13T16:02:13.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.570+0000 7f3513e00640 1 --2- 172.21.15.70:0/3178235654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f351415a5c0 0x7f3514149ac0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.570+0000 7f3513e00640 1 --2- 172.21.15.70:0/3178235654 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f34f406ac00 0x7f34f406d0c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.570+0000 7f3513e00640 1 --2- 172.21.15.70:0/3178235654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35140cbac0 0x7f351415bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.570+0000 7f3513e00640 1 --2- 172.21.15.70:0/3178235654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f35140b40c0 0x7f3514149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.570+0000 7f3513e00640 1 -- 172.21.15.70:0/3178235654 >> 172.21.15.70:0/3178235654 conn(0x7f35140ae310 msgr2=0x7f3514158bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:13.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.570+0000 7f3513e00640 1 -- 172.21.15.70:0/3178235654 shutdown_connections 2024-09-13T16:02:13.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.570+0000 7f3513e00640 1 -- 172.21.15.70:0/3178235654 wait complete. 2024-09-13T16:02:13.589 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:02:13.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.743+0000 7f50e9400640 1 Processor -- start 2024-09-13T16:02:13.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.743+0000 7f50e9400640 1 -- start start 2024-09-13T16:02:13.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.745+0000 7f50e9400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f50e415a520 0x7f50e406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:13.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.745+0000 7f50e9400640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e406bc00 con 0x7f50e40b1b00 2024-09-13T16:02:13.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.745+0000 7f50e9400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e406bea0 con 0x7f50e40ce020 2024-09-13T16:02:13.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.745+0000 7f50e9400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e406c180 con 0x7f50e415a520 2024-09-13T16:02:13.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.745+0000 7f50e1e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f50e40b1b00 0x7f50e40cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:52012/0 (socket says 172.21.15.70:52012) 2024-09-13T16:02:13.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.745+0000 7f50e1e00640 1 -- 172.21.15.70:0/3227136710 learned_addr learned my addr 172.21.15.70:0/3227136710 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.745+0000 7f50e1400640 1 -- 172.21.15.70:0/3227136710 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745552554 0 0) 0x7f50e406bc00 con 0x7f50e40b1b00 2024-09-13T16:02:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.745+0000 7f50e1400640 1 -- 172.21.15.70:0/3227136710 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50c8003520 con 0x7f50e40b1b00 2024-09-13T16:02:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.745+0000 7f50e2800640 1 --2- 172.21.15.70:0/3227136710 >> v2:172.21.15.107:3300/0 conn(0x7f50e415a520 0x7f50e406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.746+0000 7f50e1400640 1 -- 172.21.15.70:0/3227136710 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1590449062 0 0) 0x7f50c8003520 con 0x7f50e40b1b00 2024-09-13T16:02:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.746+0000 7f50e1400640 1 -- 172.21.15.70:0/3227136710 >> v2:172.21.15.107:3300/0 conn(0x7f50e415a520 msgr2=0x7f50e406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.746+0000 7f50e1400640 1 --2- 172.21.15.70:0/3227136710 >> v2:172.21.15.107:3300/0 conn(0x7f50e415a520 0x7f50e406b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.746+0000 7f50e1400640 1 -- 172.21.15.70:0/3227136710 >> v1:172.21.15.107:6789/0 conn(0x7f50e40ce020 legacy=0x7f50e415a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.746+0000 7f50e1400640 1 -- 172.21.15.70:0/3227136710 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e406c460 con 0x7f50e40b1b00 2024-09-13T16:02:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.746+0000 7f50e1400640 1 -- 172.21.15.70:0/3227136710 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f50d0001670 con 0x7f50e40b1b00 2024-09-13T16:02:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.746+0000 7f50e1400640 1 -- 172.21.15.70:0/3227136710 >> v1:172.21.15.70:6789/0 conn(0x7f50e40b1b00 legacy=0x7f50e40cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.746+0000 7f50e1400640 1 --2- 172.21.15.70:0/3227136710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50c8003970 0x7f50c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.746+0000 7f50e1400640 1 --2- 172.21.15.70:0/3227136710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50c80047c0 0x7f50c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.746+0000 7f50e1400640 1 --2- 172.21.15.70:0/3227136710 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50c8005180 0x7f50c800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.746+0000 7f50e1400640 1 -- 172.21.15.70:0/3227136710 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e406c180 con 0x7f50c8003970 2024-09-13T16:02:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.746+0000 7f50e1400640 1 -- 172.21.15.70:0/3227136710 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c800c020 con 0x7f50c80047c0 2024-09-13T16:02:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.746+0000 7f50e1400640 1 -- 172.21.15.70:0/3227136710 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c800c1e0 con 0x7f50c8005180 2024-09-13T16:02:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.746+0000 7f50e2800640 1 --2- 172.21.15.70:0/3227136710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50c8003970 0x7f50c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.746+0000 7f50e1e00640 1 --2- 172.21.15.70:0/3227136710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50c80047c0 0x7f50c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.746+0000 7f50e3200640 1 --2- 172.21.15.70:0/3227136710 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50c8005180 0x7f50c800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.747+0000 7f50e2800640 1 -- 172.21.15.70:0/3227136710 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50c8005180 msgr2=0x7f50c800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.747+0000 7f50e2800640 1 --2- 172.21.15.70:0/3227136710 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50c8005180 0x7f50c800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.747+0000 7f50e2800640 1 -- 172.21.15.70:0/3227136710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50c80047c0 msgr2=0x7f50c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.747+0000 7f50e2800640 1 --2- 172.21.15.70:0/3227136710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50c80047c0 0x7f50c8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.747+0000 7f50e2800640 1 -- 172.21.15.70:0/3227136710 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c8003520 con 0x7f50c8003970 2024-09-13T16:02:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.747+0000 7f50e3200640 1 -- 172.21.15.70:0/3227136710 reap_dead start 2024-09-13T16:02:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.747+0000 7f50e2800640 1 --2- 172.21.15.70:0/3227136710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50c8003970 0x7f50c8003d90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009fc0 tx=0x7f50c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d715a1d4be1433af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.748+0000 7f50e1400640 1 -- 172.21.15.70:0/3227136710 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d40305f0 con 0x7f50c8003970 2024-09-13T16:02:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.748+0000 7f50e1400640 1 -- 172.21.15.70:0/3227136710 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d400f040 con 0x7f50c8003970 2024-09-13T16:02:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.748+0000 7f50e1400640 1 -- 172.21.15.70:0/3227136710 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4030990 con 0x7f50c8003970 2024-09-13T16:02:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.748+0000 7f50e9400640 1 -- 172.21.15.70:0/3227136710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50c8003970 msgr2=0x7f50c8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.748+0000 7f50e9400640 1 --2- 172.21.15.70:0/3227136710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50c8003970 0x7f50c8003d90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009fc0 tx=0x7f50c80057f0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.748+0000 7f50e9400640 1 -- 172.21.15.70:0/3227136710 shutdown_connections 2024-09-13T16:02:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.748+0000 7f50e9400640 1 --2- 172.21.15.70:0/3227136710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50c8003970 0x7f50c8003d90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.748+0000 7f50e9400640 1 -- 172.21.15.70:0/3227136710 >> 172.21.15.70:0/3227136710 conn(0x7f50e40b0510 msgr2=0x7f50e40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.748+0000 7f50e9400640 1 -- 172.21.15.70:0/3227136710 shutdown_connections 2024-09-13T16:02:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.748+0000 7f50e9400640 1 -- 172.21.15.70:0/3227136710 wait complete. 2024-09-13T16:02:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.750+0000 7f50e9400640 1 Processor -- start 2024-09-13T16:02:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.750+0000 7f50e9400640 1 -- start start 2024-09-13T16:02:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.751+0000 7f50e9400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50c8003970 0x7f50e4151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.751+0000 7f50e9400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50e41f4400 0x7f50e40a91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.751+0000 7f50e9400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50e415b630 0x7f50e4153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.751+0000 7f50e9400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e415a900 con 0x7f50c8003970 2024-09-13T16:02:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.751+0000 7f50e9400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e415b1a0 con 0x7f50e415b630 2024-09-13T16:02:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.751+0000 7f50e9400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40a9b60 con 0x7f50e41f4400 2024-09-13T16:02:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.751+0000 7f50e2800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50c8003970 0x7f50e4151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.751+0000 7f50e2800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50c8003970 0x7f50e4151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45114/0 (socket says 172.21.15.70:45114) 2024-09-13T16:02:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.751+0000 7f50e2800640 1 -- 172.21.15.70:0/2609860427 learned_addr learned my addr 172.21.15.70:0/2609860427 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.751+0000 7f50e3200640 1 --2- 172.21.15.70:0/2609860427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50e415b630 0x7f50e4153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.751+0000 7f50e1e00640 1 --2- 172.21.15.70:0/2609860427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50e41f4400 0x7f50e40a91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.752+0000 7f50e2800640 1 -- 172.21.15.70:0/2609860427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50e41f4400 msgr2=0x7f50e40a91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.752+0000 7f50e2800640 1 --2- 172.21.15.70:0/2609860427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50e41f4400 0x7f50e40a91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.752+0000 7f50e2800640 1 -- 172.21.15.70:0/2609860427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50e415b630 msgr2=0x7f50e4153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.752+0000 7f50e2800640 1 --2- 172.21.15.70:0/2609860427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50e415b630 0x7f50e4153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.752+0000 7f50e2800640 1 -- 172.21.15.70:0/2609860427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e415ab50 con 0x7f50c8003970 2024-09-13T16:02:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.752+0000 7f50e2800640 1 --2- 172.21.15.70:0/2609860427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50c8003970 0x7f50e4151150 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f50d4033040 tx=0x7f50d4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.752+0000 7f50daa00640 1 -- 172.21.15.70:0/2609860427 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4003b90 con 0x7f50c8003970 2024-09-13T16:02:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.752+0000 7f50daa00640 1 -- 172.21.15.70:0/2609860427 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d4003cf0 con 0x7f50c8003970 2024-09-13T16:02:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.752+0000 7f50daa00640 1 -- 172.21.15.70:0/2609860427 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4004240 con 0x7f50c8003970 2024-09-13T16:02:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.752+0000 7f50e9400640 1 -- 172.21.15.70:0/2609860427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e415ae30 con 0x7f50c8003970 2024-09-13T16:02:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.752+0000 7f50e9400640 1 -- 172.21.15.70:0/2609860427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e40a9730 con 0x7f50c8003970 2024-09-13T16:02:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.753+0000 7f50e9400640 1 -- 172.21.15.70:0/2609860427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e406b640 con 0x7f50c8003970 2024-09-13T16:02:13.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.754+0000 7f50daa00640 1 -- 172.21.15.70:0/2609860427 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f50d4042070 con 0x7f50c8003970 2024-09-13T16:02:13.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.755+0000 7f50daa00640 1 --2- 172.21.15.70:0/2609860427 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f50c406ac30 0x7f50c406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:13.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.755+0000 7f50daa00640 1 -- 172.21.15.70:0/2609860427 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f50d402d070 con 0x7f50c8003970 2024-09-13T16:02:13.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.755+0000 7f50e1e00640 1 --2- 172.21.15.70:0/2609860427 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f50c406ac30 0x7f50c406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:13.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.756+0000 7f50e1e00640 1 --2- 172.21.15.70:0/2609860427 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f50c406ac30 0x7f50c406d0f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f50e415c1c0 tx=0x7f50d0000f80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:13.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.759+0000 7f50daa00640 1 -- 172.21.15.70:0/2609860427 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f50d4074f00 con 0x7f50c8003970 2024-09-13T16:02:13.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.929+0000 7f50e9400640 1 -- 172.21.15.70:0/2609860427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50e406ba50 con 0x7f50c8003970 2024-09-13T16:02:13.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.930+0000 7f50daa00640 1 -- 172.21.15.70:0/2609860427 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12821 (secure 0 0 0) 0x7f50d4034090 con 0x7f50c8003970 2024-09-13T16:02:13.932 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:13.932 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":30,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:02:10.584135+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:02:13.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.932+0000 7f50e9400640 1 -- 172.21.15.70:0/2609860427 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f50c406ac30 msgr2=0x7f50c406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:13.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.932+0000 7f50e9400640 1 --2- 172.21.15.70:0/2609860427 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f50c406ac30 0x7f50c406d0f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f50e415c1c0 tx=0x7f50d0000f80 comp rx=0 tx=0).stop 2024-09-13T16:02:13.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.932+0000 7f50e9400640 1 -- 172.21.15.70:0/2609860427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50c8003970 msgr2=0x7f50e4151150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:13.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.932+0000 7f50e9400640 1 --2- 172.21.15.70:0/2609860427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50c8003970 0x7f50e4151150 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f50d4033040 tx=0x7f50d4009750 comp rx=0 tx=0).stop 2024-09-13T16:02:13.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.932+0000 7f50e9400640 1 -- 172.21.15.70:0/2609860427 shutdown_connections 2024-09-13T16:02:13.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.932+0000 7f50e9400640 1 --2- 172.21.15.70:0/2609860427 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f50c406ac30 0x7f50c406d0f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.932+0000 7f50e9400640 1 --2- 172.21.15.70:0/2609860427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50e415b630 0x7f50e4153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.932+0000 7f50e9400640 1 --2- 172.21.15.70:0/2609860427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50e41f4400 0x7f50e40a91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.932+0000 7f50e9400640 1 --2- 172.21.15.70:0/2609860427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50c8003970 0x7f50e4151150 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:13.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.932+0000 7f50e9400640 1 -- 172.21.15.70:0/2609860427 >> 172.21.15.70:0/2609860427 conn(0x7f50e40b0510 msgr2=0x7f50e40cb020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:13.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.932+0000 7f50e9400640 1 -- 172.21.15.70:0/2609860427 shutdown_connections 2024-09-13T16:02:13.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:13.932+0000 7f50e9400640 1 -- 172.21.15.70:0/2609860427 wait complete. 2024-09-13T16:02:13.950 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:01:06.070694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:02:13.950 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:02:14.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.103+0000 7f7f3a000640 1 Processor -- start 2024-09-13T16:02:14.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.103+0000 7f7f3a000640 1 -- start start 2024-09-13T16:02:14.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.104+0000 7f7f3a000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7f340b31b0 0x7f7f3406bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:14.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.104+0000 7f7f3a000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7f3406c3e0 0x7f7f34070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:14.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.104+0000 7f7f3a000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f340b2890 con 0x7f7f341461c0 2024-09-13T16:02:14.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.104+0000 7f7f3a000640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f340b1880 con 0x7f7f340b31b0 2024-09-13T16:02:14.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.104+0000 7f7f3a000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f340b1ad0 con 0x7f7f3406c3e0 2024-09-13T16:02:14.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.104+0000 7f7f32a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7f340b31b0 0x7f7f3406bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:14.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.105+0000 7f7f32a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7f340b31b0 0x7f7f3406bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45126/0 (socket says 172.21.15.70:45126) 2024-09-13T16:02:14.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.105+0000 7f7f32a00640 1 -- 172.21.15.70:0/1985091449 learned_addr learned my addr 172.21.15.70:0/1985091449 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:14.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.105+0000 7f7f33e00640 1 --2- 172.21.15.70:0/1985091449 >> v2:172.21.15.107:3300/0 conn(0x7f7f3406c3e0 0x7f7f34070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:14.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.105+0000 7f7f32a00640 1 -- 172.21.15.70:0/1985091449 >> v2:172.21.15.107:3300/0 conn(0x7f7f3406c3e0 msgr2=0x7f7f34070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:14.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.105+0000 7f7f32a00640 1 --2- 172.21.15.70:0/1985091449 >> v2:172.21.15.107:3300/0 conn(0x7f7f3406c3e0 0x7f7f34070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.105+0000 7f7f32a00640 1 -- 172.21.15.70:0/1985091449 >> v1:172.21.15.107:6789/0 conn(0x7f7f341461c0 legacy=0x7f7f340b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:14.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.105+0000 7f7f32a00640 1 -- 172.21.15.70:0/1985091449 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f340b1db0 con 0x7f7f340b31b0 2024-09-13T16:02:14.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.106+0000 7f7f32a00640 1 --2- 172.21.15.70:0/1985091449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f340b31b0 0x7f7f3406bea0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7f3406d9f0 tx=0x7f7f2002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b3dd85d059f2a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:14.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.106+0000 7f7f32000640 1 -- 172.21.15.70:0/1985091449 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f20032440 con 0x7f7f340b31b0 2024-09-13T16:02:14.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.106+0000 7f7f32000640 1 -- 172.21.15.70:0/1985091449 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f200325a0 con 0x7f7f340b31b0 2024-09-13T16:02:14.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.106+0000 7f7f32000640 1 -- 172.21.15.70:0/1985091449 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f20032930 con 0x7f7f340b31b0 2024-09-13T16:02:14.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.107+0000 7f7f3a000640 1 -- 172.21.15.70:0/1985091449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f340b31b0 msgr2=0x7f7f3406bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:14.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.107+0000 7f7f3a000640 1 --2- 172.21.15.70:0/1985091449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f340b31b0 0x7f7f3406bea0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7f3406d9f0 tx=0x7f7f2002a1e0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.107+0000 7f7f3a000640 1 -- 172.21.15.70:0/1985091449 shutdown_connections 2024-09-13T16:02:14.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.107+0000 7f7f3a000640 1 --2- 172.21.15.70:0/1985091449 >> v2:172.21.15.107:3300/0 conn(0x7f7f3406c3e0 0x7f7f34070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.107+0000 7f7f3a000640 1 --2- 172.21.15.70:0/1985091449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f340b31b0 0x7f7f3406bea0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.107+0000 7f7f3a000640 1 -- 172.21.15.70:0/1985091449 >> 172.21.15.70:0/1985091449 conn(0x7f7f340b0580 msgr2=0x7f7f340b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:14.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.107+0000 7f7f3a000640 1 -- 172.21.15.70:0/1985091449 shutdown_connections 2024-09-13T16:02:14.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.107+0000 7f7f3a000640 1 -- 172.21.15.70:0/1985091449 wait complete. 2024-09-13T16:02:14.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.108+0000 7f7f3a000640 1 Processor -- start 2024-09-13T16:02:14.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.109+0000 7f7f3a000640 1 -- start start 2024-09-13T16:02:14.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.109+0000 7f7f3a000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f3406c3e0 0x7f7f3415f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:14.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.109+0000 7f7f3a000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f340b31b0 0x7f7f3413c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:14.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.109+0000 7f7f3a000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f341461c0 0x7f7f3413e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:14.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.109+0000 7f7f3a000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f34140410 con 0x7f7f341461c0 2024-09-13T16:02:14.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.109+0000 7f7f3a000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f341567e0 con 0x7f7f340b31b0 2024-09-13T16:02:14.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.109+0000 7f7f3a000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3415f5b0 con 0x7f7f3406c3e0 2024-09-13T16:02:14.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.110+0000 7f7f33e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f341461c0 0x7f7f3413e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:14.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.110+0000 7f7f33e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f341461c0 0x7f7f3413e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45142/0 (socket says 172.21.15.70:45142) 2024-09-13T16:02:14.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.110+0000 7f7f33e00640 1 -- 172.21.15.70:0/852636324 learned_addr learned my addr 172.21.15.70:0/852636324 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:14.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.110+0000 7f7f33400640 1 --2- 172.21.15.70:0/852636324 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f3406c3e0 0x7f7f3415f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:14.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.110+0000 7f7f32a00640 1 --2- 172.21.15.70:0/852636324 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f340b31b0 0x7f7f3413c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:14.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.110+0000 7f7f33e00640 1 -- 172.21.15.70:0/852636324 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f3406c3e0 msgr2=0x7f7f3415f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:14.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.110+0000 7f7f33e00640 1 --2- 172.21.15.70:0/852636324 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f3406c3e0 0x7f7f3415f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.110+0000 7f7f33e00640 1 -- 172.21.15.70:0/852636324 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f340b31b0 msgr2=0x7f7f3413c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:14.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.110+0000 7f7f33e00640 1 --2- 172.21.15.70:0/852636324 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f340b31b0 0x7f7f3413c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.110+0000 7f7f33e00640 1 -- 172.21.15.70:0/852636324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f200094d0 con 0x7f7f341461c0 2024-09-13T16:02:14.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.110+0000 7f7f33e00640 1 --2- 172.21.15.70:0/852636324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f341461c0 0x7f7f3413e890 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c009d30 tx=0x7f7f2c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:14.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.110+0000 7f7f2b400640 1 -- 172.21.15.70:0/852636324 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c009ba0 con 0x7f7f341461c0 2024-09-13T16:02:14.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.110+0000 7f7f2b400640 1 -- 172.21.15.70:0/852636324 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c00f040 con 0x7f7f341461c0 2024-09-13T16:02:14.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.111+0000 7f7f2b400640 1 -- 172.21.15.70:0/852636324 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c0146c0 con 0x7f7f341461c0 2024-09-13T16:02:14.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.111+0000 7f7f3a000640 1 -- 172.21.15.70:0/852636324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f34142390 con 0x7f7f341461c0 2024-09-13T16:02:14.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.111+0000 7f7f3a000640 1 -- 172.21.15.70:0/852636324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f34142910 con 0x7f7f341461c0 2024-09-13T16:02:14.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.112+0000 7f7f3a000640 1 -- 172.21.15.70:0/852636324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f3415dd50 con 0x7f7f341461c0 2024-09-13T16:02:14.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.112+0000 7f7f2b400640 1 -- 172.21.15.70:0/852636324 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7f2c014820 con 0x7f7f341461c0 2024-09-13T16:02:14.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.113+0000 7f7f2b400640 1 --2- 172.21.15.70:0/852636324 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7f1406ac00 0x7f7f1406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:14.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.113+0000 7f7f2b400640 1 -- 172.21.15.70:0/852636324 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7f2c089cb0 con 0x7f7f341461c0 2024-09-13T16:02:14.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.114+0000 7f7f33400640 1 --2- 172.21.15.70:0/852636324 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7f1406ac00 0x7f7f1406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:14.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.114+0000 7f7f33400640 1 --2- 172.21.15.70:0/852636324 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7f1406ac00 0x7f7f1406d0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7f3415c740 tx=0x7f7f24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:14.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.118+0000 7f7f2b400640 1 -- 172.21.15.70:0/852636324 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7f2c055280 con 0x7f7f341461c0 2024-09-13T16:02:14.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.285+0000 7f7f3a000640 1 -- 172.21.15.70:0/852636324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7f3406bea0 con 0x7f7f341461c0 2024-09-13T16:02:14.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.286+0000 7f7f2b400640 1 -- 172.21.15.70:0/852636324 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7f2c018020 con 0x7f7f341461c0 2024-09-13T16:02:14.288 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-13T16:02:14.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.288+0000 7f7f3a000640 1 -- 172.21.15.70:0/852636324 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7f1406ac00 msgr2=0x7f7f1406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:14.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.288+0000 7f7f3a000640 1 --2- 172.21.15.70:0/852636324 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7f1406ac00 0x7f7f1406d0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7f3415c740 tx=0x7f7f24009040 comp rx=0 tx=0).stop 2024-09-13T16:02:14.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.288+0000 7f7f3a000640 1 -- 172.21.15.70:0/852636324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f341461c0 msgr2=0x7f7f3413e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:14.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.288+0000 7f7f3a000640 1 --2- 172.21.15.70:0/852636324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f341461c0 0x7f7f3413e890 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c009d30 tx=0x7f7f2c00c490 comp rx=0 tx=0).stop 2024-09-13T16:02:14.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.288+0000 7f7f3a000640 1 -- 172.21.15.70:0/852636324 shutdown_connections 2024-09-13T16:02:14.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.288+0000 7f7f3a000640 1 --2- 172.21.15.70:0/852636324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f341461c0 0x7f7f3413e890 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.288+0000 7f7f3a000640 1 --2- 172.21.15.70:0/852636324 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7f1406ac00 0x7f7f1406d0c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.288+0000 7f7f3a000640 1 --2- 172.21.15.70:0/852636324 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f340b31b0 0x7f7f3413c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.288+0000 7f7f3a000640 1 --2- 172.21.15.70:0/852636324 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f3406c3e0 0x7f7f3415f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.288+0000 7f7f3a000640 1 -- 172.21.15.70:0/852636324 >> 172.21.15.70:0/852636324 conn(0x7f7f340b0580 msgr2=0x7f7f340ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:14.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.288+0000 7f7f3a000640 1 -- 172.21.15.70:0/852636324 shutdown_connections 2024-09-13T16:02:14.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.288+0000 7f7f3a000640 1 -- 172.21.15.70:0/852636324 wait complete. 2024-09-13T16:02:14.306 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T16:02:14.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.457+0000 7f7bfae00640 1 Processor -- start 2024-09-13T16:02:14.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.457+0000 7f7bfae00640 1 -- start start 2024-09-13T16:02:14.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.458+0000 7f7bfae00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7bf4159610 0x7f7bf4070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:14.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.458+0000 7f7bfae00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7bf40b3790 0x7f7bf40cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:14.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.458+0000 7f7bfae00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf40709e0 con 0x7f7bf4070540 2024-09-13T16:02:14.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.458+0000 7f7bfae00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf41599f0 con 0x7f7bf4159610 2024-09-13T16:02:14.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.458+0000 7f7bfae00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4070cc0 con 0x7f7bf40b3790 2024-09-13T16:02:14.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.459+0000 7f7bf3e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7bf4159610 0x7f7bf4070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:14.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.459+0000 7f7bf3e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7bf4159610 0x7f7bf4070000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45156/0 (socket says 172.21.15.70:45156) 2024-09-13T16:02:14.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.459+0000 7f7bf3e00640 1 -- 172.21.15.70:0/3492069080 learned_addr learned my addr 172.21.15.70:0/3492069080 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:14.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.459+0000 7f7bf3e00640 1 -- 172.21.15.70:0/3492069080 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7bf40b3790 msgr2=0x7f7bf40cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:14.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.459+0000 7f7bf8e00640 1 --2- 172.21.15.70:0/3492069080 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7bf40b3790 0x7f7bf40cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:14.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.459+0000 7f7bf3e00640 1 --2- 172.21.15.70:0/3492069080 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7bf40b3790 0x7f7bf40cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.459+0000 7f7bf3e00640 1 -- 172.21.15.70:0/3492069080 >> v1:172.21.15.107:6789/0 conn(0x7f7bf4070540 legacy=0x7f7bf40b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:14.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.459+0000 7f7bf3e00640 1 -- 172.21.15.70:0/3492069080 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf4070fa0 con 0x7f7bf4159610 2024-09-13T16:02:14.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.459+0000 7f7bf8e00640 1 --2- 172.21.15.70:0/3492069080 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7bf40b3790 0x7f7bf40cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:14.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.460+0000 7f7bf3e00640 1 --2- 172.21.15.70:0/3492069080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bf4159610 0x7f7bf4070000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009870 tx=0x7f7be402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61644c997a321b5e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:14.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.460+0000 7f7bf2a00640 1 -- 172.21.15.70:0/3492069080 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4032440 con 0x7f7bf4159610 2024-09-13T16:02:14.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.460+0000 7f7bf2a00640 1 -- 172.21.15.70:0/3492069080 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be40325a0 con 0x7f7bf4159610 2024-09-13T16:02:14.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.460+0000 7f7bf2a00640 1 -- 172.21.15.70:0/3492069080 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4032930 con 0x7f7bf4159610 2024-09-13T16:02:14.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.461+0000 7f7bfae00640 1 -- 172.21.15.70:0/3492069080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bf4159610 msgr2=0x7f7bf4070000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:14.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.461+0000 7f7bfae00640 1 --2- 172.21.15.70:0/3492069080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bf4159610 0x7f7bf4070000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009870 tx=0x7f7be402a210 comp rx=0 tx=0).stop 2024-09-13T16:02:14.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.461+0000 7f7bfae00640 1 -- 172.21.15.70:0/3492069080 shutdown_connections 2024-09-13T16:02:14.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.461+0000 7f7bfae00640 1 --2- 172.21.15.70:0/3492069080 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7bf40b3790 0x7f7bf40cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.461+0000 7f7bfae00640 1 --2- 172.21.15.70:0/3492069080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bf4159610 0x7f7bf4070000 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.461+0000 7f7bfae00640 1 -- 172.21.15.70:0/3492069080 >> 172.21.15.70:0/3492069080 conn(0x7f7bf40b0510 msgr2=0x7f7bf40b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:14.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.461+0000 7f7bfae00640 1 -- 172.21.15.70:0/3492069080 shutdown_connections 2024-09-13T16:02:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.461+0000 7f7bfae00640 1 -- 172.21.15.70:0/3492069080 wait complete. 2024-09-13T16:02:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.463+0000 7f7bfae00640 1 Processor -- start 2024-09-13T16:02:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.463+0000 7f7bfae00640 1 -- start start 2024-09-13T16:02:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.464+0000 7f7bfae00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bf4070540 0x7f7bf415c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.464+0000 7f7bfae00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bf40b3790 0x7f7bf41e5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.464+0000 7f7bfae00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7bf4159610 0x7f7bf41547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.464+0000 7f7bfae00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf415bb40 con 0x7f7bf4070540 2024-09-13T16:02:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.464+0000 7f7bfae00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf41e6360 con 0x7f7bf40b3790 2024-09-13T16:02:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.464+0000 7f7bfae00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf41e6080 con 0x7f7bf4159610 2024-09-13T16:02:14.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.464+0000 7f7bf3e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bf4070540 0x7f7bf415c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:14.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.464+0000 7f7bf3e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bf4070540 0x7f7bf415c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45168/0 (socket says 172.21.15.70:45168) 2024-09-13T16:02:14.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.464+0000 7f7bf3e00640 1 -- 172.21.15.70:0/1156464789 learned_addr learned my addr 172.21.15.70:0/1156464789 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:14.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.464+0000 7f7bf8e00640 1 --2- 172.21.15.70:0/1156464789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7bf4159610 0x7f7bf41547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:14.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.464+0000 7f7bf3400640 1 --2- 172.21.15.70:0/1156464789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bf40b3790 0x7f7bf41e5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:14.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.464+0000 7f7bf3e00640 1 -- 172.21.15.70:0/1156464789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7bf4159610 msgr2=0x7f7bf41547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:14.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.464+0000 7f7bf3e00640 1 --2- 172.21.15.70:0/1156464789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7bf4159610 0x7f7bf41547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.464+0000 7f7bf3e00640 1 -- 172.21.15.70:0/1156464789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bf40b3790 msgr2=0x7f7bf41e5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:14.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.464+0000 7f7bf3e00640 1 --2- 172.21.15.70:0/1156464789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bf40b3790 0x7f7bf41e5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.464+0000 7f7bf3e00640 1 -- 172.21.15.70:0/1156464789 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be40094d0 con 0x7f7bf4070540 2024-09-13T16:02:14.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.464+0000 7f7bf3400640 1 --2- 172.21.15.70:0/1156464789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bf40b3790 0x7f7bf41e5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:14.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.465+0000 7f7bf3e00640 1 --2- 172.21.15.70:0/1156464789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bf4070540 0x7f7bf415c410 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009870 tx=0x7f7be40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:14.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.465+0000 7f7bebe00640 1 -- 172.21.15.70:0/1156464789 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4030b00 con 0x7f7bf4070540 2024-09-13T16:02:14.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.465+0000 7f7bebe00640 1 -- 172.21.15.70:0/1156464789 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be4030c60 con 0x7f7bf4070540 2024-09-13T16:02:14.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.465+0000 7f7bebe00640 1 -- 172.21.15.70:0/1156464789 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be403d420 con 0x7f7bf4070540 2024-09-13T16:02:14.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.465+0000 7f7bfae00640 1 -- 172.21.15.70:0/1156464789 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf414e450 con 0x7f7bf4070540 2024-09-13T16:02:14.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.465+0000 7f7bfae00640 1 -- 172.21.15.70:0/1156464789 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf414ea10 con 0x7f7bf4070540 2024-09-13T16:02:14.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.466+0000 7f7bfae00640 1 -- 172.21.15.70:0/1156464789 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf415c950 con 0x7f7bf4070540 2024-09-13T16:02:14.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.467+0000 7f7bebe00640 1 -- 172.21.15.70:0/1156464789 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7be4039040 con 0x7f7bf4070540 2024-09-13T16:02:14.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.468+0000 7f7bebe00640 1 --2- 172.21.15.70:0/1156464789 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7bd406ac30 0x7f7bd406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:14.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.468+0000 7f7bebe00640 1 -- 172.21.15.70:0/1156464789 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7be40a9d60 con 0x7f7bf4070540 2024-09-13T16:02:14.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.468+0000 7f7bf3400640 1 --2- 172.21.15.70:0/1156464789 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7bd406ac30 0x7f7bd406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:14.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.469+0000 7f7bf3400640 1 --2- 172.21.15.70:0/1156464789 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7bd406ac30 0x7f7bd406d0f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4155b90 tx=0x7f7be0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:14.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.472+0000 7f7bebe00640 1 -- 172.21.15.70:0/1156464789 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7be4075330 con 0x7f7bf4070540 2024-09-13T16:02:14.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.646+0000 7f7bfae00640 1 -- 172.21.15.70:0/1156464789 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7bf41e6a10 con 0x7f7bf4070540 2024-09-13T16:02:14.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.646+0000 7f7bebe00640 1 -- 172.21.15.70:0/1156464789 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7be4078950 con 0x7f7bf4070540 2024-09-13T16:02:14.649 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:14.649 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2024-09-13T16:02:14.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-13T16:02:14.649 INFO:teuthology.orchestra.run.smithi070.stdout: "poolnum": 1, 2024-09-13T16:02:14.649 INFO:teuthology.orchestra.run.smithi070.stdout: "poolname": ".mgr" 2024-09-13T16:02:14.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-13T16:02:14.649 INFO:teuthology.orchestra.run.smithi070.stdout:] 2024-09-13T16:02:14.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.648+0000 7f7bfae00640 1 -- 172.21.15.70:0/1156464789 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7bd406ac30 msgr2=0x7f7bd406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:14.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.648+0000 7f7bfae00640 1 --2- 172.21.15.70:0/1156464789 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7bd406ac30 0x7f7bd406d0f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4155b90 tx=0x7f7be0009040 comp rx=0 tx=0).stop 2024-09-13T16:02:14.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.648+0000 7f7bfae00640 1 -- 172.21.15.70:0/1156464789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bf4070540 msgr2=0x7f7bf415c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:14.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.648+0000 7f7bfae00640 1 --2- 172.21.15.70:0/1156464789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bf4070540 0x7f7bf415c410 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009870 tx=0x7f7be40046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.648+0000 7f7bfae00640 1 -- 172.21.15.70:0/1156464789 shutdown_connections 2024-09-13T16:02:14.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.648+0000 7f7bfae00640 1 --2- 172.21.15.70:0/1156464789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7bf4159610 0x7f7bf41547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.648+0000 7f7bfae00640 1 --2- 172.21.15.70:0/1156464789 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7bd406ac30 0x7f7bd406d0f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.648+0000 7f7bfae00640 1 --2- 172.21.15.70:0/1156464789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bf40b3790 0x7f7bf41e5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.648+0000 7f7bfae00640 1 --2- 172.21.15.70:0/1156464789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bf4070540 0x7f7bf415c410 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.648+0000 7f7bfae00640 1 -- 172.21.15.70:0/1156464789 >> 172.21.15.70:0/1156464789 conn(0x7f7bf40b0510 msgr2=0x7f7bf40b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:14.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.649+0000 7f7bfae00640 1 -- 172.21.15.70:0/1156464789 shutdown_connections 2024-09-13T16:02:14.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.649+0000 7f7bfae00640 1 -- 172.21.15.70:0/1156464789 wait complete. 2024-09-13T16:02:14.666 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T16:02:14.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T16:02:14.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.821+0000 7fd451600640 1 Processor -- start 2024-09-13T16:02:14.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.821+0000 7fd451600640 1 -- start start 2024-09-13T16:02:14.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.822+0000 7fd451600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd44c1592f0 0x7fd44c0b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:14.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.823+0000 7fd451600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44c070030 con 0x7fd44c0adeb0 2024-09-13T16:02:14.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.823+0000 7fd451600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44c0b1d50 con 0x7fd44c1596d0 2024-09-13T16:02:14.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.823+0000 7fd451600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c071870 con 0x7fd44c1592f0 2024-09-13T16:02:14.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.823+0000 7fd442000640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd44c0adeb0 0x7fd44c0704c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:52018/0 (socket says 172.21.15.70:52018) 2024-09-13T16:02:14.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.823+0000 7fd442000640 1 -- 172.21.15.70:0/3980989586 learned_addr learned my addr 172.21.15.70:0/3980989586 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:14.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.823+0000 7fd44aa00640 1 --2- 172.21.15.70:0/3980989586 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd44c1592f0 0x7fd44c0b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:14.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.823+0000 7fd44a000640 1 -- 172.21.15.70:0/3980989586 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747072305 0 0) 0x7fd44c070030 con 0x7fd44c0adeb0 2024-09-13T16:02:14.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.823+0000 7fd44a000640 1 -- 172.21.15.70:0/3980989586 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd430003520 con 0x7fd44c0adeb0 2024-09-13T16:02:14.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.824+0000 7fd44a000640 1 -- 172.21.15.70:0/3980989586 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577069900 0 0) 0x7fd44c0b1d50 con 0x7fd44c1596d0 2024-09-13T16:02:14.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.824+0000 7fd44aa00640 1 -- 172.21.15.70:0/3980989586 >> v1:172.21.15.107:6789/0 conn(0x7fd44c1596d0 legacy=0x7fd44c15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:14.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.824+0000 7fd44aa00640 1 -- 172.21.15.70:0/3980989586 >> v1:172.21.15.70:6789/0 conn(0x7fd44c0adeb0 legacy=0x7fd44c0704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:14.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.824+0000 7fd44aa00640 1 -- 172.21.15.70:0/3980989586 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c06f700 con 0x7fd44c1592f0 2024-09-13T16:02:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.825+0000 7fd44aa00640 1 --2- 172.21.15.70:0/3980989586 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd44c1592f0 0x7fd44c0b1810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0097d0 tx=0x7fd43c02c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4899318d60a50c78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.825+0000 7fd44a000640 1 -- 172.21.15.70:0/3980989586 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c031710 con 0x7fd44c1592f0 2024-09-13T16:02:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.825+0000 7fd44a000640 1 -- 172.21.15.70:0/3980989586 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43c02f050 con 0x7fd44c1592f0 2024-09-13T16:02:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.825+0000 7fd44a000640 1 -- 172.21.15.70:0/3980989586 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c031a90 con 0x7fd44c1592f0 2024-09-13T16:02:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.825+0000 7fd451600640 1 -- 172.21.15.70:0/3980989586 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd44c1592f0 msgr2=0x7fd44c0b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.825+0000 7fd451600640 1 --2- 172.21.15.70:0/3980989586 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd44c1592f0 0x7fd44c0b1810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0097d0 tx=0x7fd43c02c420 comp rx=0 tx=0).stop 2024-09-13T16:02:14.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.826+0000 7fd451600640 1 -- 172.21.15.70:0/3980989586 shutdown_connections 2024-09-13T16:02:14.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.826+0000 7fd451600640 1 --2- 172.21.15.70:0/3980989586 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd44c1592f0 0x7fd44c0b1810 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.826+0000 7fd451600640 1 -- 172.21.15.70:0/3980989586 >> 172.21.15.70:0/3980989586 conn(0x7fd44c0b0510 msgr2=0x7fd44c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:14.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.826+0000 7fd451600640 1 -- 172.21.15.70:0/3980989586 shutdown_connections 2024-09-13T16:02:14.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.826+0000 7fd451600640 1 -- 172.21.15.70:0/3980989586 wait complete. 2024-09-13T16:02:14.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.827+0000 7fd451600640 1 Processor -- start 2024-09-13T16:02:14.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.827+0000 7fd451600640 1 -- start start 2024-09-13T16:02:14.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.828+0000 7fd451600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd44c0adeb0 0x7fd44c1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:14.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.828+0000 7fd451600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd44c1592f0 0x7fd44c150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:14.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.828+0000 7fd451600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd44c1596d0 0x7fd44c1545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:14.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.828+0000 7fd451600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c151ef0 con 0x7fd44c1592f0 2024-09-13T16:02:14.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.828+0000 7fd451600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c1523c0 con 0x7fd44c1596d0 2024-09-13T16:02:14.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.828+0000 7fd451600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c1520e0 con 0x7fd44c0adeb0 2024-09-13T16:02:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.828+0000 7fd442000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd44c1592f0 0x7fd44c150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.829+0000 7fd442000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd44c1592f0 0x7fd44c150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45182/0 (socket says 172.21.15.70:45182) 2024-09-13T16:02:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.829+0000 7fd442000640 1 -- 172.21.15.70:0/3516928297 learned_addr learned my addr 172.21.15.70:0/3516928297 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.829+0000 7fd44aa00640 1 --2- 172.21.15.70:0/3516928297 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd44c0adeb0 0x7fd44c1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.829+0000 7fd44b400640 1 --2- 172.21.15.70:0/3516928297 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd44c1596d0 0x7fd44c1545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.829+0000 7fd442000640 1 -- 172.21.15.70:0/3516928297 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd44c0adeb0 msgr2=0x7fd44c1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.829+0000 7fd442000640 1 --2- 172.21.15.70:0/3516928297 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd44c0adeb0 0x7fd44c1519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.829+0000 7fd442000640 1 -- 172.21.15.70:0/3516928297 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd44c1596d0 msgr2=0x7fd44c1545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.829+0000 7fd442000640 1 --2- 172.21.15.70:0/3516928297 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd44c1596d0 0x7fd44c1545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.829+0000 7fd442000640 1 -- 172.21.15.70:0/3516928297 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c009400 con 0x7fd44c1592f0 2024-09-13T16:02:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.829+0000 7fd442000640 1 --2- 172.21.15.70:0/3516928297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd44c1592f0 0x7fd44c150750 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd43400c400 tx=0x7fd43400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.829+0000 7fd443400640 1 -- 172.21.15.70:0/3516928297 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd434005ce0 con 0x7fd44c1592f0 2024-09-13T16:02:14.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.829+0000 7fd443400640 1 -- 172.21.15.70:0/3516928297 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd434005e60 con 0x7fd44c1592f0 2024-09-13T16:02:14.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.829+0000 7fd443400640 1 -- 172.21.15.70:0/3516928297 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4340072f0 con 0x7fd44c1592f0 2024-09-13T16:02:14.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.829+0000 7fd451600640 1 -- 172.21.15.70:0/3516928297 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44c153ac0 con 0x7fd44c1592f0 2024-09-13T16:02:14.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.830+0000 7fd451600640 1 -- 172.21.15.70:0/3516928297 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c154080 con 0x7fd44c1592f0 2024-09-13T16:02:14.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.830+0000 7fd451600640 1 -- 172.21.15.70:0/3516928297 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44c070d40 con 0x7fd44c1592f0 2024-09-13T16:02:14.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.831+0000 7fd443400640 1 -- 172.21.15.70:0/3516928297 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd434007450 con 0x7fd44c1592f0 2024-09-13T16:02:14.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.832+0000 7fd443400640 1 --2- 172.21.15.70:0/3516928297 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd42806ac00 0x7fd42806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:14.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.832+0000 7fd443400640 1 -- 172.21.15.70:0/3516928297 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd434088640 con 0x7fd44c1592f0 2024-09-13T16:02:14.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.833+0000 7fd44aa00640 1 --2- 172.21.15.70:0/3516928297 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd42806ac00 0x7fd42806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:14.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.833+0000 7fd44aa00640 1 --2- 172.21.15.70:0/3516928297 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd42806ac00 0x7fd42806d0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd43c035000 tx=0x7fd43c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:14.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:14.837+0000 7fd443400640 1 -- 172.21.15.70:0/3516928297 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd434053c10 con 0x7fd44c1592f0 2024-09-13T16:02:15.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.003+0000 7fd451600640 1 -- 172.21.15.70:0/3516928297 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd44c0b19b0 con 0x7fd44c1592f0 2024-09-13T16:02:15.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.572+0000 7fd443400640 1 -- 172.21.15.70:0/3516928297 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd4340170b0 con 0x7fd44c1592f0 2024-09-13T16:02:15.575 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' created 2024-09-13T16:02:15.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.575+0000 7fd451600640 1 -- 172.21.15.70:0/3516928297 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd42806ac00 msgr2=0x7fd42806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:15.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.575+0000 7fd451600640 1 --2- 172.21.15.70:0/3516928297 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd42806ac00 0x7fd42806d0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd43c035000 tx=0x7fd43c008030 comp rx=0 tx=0).stop 2024-09-13T16:02:15.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.576+0000 7fd451600640 1 -- 172.21.15.70:0/3516928297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd44c1592f0 msgr2=0x7fd44c150750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:15.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.576+0000 7fd451600640 1 --2- 172.21.15.70:0/3516928297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd44c1592f0 0x7fd44c150750 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd43400c400 tx=0x7fd43400c8c0 comp rx=0 tx=0).stop 2024-09-13T16:02:15.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.576+0000 7fd451600640 1 -- 172.21.15.70:0/3516928297 shutdown_connections 2024-09-13T16:02:15.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.576+0000 7fd451600640 1 --2- 172.21.15.70:0/3516928297 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd42806ac00 0x7fd42806d0c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:15.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.576+0000 7fd451600640 1 --2- 172.21.15.70:0/3516928297 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd44c1596d0 0x7fd44c1545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:15.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.576+0000 7fd451600640 1 --2- 172.21.15.70:0/3516928297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd44c1592f0 0x7fd44c150750 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:15.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.576+0000 7fd451600640 1 --2- 172.21.15.70:0/3516928297 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd44c0adeb0 0x7fd44c1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:15.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.576+0000 7fd451600640 1 -- 172.21.15.70:0/3516928297 >> 172.21.15.70:0/3516928297 conn(0x7fd44c0b0510 msgr2=0x7fd44c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:15.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.577+0000 7fd451600640 1 -- 172.21.15.70:0/3516928297 shutdown_connections 2024-09-13T16:02:15.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.577+0000 7fd451600640 1 -- 172.21.15.70:0/3516928297 wait complete. 2024-09-13T16:02:15.597 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T16:02:15.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.755+0000 7fa056600640 1 Processor -- start 2024-09-13T16:02:15.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.755+0000 7fa056600640 1 -- start start 2024-09-13T16:02:15.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.756+0000 7fa056600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa050159740 0x7fa0500b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:15.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.756+0000 7fa056600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa0500b3ac0 0x7fa050070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:15.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.756+0000 7fa056600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0500b2df0 con 0x7fa050159360 2024-09-13T16:02:15.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.756+0000 7fa056600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa05015d9b0 con 0x7fa0500b3ac0 2024-09-13T16:02:15.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.756+0000 7fa056600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05015dc90 con 0x7fa050159740 2024-09-13T16:02:15.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.756+0000 7fa04f400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fa050159360 0x7fa05015d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:52024/0 (socket says 172.21.15.70:52024) 2024-09-13T16:02:15.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.756+0000 7fa04f400640 1 -- 172.21.15.70:0/2269738009 learned_addr learned my addr 172.21.15.70:0/2269738009 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:15.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.757+0000 7fa04fe00640 1 --2- 172.21.15.70:0/2269738009 >> v2:172.21.15.107:3300/0 conn(0x7fa0500b3ac0 0x7fa050070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.757+0000 7fa04ea00640 1 --2- 172.21.15.70:0/2269738009 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa050159740 0x7fa0500b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.757+0000 7fa04e000640 1 -- 172.21.15.70:0/2269738009 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454833327 0 0) 0x7fa0500b2df0 con 0x7fa050159360 2024-09-13T16:02:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.757+0000 7fa04e000640 1 -- 172.21.15.70:0/2269738009 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa034005730 con 0x7fa050159360 2024-09-13T16:02:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.757+0000 7fa04e000640 1 -- 172.21.15.70:0/2269738009 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 555775625 0 0) 0x7fa034005730 con 0x7fa050159360 2024-09-13T16:02:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.757+0000 7fa04e000640 1 -- 172.21.15.70:0/2269738009 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa050159740 msgr2=0x7fa0500b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.757+0000 7fa04e000640 1 --2- 172.21.15.70:0/2269738009 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa050159740 0x7fa0500b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.757+0000 7fa04e000640 1 -- 172.21.15.70:0/2269738009 >> v2:172.21.15.107:3300/0 conn(0x7fa0500b3ac0 msgr2=0x7fa050070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.757+0000 7fa04e000640 1 --2- 172.21.15.70:0/2269738009 >> v2:172.21.15.107:3300/0 conn(0x7fa0500b3ac0 0x7fa050070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.757+0000 7fa04e000640 1 -- 172.21.15.70:0/2269738009 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0500b3060 con 0x7fa050159360 2024-09-13T16:02:15.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.757+0000 7fa04e000640 1 -- 172.21.15.70:0/2269738009 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7fa040001670 con 0x7fa050159360 2024-09-13T16:02:15.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.757+0000 7fa04e000640 1 -- 172.21.15.70:0/2269738009 >> v1:172.21.15.70:6789/0 conn(0x7fa050159360 legacy=0x7fa05015d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:15.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.757+0000 7fa04e000640 1 --2- 172.21.15.70:0/2269738009 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa050159740 0x7fa034005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:15.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.757+0000 7fa04e000640 1 --2- 172.21.15.70:0/2269738009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa034006100 0x7fa0340069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:15.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.757+0000 7fa04e000640 1 --2- 172.21.15.70:0/2269738009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa034006f10 0x7fa034007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:15.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.757+0000 7fa04e000640 1 -- 172.21.15.70:0/2269738009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05015d9b0 con 0x7fa034006f10 2024-09-13T16:02:15.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.757+0000 7fa04e000640 1 -- 172.21.15.70:0/2269738009 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05015dc90 con 0x7fa034006100 2024-09-13T16:02:15.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.757+0000 7fa04e000640 1 -- 172.21.15.70:0/2269738009 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03400dbe0 con 0x7fa050159740 2024-09-13T16:02:15.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.758+0000 7fa04fe00640 1 --2- 172.21.15.70:0/2269738009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa034006f10 0x7fa034007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:15.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.758+0000 7fa04ea00640 1 --2- 172.21.15.70:0/2269738009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa034006100 0x7fa0340069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:15.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.758+0000 7fa04f400640 1 --2- 172.21.15.70:0/2269738009 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa050159740 0x7fa034005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:15.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.758+0000 7fa04fe00640 1 -- 172.21.15.70:0/2269738009 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa050159740 msgr2=0x7fa034005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:15.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.758+0000 7fa04fe00640 1 --2- 172.21.15.70:0/2269738009 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa050159740 0x7fa034005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:15.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.758+0000 7fa04fe00640 1 -- 172.21.15.70:0/2269738009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa034006100 msgr2=0x7fa0340069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:15.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.758+0000 7fa04fe00640 1 --2- 172.21.15.70:0/2269738009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa034006100 0x7fa0340069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:15.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.758+0000 7fa04fe00640 1 -- 172.21.15.70:0/2269738009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa034005730 con 0x7fa034006f10 2024-09-13T16:02:15.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.759+0000 7fa04fe00640 1 --2- 172.21.15.70:0/2269738009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa034006f10 0x7fa034007390 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa04800e170 tx=0x7fa034007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5941f5bc0dd19e7f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:15.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.759+0000 7fa04e000640 1 -- 172.21.15.70:0/2269738009 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048030430 con 0x7fa034006f10 2024-09-13T16:02:15.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.759+0000 7fa04e000640 1 -- 172.21.15.70:0/2269738009 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04800f040 con 0x7fa034006f10 2024-09-13T16:02:15.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.759+0000 7fa04e000640 1 -- 172.21.15.70:0/2269738009 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0480307d0 con 0x7fa034006f10 2024-09-13T16:02:15.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.760+0000 7fa056600640 1 -- 172.21.15.70:0/2269738009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa034006f10 msgr2=0x7fa034007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:15.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.760+0000 7fa056600640 1 --2- 172.21.15.70:0/2269738009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa034006f10 0x7fa034007390 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa04800e170 tx=0x7fa034007a00 comp rx=0 tx=0).stop 2024-09-13T16:02:15.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.760+0000 7fa04fe00640 1 -- 172.21.15.70:0/2269738009 reap_dead start 2024-09-13T16:02:15.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.760+0000 7fa056600640 1 -- 172.21.15.70:0/2269738009 shutdown_connections 2024-09-13T16:02:15.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.760+0000 7fa056600640 1 -- 172.21.15.70:0/2269738009 >> 172.21.15.70:0/2269738009 conn(0x7fa0500b0840 msgr2=0x7fa0500b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:15.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.760+0000 7fa056600640 1 -- 172.21.15.70:0/2269738009 shutdown_connections 2024-09-13T16:02:15.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.760+0000 7fa056600640 1 -- 172.21.15.70:0/2269738009 wait complete. 2024-09-13T16:02:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.762+0000 7fa056600640 1 Processor -- start 2024-09-13T16:02:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.762+0000 7fa056600640 1 -- start start 2024-09-13T16:02:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.763+0000 7fa056600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa05014e1b0 0x7fa05015bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.763+0000 7fa056600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa05014b6e0 0x7fa05014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.763+0000 7fa056600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa05014ead0 0x7fa05014ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.763+0000 7fa056600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05015c110 con 0x7fa05014e1b0 2024-09-13T16:02:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.763+0000 7fa056600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05015c3f0 con 0x7fa05014ead0 2024-09-13T16:02:15.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.763+0000 7fa056600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05015c6d0 con 0x7fa05014b6e0 2024-09-13T16:02:15.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.763+0000 7fa04f400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa05014e1b0 0x7fa05015bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:15.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.763+0000 7fa04f400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa05014e1b0 0x7fa05015bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45188/0 (socket says 172.21.15.70:45188) 2024-09-13T16:02:15.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.763+0000 7fa04f400640 1 -- 172.21.15.70:0/595067043 learned_addr learned my addr 172.21.15.70:0/595067043 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:15.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.763+0000 7fa04ea00640 1 --2- 172.21.15.70:0/595067043 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa05014b6e0 0x7fa05014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:15.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.763+0000 7fa04fe00640 1 --2- 172.21.15.70:0/595067043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa05014ead0 0x7fa05014ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:15.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.763+0000 7fa04f400640 1 -- 172.21.15.70:0/595067043 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa05014b6e0 msgr2=0x7fa05014e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:15.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.763+0000 7fa04f400640 1 --2- 172.21.15.70:0/595067043 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa05014b6e0 0x7fa05014e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:15.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.763+0000 7fa04f400640 1 -- 172.21.15.70:0/595067043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa05014ead0 msgr2=0x7fa05014ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:15.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.763+0000 7fa04f400640 1 --2- 172.21.15.70:0/595067043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa05014ead0 0x7fa05014ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:15.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.763+0000 7fa04f400640 1 -- 172.21.15.70:0/595067043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05015c9b0 con 0x7fa05014e1b0 2024-09-13T16:02:15.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.763+0000 7fa04ea00640 1 --2- 172.21.15.70:0/595067043 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa05014b6e0 0x7fa05014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:15.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.764+0000 7fa04f400640 1 --2- 172.21.15.70:0/595067043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa05014e1b0 0x7fa05015bb30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa040007290 tx=0x7fa040007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:15.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.764+0000 7fa047400640 1 -- 172.21.15.70:0/595067043 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04000f960 con 0x7fa05014e1b0 2024-09-13T16:02:15.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.764+0000 7fa047400640 1 -- 172.21.15.70:0/595067043 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04000fac0 con 0x7fa05014e1b0 2024-09-13T16:02:15.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.764+0000 7fa047400640 1 -- 172.21.15.70:0/595067043 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04000fe70 con 0x7fa05014e1b0 2024-09-13T16:02:15.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.764+0000 7fa056600640 1 -- 172.21.15.70:0/595067043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05014c090 con 0x7fa05014e1b0 2024-09-13T16:02:15.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.764+0000 7fa056600640 1 -- 172.21.15.70:0/595067043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa050156950 con 0x7fa05014e1b0 2024-09-13T16:02:15.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.765+0000 7fa056600640 1 -- 172.21.15.70:0/595067043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa05014c280 con 0x7fa05014e1b0 2024-09-13T16:02:15.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.766+0000 7fa047400640 1 -- 172.21.15.70:0/595067043 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa04001d460 con 0x7fa05014e1b0 2024-09-13T16:02:15.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.767+0000 7fa047400640 1 --2- 172.21.15.70:0/595067043 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa03006ac00 0x7fa03006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:15.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.767+0000 7fa047400640 1 -- 172.21.15.70:0/595067043 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa040089f50 con 0x7fa05014e1b0 2024-09-13T16:02:15.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.768+0000 7fa04ea00640 1 --2- 172.21.15.70:0/595067043 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa03006ac00 0x7fa03006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:15.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.768+0000 7fa04ea00640 1 --2- 172.21.15.70:0/595067043 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa03006ac00 0x7fa03006d0c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa05014be90 tx=0x7fa03c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:15.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.771+0000 7fa047400640 1 -- 172.21.15.70:0/595067043 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa0400552f0 con 0x7fa05014e1b0 2024-09-13T16:02:15.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:15.940+0000 7fa056600640 1 -- 172.21.15.70:0/595067043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa05015d0d0 con 0x7fa05014e1b0 2024-09-13T16:02:16.208 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T16:02:16.213 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T16:02:16.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.579+0000 7fa047400640 1 -- 172.21.15.70:0/595067043 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa040058910 con 0x7fa05014e1b0 2024-09-13T16:02:16.582 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' created 2024-09-13T16:02:16.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.583+0000 7fa056600640 1 -- 172.21.15.70:0/595067043 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa03006ac00 msgr2=0x7fa03006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:16.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.583+0000 7fa056600640 1 --2- 172.21.15.70:0/595067043 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa03006ac00 0x7fa03006d0c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa05014be90 tx=0x7fa03c008040 comp rx=0 tx=0).stop 2024-09-13T16:02:16.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.583+0000 7fa056600640 1 -- 172.21.15.70:0/595067043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa05014e1b0 msgr2=0x7fa05015bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:16.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.583+0000 7fa056600640 1 --2- 172.21.15.70:0/595067043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa05014e1b0 0x7fa05015bb30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa040007290 tx=0x7fa040007750 comp rx=0 tx=0).stop 2024-09-13T16:02:16.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.584+0000 7fa056600640 1 -- 172.21.15.70:0/595067043 shutdown_connections 2024-09-13T16:02:16.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.584+0000 7fa056600640 1 --2- 172.21.15.70:0/595067043 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fa03006ac00 0x7fa03006d0c0 secure :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa05014be90 tx=0x7fa03c008040 comp rx=0 tx=0).stop 2024-09-13T16:02:16.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.584+0000 7fa056600640 1 --2- 172.21.15.70:0/595067043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa05014ead0 0x7fa05014ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:16.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.584+0000 7fa056600640 1 --2- 172.21.15.70:0/595067043 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa05014b6e0 0x7fa05014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:16.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.584+0000 7fa056600640 1 --2- 172.21.15.70:0/595067043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa05014e1b0 0x7fa05015bb30 secure :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa040007290 tx=0x7fa040007750 comp rx=0 tx=0).stop 2024-09-13T16:02:16.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.584+0000 7fa056600640 1 -- 172.21.15.70:0/595067043 >> 172.21.15.70:0/595067043 conn(0x7fa0500b0840 msgr2=0x7fa050070800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:16.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.584+0000 7fa056600640 1 -- 172.21.15.70:0/595067043 shutdown_connections 2024-09-13T16:02:16.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.584+0000 7fa056600640 1 -- 172.21.15.70:0/595067043 wait complete. 2024-09-13T16:02:16.613 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T16:02:16.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.766+0000 7efc58e00640 1 Processor -- start 2024-09-13T16:02:16.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.766+0000 7efc58e00640 1 -- start start 2024-09-13T16:02:16.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.767+0000 7efc58e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efc54070170 0x7efc540ad950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:16.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.767+0000 7efc58e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc540ade90 0x7efc5415c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:16.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.767+0000 7efc58e00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5406fce0 con 0x7efc541566f0 2024-09-13T16:02:16.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.767+0000 7efc58e00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc540ae320 con 0x7efc54070170 2024-09-13T16:02:16.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.767+0000 7efc58e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5406c550 con 0x7efc540ade90 2024-09-13T16:02:16.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.768+0000 7efc51400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efc54070170 0x7efc540ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:16.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.768+0000 7efc51400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efc54070170 0x7efc540ad950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45200/0 (socket says 172.21.15.70:45200) 2024-09-13T16:02:16.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.768+0000 7efc51400640 1 -- 172.21.15.70:0/1707983175 learned_addr learned my addr 172.21.15.70:0/1707983175 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:16.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.768+0000 7efc52800640 1 --2- 172.21.15.70:0/1707983175 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc540ade90 0x7efc5415c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:16.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.768+0000 7efc51400640 1 -- 172.21.15.70:0/1707983175 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc540ade90 msgr2=0x7efc5415c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:16.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.768+0000 7efc51400640 1 --2- 172.21.15.70:0/1707983175 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc540ade90 0x7efc5415c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:16.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.768+0000 7efc51400640 1 -- 172.21.15.70:0/1707983175 >> v1:172.21.15.70:6789/0 conn(0x7efc541566f0 legacy=0x7efc5406be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:16.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.768+0000 7efc51400640 1 -- 172.21.15.70:0/1707983175 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5406c820 con 0x7efc54070170 2024-09-13T16:02:16.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.769+0000 7efc51400640 1 --2- 172.21.15.70:0/1707983175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc54070170 0x7efc540ad950 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efc4000bb10 tx=0x7efc4002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8f998127122182 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:16.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.769+0000 7efc50a00640 1 -- 172.21.15.70:0/1707983175 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40032820 con 0x7efc54070170 2024-09-13T16:02:16.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.769+0000 7efc50a00640 1 -- 172.21.15.70:0/1707983175 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4002e040 con 0x7efc54070170 2024-09-13T16:02:16.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.769+0000 7efc50a00640 1 -- 172.21.15.70:0/1707983175 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40032ba0 con 0x7efc54070170 2024-09-13T16:02:16.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.770+0000 7efc58e00640 1 -- 172.21.15.70:0/1707983175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc54070170 msgr2=0x7efc540ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:16.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.770+0000 7efc58e00640 1 --2- 172.21.15.70:0/1707983175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc54070170 0x7efc540ad950 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efc4000bb10 tx=0x7efc4002c920 comp rx=0 tx=0).stop 2024-09-13T16:02:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.770+0000 7efc58e00640 1 -- 172.21.15.70:0/1707983175 shutdown_connections 2024-09-13T16:02:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.770+0000 7efc58e00640 1 --2- 172.21.15.70:0/1707983175 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc540ade90 0x7efc5415c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.770+0000 7efc58e00640 1 --2- 172.21.15.70:0/1707983175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc54070170 0x7efc540ad950 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.770+0000 7efc58e00640 1 -- 172.21.15.70:0/1707983175 >> 172.21.15.70:0/1707983175 conn(0x7efc540b0580 msgr2=0x7efc540b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.770+0000 7efc58e00640 1 -- 172.21.15.70:0/1707983175 shutdown_connections 2024-09-13T16:02:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.770+0000 7efc58e00640 1 -- 172.21.15.70:0/1707983175 wait complete. 2024-09-13T16:02:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.772+0000 7efc58e00640 1 Processor -- start 2024-09-13T16:02:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.772+0000 7efc58e00640 1 -- start start 2024-09-13T16:02:16.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.773+0000 7efc58e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc54070170 0x7efc541f1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:16.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.773+0000 7efc58e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc540ade90 0x7efc5415bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:16.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.773+0000 7efc58e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc541566f0 0x7efc54154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.773+0000 7efc58e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5414f7f0 con 0x7efc540ade90 2024-09-13T16:02:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.773+0000 7efc58e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5414ec20 con 0x7efc54070170 2024-09-13T16:02:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.773+0000 7efc58e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5414eec0 con 0x7efc541566f0 2024-09-13T16:02:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.773+0000 7efc51400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc540ade90 0x7efc5415bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.773+0000 7efc51400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc540ade90 0x7efc5415bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45216/0 (socket says 172.21.15.70:45216) 2024-09-13T16:02:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.773+0000 7efc51400640 1 -- 172.21.15.70:0/3684950710 learned_addr learned my addr 172.21.15.70:0/3684950710 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.773+0000 7efc51e00640 1 --2- 172.21.15.70:0/3684950710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc54070170 0x7efc541f1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.773+0000 7efc52800640 1 --2- 172.21.15.70:0/3684950710 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc541566f0 0x7efc54154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.773+0000 7efc51400640 1 -- 172.21.15.70:0/3684950710 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc541566f0 msgr2=0x7efc54154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.773+0000 7efc51400640 1 --2- 172.21.15.70:0/3684950710 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc541566f0 0x7efc54154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.773+0000 7efc51400640 1 -- 172.21.15.70:0/3684950710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc54070170 msgr2=0x7efc541f1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.773+0000 7efc51400640 1 --2- 172.21.15.70:0/3684950710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc54070170 0x7efc541f1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.773+0000 7efc51400640 1 -- 172.21.15.70:0/3684950710 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4000b770 con 0x7efc540ade90 2024-09-13T16:02:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.774+0000 7efc51400640 1 --2- 172.21.15.70:0/3684950710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc540ade90 0x7efc5415bba0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efc4002c960 tx=0x7efc40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.774+0000 7efc4a000640 1 -- 172.21.15.70:0/3684950710 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4003abf0 con 0x7efc540ade90 2024-09-13T16:02:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.774+0000 7efc4a000640 1 -- 172.21.15.70:0/3684950710 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4003f070 con 0x7efc540ade90 2024-09-13T16:02:16.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.774+0000 7efc58e00640 1 -- 172.21.15.70:0/3684950710 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5414f1a0 con 0x7efc540ade90 2024-09-13T16:02:16.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.774+0000 7efc4a000640 1 -- 172.21.15.70:0/3684950710 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40032e90 con 0x7efc540ade90 2024-09-13T16:02:16.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.774+0000 7efc58e00640 1 -- 172.21.15.70:0/3684950710 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc541f20c0 con 0x7efc540ade90 2024-09-13T16:02:16.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.775+0000 7efc58e00640 1 -- 172.21.15.70:0/3684950710 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5414f960 con 0x7efc540ade90 2024-09-13T16:02:16.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.776+0000 7efc4a000640 1 -- 172.21.15.70:0/3684950710 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efc4003b420 con 0x7efc540ade90 2024-09-13T16:02:16.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.777+0000 7efc4a000640 1 --2- 172.21.15.70:0/3684950710 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efc3406ac00 0x7efc3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:16.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.777+0000 7efc4a000640 1 -- 172.21.15.70:0/3684950710 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7efc40041070 con 0x7efc540ade90 2024-09-13T16:02:16.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.777+0000 7efc51e00640 1 --2- 172.21.15.70:0/3684950710 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efc3406ac00 0x7efc3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:16.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.778+0000 7efc51e00640 1 --2- 172.21.15.70:0/3684950710 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efc3406ac00 0x7efc3406d0c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efc44000f60 tx=0x7efc44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:16.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.782+0000 7efc4a000640 1 -- 172.21.15.70:0/3684950710 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efc40075990 con 0x7efc540ade90 2024-09-13T16:02:16.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.984+0000 7efc58e00640 1 -- 172.21.15.70:0/3684950710 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7efc540b34b0 con 0x7efc540ade90 2024-09-13T16:02:16.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:16.993+0000 7efc4a000640 1 -- 172.21.15.70:0/3684950710 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7efc400360c0 con 0x7efc540ade90 2024-09-13T16:02:16.997 INFO:teuthology.orchestra.run.smithi070.stderr:new fs with metadata pool 4 and data pool 5 2024-09-13T16:02:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.000+0000 7efc58e00640 1 -- 172.21.15.70:0/3684950710 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efc3406ac00 msgr2=0x7efc3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.000+0000 7efc58e00640 1 --2- 172.21.15.70:0/3684950710 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efc3406ac00 0x7efc3406d0c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efc44000f60 tx=0x7efc44009040 comp rx=0 tx=0).stop 2024-09-13T16:02:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.000+0000 7efc58e00640 1 -- 172.21.15.70:0/3684950710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc540ade90 msgr2=0x7efc5415bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.000+0000 7efc58e00640 1 --2- 172.21.15.70:0/3684950710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc540ade90 0x7efc5415bba0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efc4002c960 tx=0x7efc40004730 comp rx=0 tx=0).stop 2024-09-13T16:02:17.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.001+0000 7efc58e00640 1 -- 172.21.15.70:0/3684950710 shutdown_connections 2024-09-13T16:02:17.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.001+0000 7efc58e00640 1 --2- 172.21.15.70:0/3684950710 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc541566f0 0x7efc54154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.001+0000 7efc58e00640 1 --2- 172.21.15.70:0/3684950710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc540ade90 0x7efc5415bba0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.001+0000 7efc58e00640 1 --2- 172.21.15.70:0/3684950710 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efc3406ac00 0x7efc3406d0c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.001+0000 7efc58e00640 1 --2- 172.21.15.70:0/3684950710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc54070170 0x7efc541f1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.001+0000 7efc58e00640 1 -- 172.21.15.70:0/3684950710 >> 172.21.15.70:0/3684950710 conn(0x7efc540b0580 msgr2=0x7efc540af690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:17.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.002+0000 7efc58e00640 1 -- 172.21.15.70:0/3684950710 shutdown_connections 2024-09-13T16:02:17.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.003+0000 7efc58e00640 1 -- 172.21.15.70:0/3684950710 wait complete. 2024-09-13T16:02:17.033 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:02:17.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.183+0000 7f28b6200640 1 Processor -- start 2024-09-13T16:02:17.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.183+0000 7f28b6200640 1 -- start start 2024-09-13T16:02:17.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.184+0000 7f28b6200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28b0159480 0x7f28b00ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.184+0000 7f28b6200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f28b006f4b0 0x7f28b0070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.184+0000 7f28b6200640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b00717c0 con 0x7f28b0071390 2024-09-13T16:02:17.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.184+0000 7f28b6200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b00cd850 con 0x7f28b006f4b0 2024-09-13T16:02:17.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.184+0000 7f28b6200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b00cd570 con 0x7f28b0159480 2024-09-13T16:02:17.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.185+0000 7f28a7e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f28b006f4b0 0x7f28b0070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.185+0000 7f28a7e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f28b006f4b0 0x7f28b0070e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45222/0 (socket says 172.21.15.70:45222) 2024-09-13T16:02:17.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.185+0000 7f28b5800640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f28b0071390 0x7f28b015ce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:52032/0 (socket says 172.21.15.70:52032) 2024-09-13T16:02:17.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.185+0000 7f28a7e00640 1 -- 172.21.15.70:0/517292644 learned_addr learned my addr 172.21.15.70:0/517292644 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:17.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.185+0000 7f28b4e00640 1 --2- 172.21.15.70:0/517292644 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28b0159480 0x7f28b00ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.185+0000 7f28a7e00640 1 -- 172.21.15.70:0/517292644 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28b0159480 msgr2=0x7f28b00ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:17.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.185+0000 7f28a7e00640 1 --2- 172.21.15.70:0/517292644 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28b0159480 0x7f28b00ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.185+0000 7f28a7e00640 1 -- 172.21.15.70:0/517292644 >> v1:172.21.15.70:6789/0 conn(0x7f28b0071390 legacy=0x7f28b015ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.185+0000 7f28afe00640 1 -- 172.21.15.70:0/517292644 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2135083952 0 0) 0x7f28b00717c0 con 0x7f28b0071390 2024-09-13T16:02:17.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.185+0000 7f28a7e00640 1 -- 172.21.15.70:0/517292644 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b00b1740 con 0x7f28b006f4b0 2024-09-13T16:02:17.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.186+0000 7f28a7e00640 1 --2- 172.21.15.70:0/517292644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b006f4b0 0x7f28b0070e50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f289800bb10 tx=0x7f289802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a74b0349c0dc83 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:17.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.187+0000 7f28afe00640 1 -- 172.21.15.70:0/517292644 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898032790 con 0x7f28b006f4b0 2024-09-13T16:02:17.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.187+0000 7f28afe00640 1 -- 172.21.15.70:0/517292644 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28980328f0 con 0x7f28b006f4b0 2024-09-13T16:02:17.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.187+0000 7f28afe00640 1 -- 172.21.15.70:0/517292644 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898032c80 con 0x7f28b006f4b0 2024-09-13T16:02:17.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.187+0000 7f28b6200640 1 -- 172.21.15.70:0/517292644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b006f4b0 msgr2=0x7f28b0070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.187+0000 7f28b6200640 1 --2- 172.21.15.70:0/517292644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b006f4b0 0x7f28b0070e50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f289800bb10 tx=0x7f289802c890 comp rx=0 tx=0).stop 2024-09-13T16:02:17.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.187+0000 7f28b6200640 1 -- 172.21.15.70:0/517292644 shutdown_connections 2024-09-13T16:02:17.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.187+0000 7f28b6200640 1 --2- 172.21.15.70:0/517292644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b006f4b0 0x7f28b0070e50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.187+0000 7f28b6200640 1 --2- 172.21.15.70:0/517292644 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28b0159480 0x7f28b00ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.187+0000 7f28b6200640 1 -- 172.21.15.70:0/517292644 >> 172.21.15.70:0/517292644 conn(0x7f28b00ae310 msgr2=0x7f28b00ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:17.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.187+0000 7f28b6200640 1 -- 172.21.15.70:0/517292644 shutdown_connections 2024-09-13T16:02:17.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.187+0000 7f28b6200640 1 -- 172.21.15.70:0/517292644 wait complete. 2024-09-13T16:02:17.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.189+0000 7f28b6200640 1 Processor -- start 2024-09-13T16:02:17.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.189+0000 7f28b6200640 1 -- start start 2024-09-13T16:02:17.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.190+0000 7f28b6200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28b006f4b0 0x7f28b0149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.190+0000 7f28b6200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28b0071390 0x7f28b015af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.190+0000 7f28b6200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b0159480 0x7f28b00cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.190+0000 7f28b6200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b01f23b0 con 0x7f28b0159480 2024-09-13T16:02:17.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.190+0000 7f28b6200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b0156ee0 con 0x7f28b006f4b0 2024-09-13T16:02:17.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.190+0000 7f28b6200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b01571c0 con 0x7f28b0071390 2024-09-13T16:02:17.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.190+0000 7f28b5800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b0159480 0x7f28b00cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.190+0000 7f28b5800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b0159480 0x7f28b00cc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45234/0 (socket says 172.21.15.70:45234) 2024-09-13T16:02:17.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.190+0000 7f28b5800640 1 -- 172.21.15.70:0/3017447934 learned_addr learned my addr 172.21.15.70:0/3017447934 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:17.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.190+0000 7f28b4e00640 1 --2- 172.21.15.70:0/3017447934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28b006f4b0 0x7f28b0149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.190+0000 7f28a7e00640 1 --2- 172.21.15.70:0/3017447934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28b0071390 0x7f28b015af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.191+0000 7f28b5800640 1 -- 172.21.15.70:0/3017447934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28b0071390 msgr2=0x7f28b015af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.191+0000 7f28b5800640 1 --2- 172.21.15.70:0/3017447934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28b0071390 0x7f28b015af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.191+0000 7f28b5800640 1 -- 172.21.15.70:0/3017447934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28b006f4b0 msgr2=0x7f28b0149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.191+0000 7f28b5800640 1 --2- 172.21.15.70:0/3017447934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28b006f4b0 0x7f28b0149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.191+0000 7f28b5800640 1 -- 172.21.15.70:0/3017447934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289800b770 con 0x7f28b0159480 2024-09-13T16:02:17.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.191+0000 7f28b5800640 1 --2- 172.21.15.70:0/3017447934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b0159480 0x7f28b00cc460 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f28a800c7a0 tx=0x7f28a800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:17.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.191+0000 7f28ad600640 1 -- 172.21.15.70:0/3017447934 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a800a640 con 0x7f28b0159480 2024-09-13T16:02:17.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.191+0000 7f28ad600640 1 -- 172.21.15.70:0/3017447934 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a800a7a0 con 0x7f28b0159480 2024-09-13T16:02:17.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.191+0000 7f28b6200640 1 -- 172.21.15.70:0/3017447934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b01574a0 con 0x7f28b0159480 2024-09-13T16:02:17.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.191+0000 7f28ad600640 1 -- 172.21.15.70:0/3017447934 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a800abd0 con 0x7f28b0159480 2024-09-13T16:02:17.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.191+0000 7f28b6200640 1 -- 172.21.15.70:0/3017447934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b015b4a0 con 0x7f28b0159480 2024-09-13T16:02:17.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.192+0000 7f28b6200640 1 -- 172.21.15.70:0/3017447934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b0067360 con 0x7f28b0159480 2024-09-13T16:02:17.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.193+0000 7f28ad600640 1 -- 172.21.15.70:0/3017447934 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f28a800ad30 con 0x7f28b0159480 2024-09-13T16:02:17.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.194+0000 7f28ad600640 1 --2- 172.21.15.70:0/3017447934 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f288c06ac30 0x7f288c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.194+0000 7f28ad600640 1 -- 172.21.15.70:0/3017447934 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28a8088ae0 con 0x7f28b0159480 2024-09-13T16:02:17.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.194+0000 7f28b4e00640 1 --2- 172.21.15.70:0/3017447934 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f288c06ac30 0x7f288c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.195+0000 7f28b4e00640 1 --2- 172.21.15.70:0/3017447934 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f288c06ac30 0x7f288c06d0f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f28b00af480 tx=0x7f28a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:17.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.199+0000 7f28ad600640 1 -- 172.21.15.70:0/3017447934 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f28a8053cd0 con 0x7f28b0159480 2024-09-13T16:02:17.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.367+0000 7f28b6200640 1 -- 172.21.15.70:0/3017447934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28b01f24f0 con 0x7f28b0159480 2024-09-13T16:02:17.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.369+0000 7f28ad600640 1 -- 172.21.15.70:0/3017447934 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16546 (secure 0 0 0) 0x7f28a8018020 con 0x7f28b0159480 2024-09-13T16:02:17.371 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:17.371 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":33,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:02:16.986847+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:02:15.044503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T16:02:15.981176+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:02:17.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.371+0000 7f28b6200640 1 -- 172.21.15.70:0/3017447934 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f288c06ac30 msgr2=0x7f288c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.371+0000 7f28b6200640 1 --2- 172.21.15.70:0/3017447934 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f288c06ac30 0x7f288c06d0f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f28b00af480 tx=0x7f28a0008040 comp rx=0 tx=0).stop 2024-09-13T16:02:17.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.371+0000 7f28b6200640 1 -- 172.21.15.70:0/3017447934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b0159480 msgr2=0x7f28b00cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.371+0000 7f28b6200640 1 --2- 172.21.15.70:0/3017447934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b0159480 0x7f28b00cc460 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f28a800c7a0 tx=0x7f28a800cc60 comp rx=0 tx=0).stop 2024-09-13T16:02:17.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.371+0000 7f28b6200640 1 -- 172.21.15.70:0/3017447934 shutdown_connections 2024-09-13T16:02:17.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.371+0000 7f28b6200640 1 --2- 172.21.15.70:0/3017447934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b0159480 0x7f28b00cc460 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.371+0000 7f28b6200640 1 --2- 172.21.15.70:0/3017447934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28b0071390 0x7f28b015af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.371+0000 7f28b6200640 1 --2- 172.21.15.70:0/3017447934 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f288c06ac30 0x7f288c06d0f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.371+0000 7f28b6200640 1 --2- 172.21.15.70:0/3017447934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28b006f4b0 0x7f28b0149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.371+0000 7f28b6200640 1 -- 172.21.15.70:0/3017447934 >> 172.21.15.70:0/3017447934 conn(0x7f28b00ae310 msgr2=0x7f28b00cb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:17.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.371+0000 7f28b6200640 1 -- 172.21.15.70:0/3017447934 shutdown_connections 2024-09-13T16:02:17.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.371+0000 7f28b6200640 1 -- 172.21.15.70:0/3017447934 wait complete. 2024-09-13T16:02:17.390 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:02:17.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.540+0000 7f36a5a00640 1 Processor -- start 2024-09-13T16:02:17.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.540+0000 7f36a5a00640 1 -- start start 2024-09-13T16:02:17.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.541+0000 7f36a5a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36a0160370 0x7f36a00b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.541+0000 7f36a5a00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a013fbc0 con 0x7f36a00b2e90 2024-09-13T16:02:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.541+0000 7f36a5a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a015ce80 con 0x7f36a00b3a40 2024-09-13T16:02:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.541+0000 7f36a5a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a006cca0 con 0x7f36a0160370 2024-09-13T16:02:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.541+0000 7f369f400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f36a00b2e90 0x7f36a00ac870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:52042/0 (socket says 172.21.15.70:52042) 2024-09-13T16:02:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.541+0000 7f369f400640 1 -- 172.21.15.70:0/1791600195 learned_addr learned my addr 172.21.15.70:0/1791600195 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.542+0000 7f369e000640 1 --2- 172.21.15.70:0/1791600195 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36a0160370 0x7f36a00b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.542+0000 7f369d600640 1 -- 172.21.15.70:0/1791600195 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713100405 0 0) 0x7f36a013fbc0 con 0x7f36a00b2e90 2024-09-13T16:02:17.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.542+0000 7f369d600640 1 -- 172.21.15.70:0/1791600195 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3684003520 con 0x7f36a00b2e90 2024-09-13T16:02:17.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.542+0000 7f369d600640 1 -- 172.21.15.70:0/1791600195 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 896177613 0 0) 0x7f36a015ce80 con 0x7f36a00b3a40 2024-09-13T16:02:17.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.542+0000 7f369d600640 1 -- 172.21.15.70:0/1791600195 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36a013fbc0 con 0x7f36a00b3a40 2024-09-13T16:02:17.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.542+0000 7f369e000640 1 -- 172.21.15.70:0/1791600195 >> v1:172.21.15.107:6789/0 conn(0x7f36a00b3a40 legacy=0x7f36a01428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.542+0000 7f369e000640 1 -- 172.21.15.70:0/1791600195 >> v1:172.21.15.70:6789/0 conn(0x7f36a00b2e90 legacy=0x7f36a00ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.542+0000 7f369e000640 1 -- 172.21.15.70:0/1791600195 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a0160910 con 0x7f36a0160370 2024-09-13T16:02:17.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.543+0000 7f369e000640 1 --2- 172.21.15.70:0/1791600195 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36a0160370 0x7f36a00b2950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f368c0097d0 tx=0x7f368c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4a46c6fbb0d87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:17.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.543+0000 7f369d600640 1 -- 172.21.15.70:0/1791600195 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c032440 con 0x7f36a0160370 2024-09-13T16:02:17.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.543+0000 7f369d600640 1 -- 172.21.15.70:0/1791600195 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368c0325a0 con 0x7f36a0160370 2024-09-13T16:02:17.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.543+0000 7f369d600640 1 -- 172.21.15.70:0/1791600195 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c032930 con 0x7f36a0160370 2024-09-13T16:02:17.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.544+0000 7f36a5a00640 1 -- 172.21.15.70:0/1791600195 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36a0160370 msgr2=0x7f36a00b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.544+0000 7f36a5a00640 1 --2- 172.21.15.70:0/1791600195 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36a0160370 0x7f36a00b2950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f368c0097d0 tx=0x7f368c02a180 comp rx=0 tx=0).stop 2024-09-13T16:02:17.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.544+0000 7f36a5a00640 1 -- 172.21.15.70:0/1791600195 shutdown_connections 2024-09-13T16:02:17.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.544+0000 7f36a5a00640 1 --2- 172.21.15.70:0/1791600195 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36a0160370 0x7f36a00b2950 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.544+0000 7f36a5a00640 1 -- 172.21.15.70:0/1791600195 >> 172.21.15.70:0/1791600195 conn(0x7f36a00b0510 msgr2=0x7f36a00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:17.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.544+0000 7f36a5a00640 1 -- 172.21.15.70:0/1791600195 shutdown_connections 2024-09-13T16:02:17.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.544+0000 7f36a5a00640 1 -- 172.21.15.70:0/1791600195 wait complete. 2024-09-13T16:02:17.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.546+0000 7f36a5a00640 1 Processor -- start 2024-09-13T16:02:17.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.546+0000 7f36a5a00640 1 -- start start 2024-09-13T16:02:17.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.547+0000 7f36a5a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36a00b2e90 0x7f36a0155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.547+0000 7f36a5a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36a00b3a40 0x7f36a0144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.547+0000 7f36a5a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36a0160370 0x7f36a0134fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.547+0000 7f36a5a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a0155540 con 0x7f36a00b2e90 2024-09-13T16:02:17.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.547+0000 7f36a5a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a0144ab0 con 0x7f36a0160370 2024-09-13T16:02:17.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.547+0000 7f36a5a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a0144d10 con 0x7f36a00b3a40 2024-09-13T16:02:17.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.547+0000 7f369ea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36a00b2e90 0x7f36a0155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.547+0000 7f369ea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36a00b2e90 0x7f36a0155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45246/0 (socket says 172.21.15.70:45246) 2024-09-13T16:02:17.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.547+0000 7f369ea00640 1 -- 172.21.15.70:0/2263506668 learned_addr learned my addr 172.21.15.70:0/2263506668 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:17.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.547+0000 7f369f400640 1 --2- 172.21.15.70:0/2263506668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36a0160370 0x7f36a0134fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.547+0000 7f369e000640 1 --2- 172.21.15.70:0/2263506668 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36a00b3a40 0x7f36a0144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.547+0000 7f369ea00640 1 -- 172.21.15.70:0/2263506668 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36a00b3a40 msgr2=0x7f36a0144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.547+0000 7f369ea00640 1 --2- 172.21.15.70:0/2263506668 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36a00b3a40 0x7f36a0144570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.547+0000 7f369ea00640 1 -- 172.21.15.70:0/2263506668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36a0160370 msgr2=0x7f36a0134fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.547+0000 7f369ea00640 1 --2- 172.21.15.70:0/2263506668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36a0160370 0x7f36a0134fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.547+0000 7f369ea00640 1 -- 172.21.15.70:0/2263506668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c009400 con 0x7f36a00b2e90 2024-09-13T16:02:17.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.547+0000 7f369ea00640 1 --2- 172.21.15.70:0/2263506668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36a00b2e90 0x7f36a0155000 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f369000c490 tx=0x7f369000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:17.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.548+0000 7f3696a00640 1 -- 172.21.15.70:0/2263506668 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36900052d0 con 0x7f36a00b2e90 2024-09-13T16:02:17.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.548+0000 7f3696a00640 1 -- 172.21.15.70:0/2263506668 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3690005430 con 0x7f36a00b2e90 2024-09-13T16:02:17.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.548+0000 7f3696a00640 1 -- 172.21.15.70:0/2263506668 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690012870 con 0x7f36a00b2e90 2024-09-13T16:02:17.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.548+0000 7f36a5a00640 1 -- 172.21.15.70:0/2263506668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a0144ff0 con 0x7f36a00b2e90 2024-09-13T16:02:17.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.548+0000 7f36a5a00640 1 -- 172.21.15.70:0/2263506668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a01455b0 con 0x7f36a00b2e90 2024-09-13T16:02:17.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.549+0000 7f36a5a00640 1 -- 172.21.15.70:0/2263506668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a00b0990 con 0x7f36a00b2e90 2024-09-13T16:02:17.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.550+0000 7f3696a00640 1 -- 172.21.15.70:0/2263506668 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f36900129d0 con 0x7f36a00b2e90 2024-09-13T16:02:17.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.551+0000 7f3696a00640 1 --2- 172.21.15.70:0/2263506668 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f368006ac30 0x7f368006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.551+0000 7f3696a00640 1 -- 172.21.15.70:0/2263506668 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3690088e90 con 0x7f36a00b2e90 2024-09-13T16:02:17.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.551+0000 7f369e000640 1 --2- 172.21.15.70:0/2263506668 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f368006ac30 0x7f368006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.551+0000 7f369e000640 1 --2- 172.21.15.70:0/2263506668 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f368006ac30 0x7f368006d0f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f368c034000 tx=0x7f368c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:17.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.555+0000 7f3696a00640 1 -- 172.21.15.70:0/2263506668 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3690054100 con 0x7f36a00b2e90 2024-09-13T16:02:17.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.726+0000 7f36a5a00640 1 -- 172.21.15.70:0/2263506668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36a00b2950 con 0x7f36a00b2e90 2024-09-13T16:02:17.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.727+0000 7f3696a00640 1 -- 172.21.15.70:0/2263506668 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16546 (secure 0 0 0) 0x7f3690057720 con 0x7f36a00b2e90 2024-09-13T16:02:17.730 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:17.730 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":33,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:02:16.986847+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:02:15.044503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T16:02:15.981176+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:02:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.729+0000 7f36a5a00640 1 -- 172.21.15.70:0/2263506668 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f368006ac30 msgr2=0x7f368006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.729+0000 7f36a5a00640 1 --2- 172.21.15.70:0/2263506668 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f368006ac30 0x7f368006d0f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f368c034000 tx=0x7f368c02e000 comp rx=0 tx=0).stop 2024-09-13T16:02:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.729+0000 7f36a5a00640 1 -- 172.21.15.70:0/2263506668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36a00b2e90 msgr2=0x7f36a0155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.729+0000 7f36a5a00640 1 --2- 172.21.15.70:0/2263506668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36a00b2e90 0x7f36a0155000 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f369000c490 tx=0x7f369000c950 comp rx=0 tx=0).stop 2024-09-13T16:02:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.729+0000 7f36a5a00640 1 -- 172.21.15.70:0/2263506668 shutdown_connections 2024-09-13T16:02:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.729+0000 7f36a5a00640 1 --2- 172.21.15.70:0/2263506668 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f368006ac30 0x7f368006d0f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.729+0000 7f36a5a00640 1 --2- 172.21.15.70:0/2263506668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36a0160370 0x7f36a0134fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.729+0000 7f36a5a00640 1 --2- 172.21.15.70:0/2263506668 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36a00b3a40 0x7f36a0144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.729+0000 7f36a5a00640 1 --2- 172.21.15.70:0/2263506668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36a00b2e90 0x7f36a0155000 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.729+0000 7f36a5a00640 1 -- 172.21.15.70:0/2263506668 >> 172.21.15.70:0/2263506668 conn(0x7f36a00b0510 msgr2=0x7f36a0069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.730+0000 7f36a5a00640 1 -- 172.21.15.70:0/2263506668 shutdown_connections 2024-09-13T16:02:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.730+0000 7f36a5a00640 1 -- 172.21.15.70:0/2263506668 wait complete. 2024-09-13T16:02:17.747 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T16:02:17.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.902+0000 7f32e7400640 1 Processor -- start 2024-09-13T16:02:17.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.902+0000 7f32e7400640 1 -- start start 2024-09-13T16:02:17.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.903+0000 7f32e7400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e0071690 0x7f32e015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.903+0000 7f32e7400640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e006f5f0 con 0x7f32e00cafa0 2024-09-13T16:02:17.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.903+0000 7f32e7400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e0070450 con 0x7f32e0156f60 2024-09-13T16:02:17.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.903+0000 7f32e7400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e015aa30 con 0x7f32e0071690 2024-09-13T16:02:17.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.903+0000 7f32e5400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f32e00cafa0 0x7f32e00cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:52058/0 (socket says 172.21.15.70:52058) 2024-09-13T16:02:17.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.903+0000 7f32e5400640 1 -- 172.21.15.70:0/2715492796 learned_addr learned my addr 172.21.15.70:0/2715492796 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:17.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.904+0000 7f32dfe00640 1 --2- 172.21.15.70:0/2715492796 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e0071690 0x7f32e015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.904+0000 7f32df400640 1 -- 172.21.15.70:0/2715492796 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031132085 0 0) 0x7f32e006f5f0 con 0x7f32e00cafa0 2024-09-13T16:02:17.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.904+0000 7f32df400640 1 -- 172.21.15.70:0/2715492796 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32c8003520 con 0x7f32e00cafa0 2024-09-13T16:02:17.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.904+0000 7f32df400640 1 -- 172.21.15.70:0/2715492796 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402384906 0 0) 0x7f32e0070450 con 0x7f32e0156f60 2024-09-13T16:02:17.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.904+0000 7f32df400640 1 -- 172.21.15.70:0/2715492796 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32e006f5f0 con 0x7f32e0156f60 2024-09-13T16:02:17.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.904+0000 7f32dfe00640 1 -- 172.21.15.70:0/2715492796 >> v1:172.21.15.107:6789/0 conn(0x7f32e0156f60 legacy=0x7f32e0070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.904+0000 7f32dfe00640 1 -- 172.21.15.70:0/2715492796 >> v1:172.21.15.70:6789/0 conn(0x7f32e00cafa0 legacy=0x7f32e00cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.904+0000 7f32dfe00640 1 -- 172.21.15.70:0/2715492796 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e006f840 con 0x7f32e0071690 2024-09-13T16:02:17.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.905+0000 7f32dfe00640 1 --2- 172.21.15.70:0/2715492796 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e0071690 0x7f32e015a4f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f32cc0097d0 tx=0x7f32cc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da1e48348bb6680 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:17.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.905+0000 7f32df400640 1 -- 172.21.15.70:0/2715492796 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc032440 con 0x7f32e0071690 2024-09-13T16:02:17.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.905+0000 7f32df400640 1 -- 172.21.15.70:0/2715492796 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32cc0325a0 con 0x7f32e0071690 2024-09-13T16:02:17.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.906+0000 7f32df400640 1 -- 172.21.15.70:0/2715492796 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc032930 con 0x7f32e0071690 2024-09-13T16:02:17.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.906+0000 7f32e7400640 1 -- 172.21.15.70:0/2715492796 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e0071690 msgr2=0x7f32e015a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.906+0000 7f32e7400640 1 --2- 172.21.15.70:0/2715492796 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e0071690 0x7f32e015a4f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f32cc0097d0 tx=0x7f32cc02a210 comp rx=0 tx=0).stop 2024-09-13T16:02:17.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.906+0000 7f32e7400640 1 -- 172.21.15.70:0/2715492796 shutdown_connections 2024-09-13T16:02:17.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.906+0000 7f32e7400640 1 --2- 172.21.15.70:0/2715492796 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e0071690 0x7f32e015a4f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.906+0000 7f32e7400640 1 -- 172.21.15.70:0/2715492796 >> 172.21.15.70:0/2715492796 conn(0x7f32e00b0580 msgr2=0x7f32e00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:17.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.906+0000 7f32e7400640 1 -- 172.21.15.70:0/2715492796 shutdown_connections 2024-09-13T16:02:17.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.906+0000 7f32e7400640 1 -- 172.21.15.70:0/2715492796 wait complete. 2024-09-13T16:02:17.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.908+0000 7f32e7400640 1 Processor -- start 2024-09-13T16:02:17.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.908+0000 7f32e7400640 1 -- start start 2024-09-13T16:02:17.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.909+0000 7f32e7400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32e0071690 0x7f32e014f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.909+0000 7f32e7400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e00cafa0 0x7f32e01513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.909+0000 7f32e7400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32e0156f60 0x7f32e0151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.909+0000 7f32e7400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e015af60 con 0x7f32e0156f60 2024-09-13T16:02:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.909+0000 7f32e7400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e0150710 con 0x7f32e0071690 2024-09-13T16:02:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.909+0000 7f32e7400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e01509f0 con 0x7f32e00cafa0 2024-09-13T16:02:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.909+0000 7f32e5400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32e0156f60 0x7f32e0151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.909+0000 7f32e5400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32e0156f60 0x7f32e0151930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45252/0 (socket says 172.21.15.70:45252) 2024-09-13T16:02:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.909+0000 7f32e5400640 1 -- 172.21.15.70:0/3711309368 learned_addr learned my addr 172.21.15.70:0/3711309368 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.909+0000 7f32e4a00640 1 --2- 172.21.15.70:0/3711309368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32e0071690 0x7f32e014f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.909+0000 7f32dfe00640 1 --2- 172.21.15.70:0/3711309368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e00cafa0 0x7f32e01513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.909+0000 7f32e5400640 1 -- 172.21.15.70:0/3711309368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e00cafa0 msgr2=0x7f32e01513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.909+0000 7f32e5400640 1 --2- 172.21.15.70:0/3711309368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e00cafa0 0x7f32e01513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.909+0000 7f32e5400640 1 -- 172.21.15.70:0/3711309368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32e0071690 msgr2=0x7f32e014f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.909+0000 7f32e5400640 1 --2- 172.21.15.70:0/3711309368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32e0071690 0x7f32e014f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.909+0000 7f32e5400640 1 -- 172.21.15.70:0/3711309368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc009400 con 0x7f32e0156f60 2024-09-13T16:02:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.909+0000 7f32e4a00640 1 --2- 172.21.15.70:0/3711309368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32e0071690 0x7f32e014f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.910+0000 7f32e5400640 1 --2- 172.21.15.70:0/3711309368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32e0156f60 0x7f32e0151930 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f32d800cb70 tx=0x7f32d800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:17.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.910+0000 7f32dcc00640 1 -- 172.21.15.70:0/3711309368 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d800ace0 con 0x7f32e0156f60 2024-09-13T16:02:17.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.910+0000 7f32dcc00640 1 -- 172.21.15.70:0/3711309368 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d800ae40 con 0x7f32e0156f60 2024-09-13T16:02:17.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.910+0000 7f32dcc00640 1 -- 172.21.15.70:0/3711309368 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d8012620 con 0x7f32e0156f60 2024-09-13T16:02:17.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.910+0000 7f32e7400640 1 -- 172.21.15.70:0/3711309368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e0150cd0 con 0x7f32e0156f60 2024-09-13T16:02:17.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.910+0000 7f32e7400640 1 -- 172.21.15.70:0/3711309368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e014f9e0 con 0x7f32e0156f60 2024-09-13T16:02:17.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.911+0000 7f32e7400640 1 -- 172.21.15.70:0/3711309368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e0157340 con 0x7f32e0156f60 2024-09-13T16:02:17.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.912+0000 7f32dcc00640 1 -- 172.21.15.70:0/3711309368 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f32d8007070 con 0x7f32e0156f60 2024-09-13T16:02:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.913+0000 7f32dcc00640 1 --2- 172.21.15.70:0/3711309368 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f32c006ac00 0x7f32c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.913+0000 7f32dcc00640 1 -- 172.21.15.70:0/3711309368 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32d80892f0 con 0x7f32e0156f60 2024-09-13T16:02:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.913+0000 7f32e4a00640 1 --2- 172.21.15.70:0/3711309368 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f32c006ac00 0x7f32c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.914+0000 7f32e4a00640 1 --2- 172.21.15.70:0/3711309368 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f32c006ac00 0x7f32c006d0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f32d40011e0 tx=0x7f32d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:17.917+0000 7f32dcc00640 1 -- 172.21.15.70:0/3711309368 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f32d8058000 con 0x7f32e0156f60 2024-09-13T16:02:18.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:18.126+0000 7f32e7400640 1 -- 172.21.15.70:0/3711309368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f32e00cd100 con 0x7f32e0156f60 2024-09-13T16:02:19.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.008+0000 7f32dcc00640 1 -- 172.21.15.70:0/3711309368 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f32d8057b90 con 0x7f32e0156f60 2024-09-13T16:02:19.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.010+0000 7f32e7400640 1 -- 172.21.15.70:0/3711309368 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f32c006ac00 msgr2=0x7f32c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:19.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.010+0000 7f32e7400640 1 --2- 172.21.15.70:0/3711309368 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f32c006ac00 0x7f32c006d0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f32d40011e0 tx=0x7f32d4009040 comp rx=0 tx=0).stop 2024-09-13T16:02:19.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.010+0000 7f32e7400640 1 -- 172.21.15.70:0/3711309368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32e0156f60 msgr2=0x7f32e0151930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:19.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.010+0000 7f32e7400640 1 --2- 172.21.15.70:0/3711309368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32e0156f60 0x7f32e0151930 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f32d800cb70 tx=0x7f32d800a430 comp rx=0 tx=0).stop 2024-09-13T16:02:19.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.010+0000 7f32e7400640 1 -- 172.21.15.70:0/3711309368 shutdown_connections 2024-09-13T16:02:19.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.010+0000 7f32e7400640 1 --2- 172.21.15.70:0/3711309368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32e0156f60 0x7f32e0151930 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:19.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.010+0000 7f32e7400640 1 --2- 172.21.15.70:0/3711309368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e00cafa0 0x7f32e01513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:19.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.010+0000 7f32e7400640 1 --2- 172.21.15.70:0/3711309368 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f32c006ac00 0x7f32c006d0c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:19.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.010+0000 7f32e7400640 1 --2- 172.21.15.70:0/3711309368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32e0071690 0x7f32e014f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:19.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.010+0000 7f32e7400640 1 -- 172.21.15.70:0/3711309368 >> 172.21.15.70:0/3711309368 conn(0x7f32e00b0580 msgr2=0x7f32e00ae8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:19.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.010+0000 7f32e7400640 1 -- 172.21.15.70:0/3711309368 shutdown_connections 2024-09-13T16:02:19.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.010+0000 7f32e7400640 1 -- 172.21.15.70:0/3711309368 wait complete. 2024-09-13T16:02:19.029 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T16:02:19.030 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T16:02:19.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.184+0000 7fb755e00640 1 Processor -- start 2024-09-13T16:02:19.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.184+0000 7fb755e00640 1 -- start start 2024-09-13T16:02:19.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.186+0000 7fb755e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb750156f60 0x7fb75015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:19.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.186+0000 7fb755e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb750071690 0x7fb7500cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:19.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.186+0000 7fb755e00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75006f5f0 con 0x7fb7500cafa0 2024-09-13T16:02:19.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.186+0000 7fb755e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75015aa30 con 0x7fb750156f60 2024-09-13T16:02:19.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.186+0000 7fb755e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb750070450 con 0x7fb750071690 2024-09-13T16:02:19.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.186+0000 7fb74e000640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb7500cafa0 0x7fb750070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:52066/0 (socket says 172.21.15.70:52066) 2024-09-13T16:02:19.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.186+0000 7fb74e000640 1 -- 172.21.15.70:0/3022019237 learned_addr learned my addr 172.21.15.70:0/3022019237 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:19.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.186+0000 7fb74ea00640 1 --2- 172.21.15.70:0/3022019237 >> v2:172.21.15.107:3300/0 conn(0x7fb750156f60 0x7fb75015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:19.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.186+0000 7fb74f400640 1 --2- 172.21.15.70:0/3022019237 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb750071690 0x7fb7500cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:19.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.186+0000 7fb74d600640 1 -- 172.21.15.70:0/3022019237 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609240240 0 0) 0x7fb75006f5f0 con 0x7fb7500cafa0 2024-09-13T16:02:19.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.187+0000 7fb74d600640 1 -- 172.21.15.70:0/3022019237 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb734005730 con 0x7fb7500cafa0 2024-09-13T16:02:19.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.187+0000 7fb74d600640 1 -- 172.21.15.70:0/3022019237 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 469646893 0 0) 0x7fb734005730 con 0x7fb7500cafa0 2024-09-13T16:02:19.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.187+0000 7fb74d600640 1 -- 172.21.15.70:0/3022019237 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb750071690 msgr2=0x7fb7500cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:19.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.187+0000 7fb74d600640 1 --2- 172.21.15.70:0/3022019237 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb750071690 0x7fb7500cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:19.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.187+0000 7fb74d600640 1 -- 172.21.15.70:0/3022019237 >> v2:172.21.15.107:3300/0 conn(0x7fb750156f60 msgr2=0x7fb75015a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:19.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.187+0000 7fb74d600640 1 --2- 172.21.15.70:0/3022019237 >> v2:172.21.15.107:3300/0 conn(0x7fb750156f60 0x7fb75015a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:19.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.187+0000 7fb74d600640 1 -- 172.21.15.70:0/3022019237 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75006f840 con 0x7fb7500cafa0 2024-09-13T16:02:19.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.187+0000 7fb74d600640 1 -- 172.21.15.70:0/3022019237 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7fb73c001670 con 0x7fb7500cafa0 2024-09-13T16:02:19.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.187+0000 7fb74ea00640 1 --2- 172.21.15.70:0/3022019237 >> v2:172.21.15.107:3300/0 conn(0x7fb750156f60 0x7fb75015a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:19.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.187+0000 7fb74d600640 1 -- 172.21.15.70:0/3022019237 >> v1:172.21.15.70:6789/0 conn(0x7fb7500cafa0 legacy=0x7fb750070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:19.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.187+0000 7fb74d600640 1 --2- 172.21.15.70:0/3022019237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb734005b80 0x7fb734005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:19.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.187+0000 7fb74d600640 1 --2- 172.21.15.70:0/3022019237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7340069d0 0x7fb734006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:19.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.187+0000 7fb74d600640 1 --2- 172.21.15.70:0/3022019237 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb750071690 0x7fb734007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:19.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.187+0000 7fb74d600640 1 -- 172.21.15.70:0/3022019237 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75015aa30 con 0x7fb7340069d0 2024-09-13T16:02:19.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.187+0000 7fb74d600640 1 -- 172.21.15.70:0/3022019237 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb750070450 con 0x7fb734005b80 2024-09-13T16:02:19.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.187+0000 7fb74d600640 1 -- 172.21.15.70:0/3022019237 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73400db90 con 0x7fb750071690 2024-09-13T16:02:19.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.187+0000 7fb74e000640 1 --2- 172.21.15.70:0/3022019237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7340069d0 0x7fb734006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:19.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.188+0000 7fb74e000640 1 -- 172.21.15.70:0/3022019237 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb750071690 msgr2=0x7fb734007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:19.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.188+0000 7fb74ea00640 1 --2- 172.21.15.70:0/3022019237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb734005b80 0x7fb734005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:19.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.188+0000 7fb74f400640 1 --2- 172.21.15.70:0/3022019237 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb750071690 0x7fb734007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:19.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.188+0000 7fb74e000640 1 --2- 172.21.15.70:0/3022019237 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb750071690 0x7fb734007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:19.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.188+0000 7fb74e000640 1 -- 172.21.15.70:0/3022019237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb734005b80 msgr2=0x7fb734005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:19.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.188+0000 7fb74e000640 1 --2- 172.21.15.70:0/3022019237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb734005b80 0x7fb734005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:19.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.188+0000 7fb74e000640 1 -- 172.21.15.70:0/3022019237 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb734005730 con 0x7fb7340069d0 2024-09-13T16:02:19.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.188+0000 7fb74ea00640 1 --2- 172.21.15.70:0/3022019237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb734005b80 0x7fb734005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:19.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.188+0000 7fb74f400640 1 --2- 172.21.15.70:0/3022019237 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb750071690 0x7fb734007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:19.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.189+0000 7fb74e000640 1 --2- 172.21.15.70:0/3022019237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7340069d0 0x7fb734006e50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00c240 tx=0x7fb734007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14d03f6294dd0c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:19.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.189+0000 7fb74d600640 1 -- 172.21.15.70:0/3022019237 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c005ad0 con 0x7fb7340069d0 2024-09-13T16:02:19.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.189+0000 7fb74d600640 1 -- 172.21.15.70:0/3022019237 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c005c30 con 0x7fb7340069d0 2024-09-13T16:02:19.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.189+0000 7fb74d600640 1 -- 172.21.15.70:0/3022019237 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c007070 con 0x7fb7340069d0 2024-09-13T16:02:19.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.189+0000 7fb755e00640 1 -- 172.21.15.70:0/3022019237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7340069d0 msgr2=0x7fb734006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:19.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.189+0000 7fb755e00640 1 --2- 172.21.15.70:0/3022019237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7340069d0 0x7fb734006e50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00c240 tx=0x7fb734007a00 comp rx=0 tx=0).stop 2024-09-13T16:02:19.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.189+0000 7fb74f400640 1 -- 172.21.15.70:0/3022019237 reap_dead start 2024-09-13T16:02:19.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.190+0000 7fb755e00640 1 -- 172.21.15.70:0/3022019237 shutdown_connections 2024-09-13T16:02:19.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.190+0000 7fb755e00640 1 -- 172.21.15.70:0/3022019237 >> 172.21.15.70:0/3022019237 conn(0x7fb7500b0580 msgr2=0x7fb7500b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:19.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.190+0000 7fb755e00640 1 -- 172.21.15.70:0/3022019237 shutdown_connections 2024-09-13T16:02:19.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.190+0000 7fb755e00640 1 -- 172.21.15.70:0/3022019237 wait complete. 2024-09-13T16:02:19.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.191+0000 7fb755e00640 1 Processor -- start 2024-09-13T16:02:19.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.191+0000 7fb755e00640 1 -- start start 2024-09-13T16:02:19.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.192+0000 7fb755e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7340069d0 0x7fb750142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:19.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.192+0000 7fb755e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb750155c90 0x7fb750143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:19.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.192+0000 7fb755e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb750143560 0x7fb750150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:19.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.192+0000 7fb755e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb750154f80 con 0x7fb750155c90 2024-09-13T16:02:19.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.192+0000 7fb755e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7500ad810 con 0x7fb750143560 2024-09-13T16:02:19.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.192+0000 7fb755e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb750142d50 con 0x7fb7340069d0 2024-09-13T16:02:19.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.192+0000 7fb74e000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb750155c90 0x7fb750143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:19.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.193+0000 7fb74e000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb750155c90 0x7fb750143020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45268/0 (socket says 172.21.15.70:45268) 2024-09-13T16:02:19.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.193+0000 7fb74e000640 1 -- 172.21.15.70:0/2069607786 learned_addr learned my addr 172.21.15.70:0/2069607786 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:19.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.193+0000 7fb74ea00640 1 --2- 172.21.15.70:0/2069607786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7340069d0 0x7fb750142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:19.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.193+0000 7fb74f400640 1 --2- 172.21.15.70:0/2069607786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb750143560 0x7fb750150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:19.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.193+0000 7fb74e000640 1 -- 172.21.15.70:0/2069607786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7340069d0 msgr2=0x7fb750142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:19.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.193+0000 7fb74e000640 1 --2- 172.21.15.70:0/2069607786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7340069d0 0x7fb750142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:19.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.193+0000 7fb74e000640 1 -- 172.21.15.70:0/2069607786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb750143560 msgr2=0x7fb750150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:19.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.193+0000 7fb74e000640 1 --2- 172.21.15.70:0/2069607786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb750143560 0x7fb750150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:19.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.193+0000 7fb74e000640 1 -- 172.21.15.70:0/2069607786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7501439f0 con 0x7fb750155c90 2024-09-13T16:02:19.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.193+0000 7fb74e000640 1 --2- 172.21.15.70:0/2069607786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb750155c90 0x7fb750143020 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb73c034040 tx=0x7fb73c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:19.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.194+0000 7fb747400640 1 -- 172.21.15.70:0/2069607786 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c007480 con 0x7fb750155c90 2024-09-13T16:02:19.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.194+0000 7fb747400640 1 -- 172.21.15.70:0/2069607786 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c0075e0 con 0x7fb750155c90 2024-09-13T16:02:19.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.194+0000 7fb747400640 1 -- 172.21.15.70:0/2069607786 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c03e670 con 0x7fb750155c90 2024-09-13T16:02:19.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.194+0000 7fb755e00640 1 -- 172.21.15.70:0/2069607786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7500ad530 con 0x7fb750155c90 2024-09-13T16:02:19.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.194+0000 7fb755e00640 1 -- 172.21.15.70:0/2069607786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb750155490 con 0x7fb750155c90 2024-09-13T16:02:19.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.195+0000 7fb755e00640 1 -- 172.21.15.70:0/2069607786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb750157340 con 0x7fb750155c90 2024-09-13T16:02:19.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.196+0000 7fb747400640 1 -- 172.21.15.70:0/2069607786 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb73c03e7d0 con 0x7fb750155c90 2024-09-13T16:02:19.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.197+0000 7fb747400640 1 --2- 172.21.15.70:0/2069607786 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb73006ac00 0x7fb73006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:19.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.197+0000 7fb747400640 1 -- 172.21.15.70:0/2069607786 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb73c0aa530 con 0x7fb750155c90 2024-09-13T16:02:19.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.197+0000 7fb74ea00640 1 --2- 172.21.15.70:0/2069607786 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb73006ac00 0x7fb73006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:19.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.197+0000 7fb74ea00640 1 --2- 172.21.15.70:0/2069607786 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb73006ac00 0x7fb73006d0c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb740003e20 tx=0x7fb74000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:19.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.201+0000 7fb747400640 1 -- 172.21.15.70:0/2069607786 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb73c0757b0 con 0x7fb750155c90 2024-09-13T16:02:19.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:19.403+0000 7fb755e00640 1 -- 172.21.15.70:0/2069607786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb7500cd240 con 0x7fb750155c90 2024-09-13T16:02:20.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.010+0000 7fb747400640 1 -- 172.21.15.70:0/2069607786 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb73c078dd0 con 0x7fb750155c90 2024-09-13T16:02:20.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.013+0000 7fb755e00640 1 -- 172.21.15.70:0/2069607786 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb73006ac00 msgr2=0x7fb73006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:20.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.013+0000 7fb755e00640 1 --2- 172.21.15.70:0/2069607786 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb73006ac00 0x7fb73006d0c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb740003e20 tx=0x7fb74000b040 comp rx=0 tx=0).stop 2024-09-13T16:02:20.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.013+0000 7fb755e00640 1 -- 172.21.15.70:0/2069607786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb750155c90 msgr2=0x7fb750143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:20.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.013+0000 7fb755e00640 1 --2- 172.21.15.70:0/2069607786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb750155c90 0x7fb750143020 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb73c034040 tx=0x7fb73c001a00 comp rx=0 tx=0).stop 2024-09-13T16:02:20.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.013+0000 7fb755e00640 1 -- 172.21.15.70:0/2069607786 shutdown_connections 2024-09-13T16:02:20.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.013+0000 7fb755e00640 1 --2- 172.21.15.70:0/2069607786 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb73006ac00 0x7fb73006d0c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.013+0000 7fb755e00640 1 --2- 172.21.15.70:0/2069607786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb750143560 0x7fb750150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.013+0000 7fb755e00640 1 --2- 172.21.15.70:0/2069607786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb750155c90 0x7fb750143020 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.013+0000 7fb755e00640 1 --2- 172.21.15.70:0/2069607786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7340069d0 0x7fb750142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.013+0000 7fb755e00640 1 -- 172.21.15.70:0/2069607786 >> 172.21.15.70:0/2069607786 conn(0x7fb7500b0580 msgr2=0x7fb7500af510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:20.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.013+0000 7fb755e00640 1 -- 172.21.15.70:0/2069607786 shutdown_connections 2024-09-13T16:02:20.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.013+0000 7fb755e00640 1 -- 172.21.15.70:0/2069607786 wait complete. 2024-09-13T16:02:20.033 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T16:02:20.033 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:02:20.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.186+0000 7f14a0200640 1 Processor -- start 2024-09-13T16:02:20.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.186+0000 7f14a0200640 1 -- start start 2024-09-13T16:02:20.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.187+0000 7f14a0200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f149815a520 0x7f149806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:20.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.187+0000 7f14a0200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f14980b1b00 0x7f14980cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:20.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.187+0000 7f14a0200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149806bc00 con 0x7f14980cde50 2024-09-13T16:02:20.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.187+0000 7f14a0200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149806bea0 con 0x7f14980b1b00 2024-09-13T16:02:20.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.187+0000 7f14a0200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149806c180 con 0x7f149815a520 2024-09-13T16:02:20.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.188+0000 7f149d800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f149815a520 0x7f149806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:20.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.188+0000 7f149e200640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f14980cde50 0x7f14980b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:42060/0 (socket says 172.21.15.70:42060) 2024-09-13T16:02:20.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.188+0000 7f149e200640 1 -- 172.21.15.70:0/2513520113 learned_addr learned my addr 172.21.15.70:0/2513520113 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:20.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.188+0000 7f149ce00640 1 --2- 172.21.15.70:0/2513520113 >> v2:172.21.15.107:3300/0 conn(0x7f14980b1b00 0x7f14980cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:20.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.188+0000 7f1497e00640 1 -- 172.21.15.70:0/2513520113 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265578024 0 0) 0x7f149806bc00 con 0x7f14980cde50 2024-09-13T16:02:20.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.188+0000 7f1497e00640 1 -- 172.21.15.70:0/2513520113 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1480003520 con 0x7f14980cde50 2024-09-13T16:02:20.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.188+0000 7f149ce00640 1 -- 172.21.15.70:0/2513520113 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f149815a520 msgr2=0x7f149806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:20.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.188+0000 7f149ce00640 1 --2- 172.21.15.70:0/2513520113 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f149815a520 0x7f149806b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.188+0000 7f149ce00640 1 -- 172.21.15.70:0/2513520113 >> v1:172.21.15.107:6789/0 conn(0x7f14980cde50 legacy=0x7f14980b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:20.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.188+0000 7f149ce00640 1 -- 172.21.15.70:0/2513520113 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149806c460 con 0x7f14980b1b00 2024-09-13T16:02:20.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.188+0000 7f149d800640 1 --2- 172.21.15.70:0/2513520113 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f149815a520 0x7f149806b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:20.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.189+0000 7f149ce00640 1 --2- 172.21.15.70:0/2513520113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14980b1b00 0x7f14980cd910 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f14840097d0 tx=0x7f148402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9ec18776ec7fb20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:20.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.190+0000 7f1497e00640 1 -- 172.21.15.70:0/2513520113 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484032440 con 0x7f14980b1b00 2024-09-13T16:02:20.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.190+0000 7f1497e00640 1 -- 172.21.15.70:0/2513520113 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14840325a0 con 0x7f14980b1b00 2024-09-13T16:02:20.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.190+0000 7f1497e00640 1 -- 172.21.15.70:0/2513520113 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484032930 con 0x7f14980b1b00 2024-09-13T16:02:20.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.190+0000 7f14a0200640 1 -- 172.21.15.70:0/2513520113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14980b1b00 msgr2=0x7f14980cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:20.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.190+0000 7f14a0200640 1 --2- 172.21.15.70:0/2513520113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14980b1b00 0x7f14980cd910 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f14840097d0 tx=0x7f148402a1c0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.190+0000 7f14a0200640 1 -- 172.21.15.70:0/2513520113 shutdown_connections 2024-09-13T16:02:20.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.190+0000 7f14a0200640 1 --2- 172.21.15.70:0/2513520113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14980b1b00 0x7f14980cd910 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.190+0000 7f14a0200640 1 --2- 172.21.15.70:0/2513520113 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f149815a520 0x7f149806b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.190+0000 7f14a0200640 1 -- 172.21.15.70:0/2513520113 >> 172.21.15.70:0/2513520113 conn(0x7f14980b0510 msgr2=0x7f14980b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:20.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.190+0000 7f14a0200640 1 -- 172.21.15.70:0/2513520113 shutdown_connections 2024-09-13T16:02:20.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.190+0000 7f14a0200640 1 -- 172.21.15.70:0/2513520113 wait complete. 2024-09-13T16:02:20.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.192+0000 7f14a0200640 1 Processor -- start 2024-09-13T16:02:20.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.192+0000 7f14a0200640 1 -- start start 2024-09-13T16:02:20.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.193+0000 7f14a0200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14980b1b00 0x7f1498147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:20.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.193+0000 7f14a0200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14980cde50 0x7f1498151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:20.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.193+0000 7f14a0200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f149815a520 0x7f1498144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:20.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.193+0000 7f14a0200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149814e570 con 0x7f14980cde50 2024-09-13T16:02:20.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.193+0000 7f14a0200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149814e850 con 0x7f149815a520 2024-09-13T16:02:20.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.193+0000 7f14a0200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149814eb30 con 0x7f14980b1b00 2024-09-13T16:02:20.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.193+0000 7f149ce00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14980cde50 0x7f1498151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:20.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.193+0000 7f149ce00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14980cde50 0x7f1498151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36986/0 (socket says 172.21.15.70:36986) 2024-09-13T16:02:20.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.193+0000 7f149ce00640 1 -- 172.21.15.70:0/836931416 learned_addr learned my addr 172.21.15.70:0/836931416 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:20.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.193+0000 7f149d800640 1 --2- 172.21.15.70:0/836931416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14980b1b00 0x7f1498147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:20.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.194+0000 7f149e200640 1 --2- 172.21.15.70:0/836931416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f149815a520 0x7f1498144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:20.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.194+0000 7f149ce00640 1 -- 172.21.15.70:0/836931416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14980b1b00 msgr2=0x7f1498147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:20.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.194+0000 7f149ce00640 1 --2- 172.21.15.70:0/836931416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14980b1b00 0x7f1498147e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.194+0000 7f149ce00640 1 -- 172.21.15.70:0/836931416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f149815a520 msgr2=0x7f1498144ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:20.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.194+0000 7f149ce00640 1 --2- 172.21.15.70:0/836931416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f149815a520 0x7f1498144ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.194+0000 7f149ce00640 1 -- 172.21.15.70:0/836931416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c009400 con 0x7f14980cde50 2024-09-13T16:02:20.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.194+0000 7f149ce00640 1 --2- 172.21.15.70:0/836931416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14980cde50 0x7f1498151020 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1484000c00 tx=0x7f14840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:20.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.194+0000 7f1495600640 1 -- 172.21.15.70:0/836931416 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148403d8f0 con 0x7f14980cde50 2024-09-13T16:02:20.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.195+0000 7f1495600640 1 -- 172.21.15.70:0/836931416 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148403da70 con 0x7f14980cde50 2024-09-13T16:02:20.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.195+0000 7f14a0200640 1 -- 172.21.15.70:0/836931416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1484009400 con 0x7f14980cde50 2024-09-13T16:02:20.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.195+0000 7f1495600640 1 -- 172.21.15.70:0/836931416 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148403de20 con 0x7f14980cde50 2024-09-13T16:02:20.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.195+0000 7f14a0200640 1 -- 172.21.15.70:0/836931416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149814ba20 con 0x7f14980cde50 2024-09-13T16:02:20.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.196+0000 7f14a0200640 1 -- 172.21.15.70:0/836931416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14980cd910 con 0x7f14980cde50 2024-09-13T16:02:20.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.196+0000 7f1495600640 1 -- 172.21.15.70:0/836931416 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1484039040 con 0x7f14980cde50 2024-09-13T16:02:20.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.197+0000 7f1495600640 1 --2- 172.21.15.70:0/836931416 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f147806ac00 0x7f147806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:20.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.197+0000 7f1495600640 1 -- 172.21.15.70:0/836931416 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14840a9da0 con 0x7f14980cde50 2024-09-13T16:02:20.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.197+0000 7f149d800640 1 --2- 172.21.15.70:0/836931416 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f147806ac00 0x7f147806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:20.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.198+0000 7f149d800640 1 --2- 172.21.15.70:0/836931416 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f147806ac00 0x7f147806d0c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f148c009c30 tx=0x7f148c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:20.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.201+0000 7f1495600640 1 -- 172.21.15.70:0/836931416 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1484074f90 con 0x7f14980cde50 2024-09-13T16:02:20.351 INFO:tasks.ceph.mds.c.smithi070.stderr:2024-09-13T16:02:20.349+0000 7f5777600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T16:02:20.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.404+0000 7f14a0200640 1 -- 172.21.15.70:0/836931416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f149806aac0 con 0x7f14980cde50 2024-09-13T16:02:20.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.405+0000 7f1495600640 1 -- 172.21.15.70:0/836931416 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f14840785b0 con 0x7f14980cde50 2024-09-13T16:02:20.407 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:20.407 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/1247927631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1247927631},{"type":"v1","addr":"172.21.15.70:6836","nonce":1247927631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/1077617661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1077617661},{"type":"v1","addr":"172.21.15.107:6834","nonce":1077617661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2709979655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2709979655},{"type":"v1","addr":"172.21.15.107:6835","nonce":2709979655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:02:16.987283+0000","modified":"2024-09-13T16:02:20.008275+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6837/3554365995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":3554365995},{"type":"v1","addr":"172.21.15.70:6837","nonce":3554365995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T16:02:20.407 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 16 2024-09-13T16:02:20.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.407+0000 7f14a0200640 1 -- 172.21.15.70:0/836931416 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f147806ac00 msgr2=0x7f147806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:20.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.407+0000 7f14a0200640 1 --2- 172.21.15.70:0/836931416 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f147806ac00 0x7f147806d0c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f148c009c30 tx=0x7f148c009190 comp rx=0 tx=0).stop 2024-09-13T16:02:20.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.407+0000 7f14a0200640 1 -- 172.21.15.70:0/836931416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14980cde50 msgr2=0x7f1498151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:20.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.407+0000 7f14a0200640 1 --2- 172.21.15.70:0/836931416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14980cde50 0x7f1498151020 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1484000c00 tx=0x7f14840046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.407+0000 7f14a0200640 1 -- 172.21.15.70:0/836931416 shutdown_connections 2024-09-13T16:02:20.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.407+0000 7f14a0200640 1 --2- 172.21.15.70:0/836931416 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f147806ac00 0x7f147806d0c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.407+0000 7f14a0200640 1 --2- 172.21.15.70:0/836931416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f149815a520 0x7f1498144ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.407+0000 7f14a0200640 1 --2- 172.21.15.70:0/836931416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14980cde50 0x7f1498151020 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.407+0000 7f14a0200640 1 --2- 172.21.15.70:0/836931416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14980b1b00 0x7f1498147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.407+0000 7f14a0200640 1 -- 172.21.15.70:0/836931416 >> 172.21.15.70:0/836931416 conn(0x7f14980b0510 msgr2=0x7f14980cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:20.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.407+0000 7f14a0200640 1 -- 172.21.15.70:0/836931416 shutdown_connections 2024-09-13T16:02:20.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.407+0000 7f14a0200640 1 -- 172.21.15.70:0/836931416 wait complete. 2024-09-13T16:02:20.426 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:02:20.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.575+0000 7f8295400640 1 Processor -- start 2024-09-13T16:02:20.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.575+0000 7f8295400640 1 -- start start 2024-09-13T16:02:20.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.576+0000 7f8295400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f829015a520 0x7f829006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:20.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.576+0000 7f8295400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f82900b1b00 0x7f82900cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:20.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.576+0000 7f8295400640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829006bc00 con 0x7f82900cde50 2024-09-13T16:02:20.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.576+0000 7f8295400640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829006bea0 con 0x7f82900b1b00 2024-09-13T16:02:20.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.576+0000 7f8295400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829006c180 con 0x7f829015a520 2024-09-13T16:02:20.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.576+0000 7f828de00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f82900b1b00 0x7f82900cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:20.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.576+0000 7f828f200640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f82900cde50 0x7f82900b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:43160/0 (socket says 172.21.15.70:43160) 2024-09-13T16:02:20.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.576+0000 7f828f200640 1 -- 172.21.15.70:0/809870471 learned_addr learned my addr 172.21.15.70:0/809870471 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:20.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.577+0000 7f828e800640 1 --2- 172.21.15.70:0/809870471 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f829015a520 0x7f829006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:20.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.577+0000 7f828de00640 1 -- 172.21.15.70:0/809870471 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f829015a520 msgr2=0x7f829006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:20.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.577+0000 7f828de00640 1 --2- 172.21.15.70:0/809870471 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f829015a520 0x7f829006b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.577+0000 7f828de00640 1 -- 172.21.15.70:0/809870471 >> v1:172.21.15.70:6789/0 conn(0x7f82900cde50 legacy=0x7f82900b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:20.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.577+0000 7f828de00640 1 -- 172.21.15.70:0/809870471 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829006c460 con 0x7f82900b1b00 2024-09-13T16:02:20.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.577+0000 7f828d400640 1 -- 172.21.15.70:0/809870471 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79862783 0 0) 0x7f829006bc00 con 0x7f82900cde50 2024-09-13T16:02:20.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.578+0000 7f828de00640 1 --2- 172.21.15.70:0/809870471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82900b1b00 0x7f82900cd910 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f827c0097d0 tx=0x7f827c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1bf180a0aa49d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:20.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.578+0000 7f828d400640 1 -- 172.21.15.70:0/809870471 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c032440 con 0x7f82900b1b00 2024-09-13T16:02:20.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.578+0000 7f828d400640 1 -- 172.21.15.70:0/809870471 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c0325a0 con 0x7f82900b1b00 2024-09-13T16:02:20.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.578+0000 7f828d400640 1 -- 172.21.15.70:0/809870471 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c032930 con 0x7f82900b1b00 2024-09-13T16:02:20.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.579+0000 7f8295400640 1 -- 172.21.15.70:0/809870471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82900b1b00 msgr2=0x7f82900cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:20.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.579+0000 7f8295400640 1 --2- 172.21.15.70:0/809870471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82900b1b00 0x7f82900cd910 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f827c0097d0 tx=0x7f827c02a1c0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.579+0000 7f8295400640 1 -- 172.21.15.70:0/809870471 shutdown_connections 2024-09-13T16:02:20.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.579+0000 7f8295400640 1 --2- 172.21.15.70:0/809870471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82900b1b00 0x7f82900cd910 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.579+0000 7f8295400640 1 --2- 172.21.15.70:0/809870471 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f829015a520 0x7f829006b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.579+0000 7f8295400640 1 -- 172.21.15.70:0/809870471 >> 172.21.15.70:0/809870471 conn(0x7f82900b0510 msgr2=0x7f82900b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:20.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.579+0000 7f8295400640 1 -- 172.21.15.70:0/809870471 shutdown_connections 2024-09-13T16:02:20.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.579+0000 7f8295400640 1 -- 172.21.15.70:0/809870471 wait complete. 2024-09-13T16:02:20.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.580+0000 7f8295400640 1 Processor -- start 2024-09-13T16:02:20.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.581+0000 7f8295400640 1 -- start start 2024-09-13T16:02:20.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.581+0000 7f8295400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82900b1b00 0x7f82901546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:20.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.581+0000 7f8295400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82900cde50 0x7f8290151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:20.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.581+0000 7f8295400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f829015a520 0x7f82900c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:20.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.581+0000 7f8295400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8290153640 con 0x7f82900cde50 2024-09-13T16:02:20.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.581+0000 7f8295400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8290153920 con 0x7f829015a520 2024-09-13T16:02:20.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.581+0000 7f8295400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8290153c00 con 0x7f82900b1b00 2024-09-13T16:02:20.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.582+0000 7f828de00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82900cde50 0x7f8290151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:20.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.582+0000 7f828de00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82900cde50 0x7f8290151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37014/0 (socket says 172.21.15.70:37014) 2024-09-13T16:02:20.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.582+0000 7f828de00640 1 -- 172.21.15.70:0/3527384448 learned_addr learned my addr 172.21.15.70:0/3527384448 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:20.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.582+0000 7f828e800640 1 --2- 172.21.15.70:0/3527384448 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82900b1b00 0x7f82901546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:20.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.582+0000 7f828f200640 1 --2- 172.21.15.70:0/3527384448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f829015a520 0x7f82900c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:20.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.582+0000 7f828de00640 1 -- 172.21.15.70:0/3527384448 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82900b1b00 msgr2=0x7f82901546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:20.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.582+0000 7f828de00640 1 --2- 172.21.15.70:0/3527384448 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82900b1b00 0x7f82901546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.582+0000 7f828de00640 1 -- 172.21.15.70:0/3527384448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f829015a520 msgr2=0x7f82900c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:20.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.582+0000 7f828de00640 1 --2- 172.21.15.70:0/3527384448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f829015a520 0x7f82900c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.582+0000 7f828de00640 1 -- 172.21.15.70:0/3527384448 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c009400 con 0x7f82900cde50 2024-09-13T16:02:20.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.582+0000 7f828f200640 1 --2- 172.21.15.70:0/3527384448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f829015a520 0x7f82900c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:20.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.582+0000 7f828de00640 1 --2- 172.21.15.70:0/3527384448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82900cde50 0x7f8290151070 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f827c000c00 tx=0x7f827c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:20.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.583+0000 7f8286a00640 1 -- 172.21.15.70:0/3527384448 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c004230 con 0x7f82900cde50 2024-09-13T16:02:20.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.583+0000 7f8286a00640 1 -- 172.21.15.70:0/3527384448 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c004390 con 0x7f82900cde50 2024-09-13T16:02:20.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.583+0000 7f8295400640 1 -- 172.21.15.70:0/3527384448 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8290153ee0 con 0x7f82900cde50 2024-09-13T16:02:20.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.583+0000 7f8286a00640 1 -- 172.21.15.70:0/3527384448 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c030b20 con 0x7f82900cde50 2024-09-13T16:02:20.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.583+0000 7f8295400640 1 -- 172.21.15.70:0/3527384448 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8290154c20 con 0x7f82900cde50 2024-09-13T16:02:20.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.584+0000 7f8295400640 1 -- 172.21.15.70:0/3527384448 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8290154400 con 0x7f82900cde50 2024-09-13T16:02:20.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.585+0000 7f8286a00640 1 -- 172.21.15.70:0/3527384448 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f827c039050 con 0x7f82900cde50 2024-09-13T16:02:20.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.586+0000 7f8286a00640 1 --2- 172.21.15.70:0/3527384448 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f827006ac00 0x7f827006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:20.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.586+0000 7f8286a00640 1 -- 172.21.15.70:0/3527384448 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f827c0a9c90 con 0x7f82900cde50 2024-09-13T16:02:20.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.586+0000 7f828e800640 1 --2- 172.21.15.70:0/3527384448 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f827006ac00 0x7f827006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:20.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.586+0000 7f828e800640 1 --2- 172.21.15.70:0/3527384448 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f827006ac00 0x7f827006d0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f82800079a0 tx=0x7f8280008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:20.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.590+0000 7f8286a00640 1 -- 172.21.15.70:0/3527384448 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8290154400 con 0x7f82900cde50 2024-09-13T16:02:20.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.759+0000 7f8295400640 1 -- 172.21.15.70:0/3527384448 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8290154400 con 0x7f82900cde50 2024-09-13T16:02:20.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.760+0000 7f8286a00640 1 -- 172.21.15.70:0/3527384448 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16533 (secure 0 0 0) 0x7f8290154400 con 0x7f82900cde50 2024-09-13T16:02:20.763 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:20.763 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:02:17.990784+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:02:15.044503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T16:02:15.981176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:02:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.762+0000 7f8295400640 1 -- 172.21.15.70:0/3527384448 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f827006ac00 msgr2=0x7f827006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.762+0000 7f8295400640 1 --2- 172.21.15.70:0/3527384448 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f827006ac00 0x7f827006d0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f82800079a0 tx=0x7f8280008040 comp rx=0 tx=0).stop 2024-09-13T16:02:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.762+0000 7f8295400640 1 -- 172.21.15.70:0/3527384448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82900cde50 msgr2=0x7f8290151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.762+0000 7f8295400640 1 --2- 172.21.15.70:0/3527384448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82900cde50 0x7f8290151070 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f827c000c00 tx=0x7f827c0046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.762+0000 7f8295400640 1 -- 172.21.15.70:0/3527384448 shutdown_connections 2024-09-13T16:02:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.762+0000 7f8295400640 1 --2- 172.21.15.70:0/3527384448 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f827006ac00 0x7f827006d0c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.762+0000 7f8295400640 1 --2- 172.21.15.70:0/3527384448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f829015a520 0x7f82900c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.762+0000 7f8295400640 1 --2- 172.21.15.70:0/3527384448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82900cde50 0x7f8290151070 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.762+0000 7f8295400640 1 --2- 172.21.15.70:0/3527384448 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82900b1b00 0x7f82901546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.762+0000 7f8295400640 1 -- 172.21.15.70:0/3527384448 >> 172.21.15.70:0/3527384448 conn(0x7f82900b0510 msgr2=0x7f82900ca9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.763+0000 7f8295400640 1 -- 172.21.15.70:0/3527384448 shutdown_connections 2024-09-13T16:02:20.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.763+0000 7f8295400640 1 -- 172.21.15.70:0/3527384448 wait complete. 2024-09-13T16:02:20.780 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T16:02:20.780 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T16:02:20.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.930+0000 7f5875a00640 1 Processor -- start 2024-09-13T16:02:20.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.930+0000 7f5875a00640 1 -- start start 2024-09-13T16:02:20.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.932+0000 7f5875a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58700b3990 0x7f5870159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:20.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.932+0000 7f5875a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f587006f660 0x7f587006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:20.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.932+0000 7f5875a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5870159fc0 con 0x7f5870153b20 2024-09-13T16:02:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.932+0000 7f5875a00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58700b3df0 con 0x7f587006f660 2024-09-13T16:02:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.932+0000 7f5875a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58700ce600 con 0x7f58700b3990 2024-09-13T16:02:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.932+0000 7f586f400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f587006f660 0x7f587006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.932+0000 7f586f400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f587006f660 0x7f587006faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37018/0 (socket says 172.21.15.70:37018) 2024-09-13T16:02:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.932+0000 7f586f400640 1 -- 172.21.15.70:0/1420051460 learned_addr learned my addr 172.21.15.70:0/1420051460 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.932+0000 7f586e000640 1 --2- 172.21.15.70:0/1420051460 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58700b3990 0x7f5870159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.932+0000 7f586f400640 1 -- 172.21.15.70:0/1420051460 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58700b3990 msgr2=0x7f5870159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.932+0000 7f586f400640 1 --2- 172.21.15.70:0/1420051460 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58700b3990 0x7f5870159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.932+0000 7f586f400640 1 -- 172.21.15.70:0/1420051460 >> v1:172.21.15.107:6789/0 conn(0x7f5870153b20 legacy=0x7f58700b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.932+0000 7f586f400640 1 -- 172.21.15.70:0/1420051460 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5870153f00 con 0x7f587006f660 2024-09-13T16:02:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.932+0000 7f586e000640 1 --2- 172.21.15.70:0/1420051460 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58700b3990 0x7f5870159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:20.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.933+0000 7f586f400640 1 --2- 172.21.15.70:0/1420051460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f587006f660 0x7f587006faf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f586800d150 tx=0x7f586802c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ea741d0531c515 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.933+0000 7f586d600640 1 -- 172.21.15.70:0/1420051460 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868009600 con 0x7f587006f660 2024-09-13T16:02:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.934+0000 7f586d600640 1 -- 172.21.15.70:0/1420051460 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5868009760 con 0x7f587006f660 2024-09-13T16:02:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.934+0000 7f586d600640 1 -- 172.21.15.70:0/1420051460 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868009af0 con 0x7f587006f660 2024-09-13T16:02:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.934+0000 7f5875a00640 1 -- 172.21.15.70:0/1420051460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f587006f660 msgr2=0x7f587006faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.934+0000 7f5875a00640 1 --2- 172.21.15.70:0/1420051460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f587006f660 0x7f587006faf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f586800d150 tx=0x7f586802c930 comp rx=0 tx=0).stop 2024-09-13T16:02:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.934+0000 7f5875a00640 1 -- 172.21.15.70:0/1420051460 shutdown_connections 2024-09-13T16:02:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.934+0000 7f5875a00640 1 --2- 172.21.15.70:0/1420051460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f587006f660 0x7f587006faf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.934+0000 7f5875a00640 1 --2- 172.21.15.70:0/1420051460 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58700b3990 0x7f5870159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.934+0000 7f5875a00640 1 -- 172.21.15.70:0/1420051460 >> 172.21.15.70:0/1420051460 conn(0x7f58700b0510 msgr2=0x7f58700b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.934+0000 7f5875a00640 1 -- 172.21.15.70:0/1420051460 shutdown_connections 2024-09-13T16:02:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.934+0000 7f5875a00640 1 -- 172.21.15.70:0/1420051460 wait complete. 2024-09-13T16:02:20.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.936+0000 7f5875a00640 1 Processor -- start 2024-09-13T16:02:20.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.936+0000 7f5875a00640 1 -- start start 2024-09-13T16:02:20.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.937+0000 7f5875a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f587006f660 0x7f587014ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:20.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.937+0000 7f5875a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58700b3990 0x7f5870152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:20.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.937+0000 7f5875a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5870153b20 0x7f58700ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:20.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.937+0000 7f5875a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58701571d0 con 0x7f587006f660 2024-09-13T16:02:20.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.937+0000 7f5875a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587014fc50 con 0x7f58700b3990 2024-09-13T16:02:20.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.937+0000 7f5875a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587014f440 con 0x7f5870153b20 2024-09-13T16:02:20.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.937+0000 7f586ea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f587006f660 0x7f587014ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:20.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.937+0000 7f586ea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f587006f660 0x7f587014ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37020/0 (socket says 172.21.15.70:37020) 2024-09-13T16:02:20.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.937+0000 7f586ea00640 1 -- 172.21.15.70:0/1503262986 learned_addr learned my addr 172.21.15.70:0/1503262986 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:20.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.937+0000 7f586e000640 1 --2- 172.21.15.70:0/1503262986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58700b3990 0x7f5870152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:20.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.937+0000 7f586f400640 1 --2- 172.21.15.70:0/1503262986 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5870153b20 0x7f58700ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:20.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.937+0000 7f586ea00640 1 -- 172.21.15.70:0/1503262986 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5870153b20 msgr2=0x7f58700ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:20.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.937+0000 7f586ea00640 1 --2- 172.21.15.70:0/1503262986 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5870153b20 0x7f58700ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.937+0000 7f586ea00640 1 -- 172.21.15.70:0/1503262986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58700b3990 msgr2=0x7f5870152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:20.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.937+0000 7f586ea00640 1 --2- 172.21.15.70:0/1503262986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58700b3990 0x7f5870152910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:20.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.937+0000 7f586ea00640 1 -- 172.21.15.70:0/1503262986 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586800bd40 con 0x7f587006f660 2024-09-13T16:02:20.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.938+0000 7f586ea00640 1 --2- 172.21.15.70:0/1503262986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f587006f660 0x7f587014ef00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f586000c450 tx=0x7f586000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:20.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.938+0000 7f5866a00640 1 -- 172.21.15.70:0/1503262986 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58600052d0 con 0x7f587006f660 2024-09-13T16:02:20.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.938+0000 7f5866a00640 1 -- 172.21.15.70:0/1503262986 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5860005430 con 0x7f587006f660 2024-09-13T16:02:20.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.938+0000 7f5866a00640 1 -- 172.21.15.70:0/1503262986 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5860012870 con 0x7f587006f660 2024-09-13T16:02:20.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.938+0000 7f5875a00640 1 -- 172.21.15.70:0/1503262986 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5870152e50 con 0x7f587006f660 2024-09-13T16:02:20.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.938+0000 7f5875a00640 1 -- 172.21.15.70:0/1503262986 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5870150180 con 0x7f587006f660 2024-09-13T16:02:20.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.939+0000 7f5875a00640 1 -- 172.21.15.70:0/1503262986 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587015a7b0 con 0x7f587006f660 2024-09-13T16:02:20.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.940+0000 7f5866a00640 1 -- 172.21.15.70:0/1503262986 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f58600129d0 con 0x7f587006f660 2024-09-13T16:02:20.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.941+0000 7f5866a00640 1 --2- 172.21.15.70:0/1503262986 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f585006ac30 0x7f585006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:20.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.941+0000 7f5866a00640 1 -- 172.21.15.70:0/1503262986 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5860088e20 con 0x7f587006f660 2024-09-13T16:02:20.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.941+0000 7f586e000640 1 --2- 172.21.15.70:0/1503262986 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f585006ac30 0x7f585006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:20.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.942+0000 7f586e000640 1 --2- 172.21.15.70:0/1503262986 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f585006ac30 0x7f585006d0f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f587014fc00 tx=0x7f585c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:20.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:20.945+0000 7f5866a00640 1 -- 172.21.15.70:0/1503262986 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5860053ff0 con 0x7f587006f660 2024-09-13T16:02:21.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.113+0000 7f5875a00640 1 -- 172.21.15.70:0/1503262986 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58700b1a40 con 0x7f585006ac30 2024-09-13T16:02:21.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.121+0000 7f5866a00640 1 -- 172.21.15.70:0/1503262986 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274153 (secure 0 0 0) 0x7f585c00f830 con 0x7f585006ac30 2024-09-13T16:02:21.126 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:21.128 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-13T16:02:21.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.125+0000 7f5875a00640 1 -- 172.21.15.70:0/1503262986 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f585006ac30 msgr2=0x7f585006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:21.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.125+0000 7f5875a00640 1 --2- 172.21.15.70:0/1503262986 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f585006ac30 0x7f585006d0f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f587014fc00 tx=0x7f585c008040 comp rx=0 tx=0).stop 2024-09-13T16:02:21.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.125+0000 7f5875a00640 1 -- 172.21.15.70:0/1503262986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f587006f660 msgr2=0x7f587014ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:21.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.125+0000 7f5875a00640 1 --2- 172.21.15.70:0/1503262986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f587006f660 0x7f587014ef00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f586000c450 tx=0x7f586000c910 comp rx=0 tx=0).stop 2024-09-13T16:02:21.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.125+0000 7f5875a00640 1 -- 172.21.15.70:0/1503262986 shutdown_connections 2024-09-13T16:02:21.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.125+0000 7f5875a00640 1 --2- 172.21.15.70:0/1503262986 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5870153b20 0x7f58700ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.125+0000 7f5875a00640 1 --2- 172.21.15.70:0/1503262986 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f585006ac30 0x7f585006d0f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.125+0000 7f5875a00640 1 --2- 172.21.15.70:0/1503262986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58700b3990 0x7f5870152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.125+0000 7f5875a00640 1 --2- 172.21.15.70:0/1503262986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f587006f660 0x7f587014ef00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.125+0000 7f5875a00640 1 -- 172.21.15.70:0/1503262986 >> 172.21.15.70:0/1503262986 conn(0x7f58700b0510 msgr2=0x7f58700b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:21.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.126+0000 7f5875a00640 1 -- 172.21.15.70:0/1503262986 shutdown_connections 2024-09-13T16:02:21.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.126+0000 7f5875a00640 1 -- 172.21.15.70:0/1503262986 wait complete. 2024-09-13T16:02:21.145 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-09-13T16:02:20.028866+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":236360,"kb_used_data":3780,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738360,"statfs":{"total":773094113280,"available":772852080640,"internally_reserved":0,"allocated":3870720,"data_stored":2193541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.455611"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T16:02:11.151867+0000","last_change":"2024-09-13T16:01:07.580186+0000","last_active":"2024-09-13T16:02:11.151867+0000","last_peered":"2024-09-13T16:02:11.151867+0000","last_clean":"2024-09-13T16:02:11.151867+0000","last_became_active":"2024-09-13T16:01:07.579877+0000","last_became_peered":"2024-09-13T16:01:07.579877+0000","last_unstale":"2024-09-13T16:02:11.151867+0000","last_undegraded":"2024-09-13T16:02:11.151867+0000","last_fullsized":"2024-09-13T16:02:11.151867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_clean_scrub_stamp":"2024-09-13T16:01:06.070807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:40.645649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":929792,"data_stored":717096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.61699999999999999}]},{"osd":1,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.498},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.53200000000000003}]},{"osd":3,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.442}]},{"osd":5,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.67600000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.749},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.57599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27364,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":335872,"data_stored":126728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.626}]},{"osd":7,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":126728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.628}]},{"osd":1,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.57899999999999996}]},{"osd":2,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.1230000000000002,"5min":5.1230000000000002,"15min":5.1230000000000002},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.0750000000000002,"5min":5.0750000000000002,"15min":5.0750000000000002},"last":0.754},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.88},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.86899999999999999}]},{"osd":6,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.94499999999999995}]},{"osd":7,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.91900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.621},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.56100000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.68300000000000005}]},{"osd":2,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.77200000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.753}]},{"osd":5,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.80400000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.84399999999999997}]},{"osd":7,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.874},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.93000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31444,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":335872,"data_stored":126728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.37}]},{"osd":1,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.61599999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.99099999999999999}]},{"osd":5,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.85799999999999998}]},{"osd":7,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.82399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31444,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":335872,"data_stored":126728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46500000000000002}]},{"osd":1,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.379},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.43099999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.54600000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.51800000000000002}]},{"osd":7,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.55800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31444,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":335872,"data_stored":126728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.309},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.436}]},{"osd":2,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.45100000000000001}]},{"osd":3,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.46100000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.71999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":925696,"data_stored":716077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.42499999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.376},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.39400000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.51500000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:02:21.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T16:02:21.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.334+0000 7efc8e400640 1 Processor -- start 2024-09-13T16:02:21.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.334+0000 7efc8e400640 1 -- start start 2024-09-13T16:02:21.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.335+0000 7efc8e400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efc88160370 0x7efc880b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:21.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.335+0000 7efc8e400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efc880b2e90 0x7efc880ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:21.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.335+0000 7efc8e400640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8813fbc0 con 0x7efc880b3a40 2024-09-13T16:02:21.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.335+0000 7efc8e400640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8806cca0 con 0x7efc88160370 2024-09-13T16:02:21.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.335+0000 7efc8e400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8815ce80 con 0x7efc880b2e90 2024-09-13T16:02:21.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.335+0000 7efc87400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7efc880b3a40 0x7efc881428a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:43172/0 (socket says 172.21.15.70:43172) 2024-09-13T16:02:21.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.336+0000 7efc87400640 1 -- 172.21.15.70:0/3409792532 learned_addr learned my addr 172.21.15.70:0/3409792532 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:21.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.336+0000 7efc86a00640 1 --2- 172.21.15.70:0/3409792532 >> v2:172.21.15.70:3300/0 conn(0x7efc88160370 0x7efc880b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:21.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.336+0000 7efc86000640 1 -- 172.21.15.70:0/3409792532 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485944554 0 0) 0x7efc8813fbc0 con 0x7efc880b3a40 2024-09-13T16:02:21.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.336+0000 7efc86000640 1 -- 172.21.15.70:0/3409792532 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc6c003520 con 0x7efc880b3a40 2024-09-13T16:02:21.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.336+0000 7efc87e00640 1 --2- 172.21.15.70:0/3409792532 >> v2:172.21.15.107:3300/0 conn(0x7efc880b2e90 0x7efc880ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:21.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.336+0000 7efc86a00640 1 -- 172.21.15.70:0/3409792532 >> v2:172.21.15.107:3300/0 conn(0x7efc880b2e90 msgr2=0x7efc880ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:21.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.336+0000 7efc86a00640 1 --2- 172.21.15.70:0/3409792532 >> v2:172.21.15.107:3300/0 conn(0x7efc880b2e90 0x7efc880ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.336+0000 7efc86a00640 1 -- 172.21.15.70:0/3409792532 >> v1:172.21.15.70:6789/0 conn(0x7efc880b3a40 legacy=0x7efc881428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:21.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.336+0000 7efc86a00640 1 -- 172.21.15.70:0/3409792532 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc88160910 con 0x7efc88160370 2024-09-13T16:02:21.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.336+0000 7efc87e00640 1 --2- 172.21.15.70:0/3409792532 >> v2:172.21.15.107:3300/0 conn(0x7efc880b2e90 0x7efc880ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:21.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.337+0000 7efc86a00640 1 --2- 172.21.15.70:0/3409792532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc88160370 0x7efc880b2950 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efc8806f5f0 tx=0x7efc7402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78bc6a2750caaa02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:21.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.337+0000 7efc86000640 1 -- 172.21.15.70:0/3409792532 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7402ae60 con 0x7efc88160370 2024-09-13T16:02:21.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.337+0000 7efc86000640 1 -- 172.21.15.70:0/3409792532 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc74032440 con 0x7efc88160370 2024-09-13T16:02:21.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.337+0000 7efc86000640 1 -- 172.21.15.70:0/3409792532 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc740327d0 con 0x7efc88160370 2024-09-13T16:02:21.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.338+0000 7efc8e400640 1 -- 172.21.15.70:0/3409792532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc88160370 msgr2=0x7efc880b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:21.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.338+0000 7efc8e400640 1 --2- 172.21.15.70:0/3409792532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc88160370 0x7efc880b2950 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efc8806f5f0 tx=0x7efc7402a110 comp rx=0 tx=0).stop 2024-09-13T16:02:21.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.338+0000 7efc8e400640 1 -- 172.21.15.70:0/3409792532 shutdown_connections 2024-09-13T16:02:21.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.338+0000 7efc8e400640 1 --2- 172.21.15.70:0/3409792532 >> v2:172.21.15.107:3300/0 conn(0x7efc880b2e90 0x7efc880ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.338+0000 7efc8e400640 1 --2- 172.21.15.70:0/3409792532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc88160370 0x7efc880b2950 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.338+0000 7efc8e400640 1 -- 172.21.15.70:0/3409792532 >> 172.21.15.70:0/3409792532 conn(0x7efc880b0510 msgr2=0x7efc880b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:21.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.338+0000 7efc8e400640 1 -- 172.21.15.70:0/3409792532 shutdown_connections 2024-09-13T16:02:21.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.338+0000 7efc8e400640 1 -- 172.21.15.70:0/3409792532 wait complete. 2024-09-13T16:02:21.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.340+0000 7efc8e400640 1 Processor -- start 2024-09-13T16:02:21.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.340+0000 7efc8e400640 1 -- start start 2024-09-13T16:02:21.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.341+0000 7efc8e400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc880b2e90 0x7efc881f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:21.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.341+0000 7efc8e400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc880b3a40 0x7efc88153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:21.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.341+0000 7efc8e400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc88160370 0x7efc88141dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:21.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.341+0000 7efc8e400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc881f2500 con 0x7efc88160370 2024-09-13T16:02:21.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.341+0000 7efc8e400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc881543e0 con 0x7efc880b2e90 2024-09-13T16:02:21.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.341+0000 7efc8e400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc88144600 con 0x7efc880b3a40 2024-09-13T16:02:21.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.341+0000 7efc87e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc88160370 0x7efc88141dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:21.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.341+0000 7efc87e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc88160370 0x7efc88141dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37050/0 (socket says 172.21.15.70:37050) 2024-09-13T16:02:21.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.341+0000 7efc87e00640 1 -- 172.21.15.70:0/914824415 learned_addr learned my addr 172.21.15.70:0/914824415 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:21.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.341+0000 7efc87400640 1 --2- 172.21.15.70:0/914824415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc880b2e90 0x7efc881f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:21.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.341+0000 7efc86a00640 1 --2- 172.21.15.70:0/914824415 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc880b3a40 0x7efc88153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:21.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.341+0000 7efc87e00640 1 -- 172.21.15.70:0/914824415 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc880b3a40 msgr2=0x7efc88153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:21.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.341+0000 7efc87e00640 1 --2- 172.21.15.70:0/914824415 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc880b3a40 0x7efc88153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.341+0000 7efc87e00640 1 -- 172.21.15.70:0/914824415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc880b2e90 msgr2=0x7efc881f1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:21.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.341+0000 7efc87e00640 1 --2- 172.21.15.70:0/914824415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc880b2e90 0x7efc881f1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.341+0000 7efc87e00640 1 -- 172.21.15.70:0/914824415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc74009400 con 0x7efc88160370 2024-09-13T16:02:21.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.341+0000 7efc86a00640 1 --2- 172.21.15.70:0/914824415 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc880b3a40 0x7efc88153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:21.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.341+0000 7efc87400640 1 --2- 172.21.15.70:0/914824415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc880b2e90 0x7efc881f1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:21.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.342+0000 7efc87e00640 1 --2- 172.21.15.70:0/914824415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc88160370 0x7efc88141dd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efc8000cf20 tx=0x7efc8000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:21.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.342+0000 7efc7f400640 1 -- 172.21.15.70:0/914824415 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8000d840 con 0x7efc88160370 2024-09-13T16:02:21.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.342+0000 7efc7f400640 1 -- 172.21.15.70:0/914824415 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8000d9a0 con 0x7efc88160370 2024-09-13T16:02:21.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.342+0000 7efc8e400640 1 -- 172.21.15.70:0/914824415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc881448e0 con 0x7efc88160370 2024-09-13T16:02:21.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.342+0000 7efc7f400640 1 -- 172.21.15.70:0/914824415 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8000dd50 con 0x7efc88160370 2024-09-13T16:02:21.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.342+0000 7efc8e400640 1 -- 172.21.15.70:0/914824415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc88144ea0 con 0x7efc88160370 2024-09-13T16:02:21.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.343+0000 7efc8e400640 1 -- 172.21.15.70:0/914824415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc880ad170 con 0x7efc88160370 2024-09-13T16:02:21.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.344+0000 7efc7f400640 1 -- 172.21.15.70:0/914824415 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efc8001e3b0 con 0x7efc88160370 2024-09-13T16:02:21.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.345+0000 7efc7f400640 1 --2- 172.21.15.70:0/914824415 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efc6806ac00 0x7efc6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:21.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.345+0000 7efc7f400640 1 -- 172.21.15.70:0/914824415 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc80089ea0 con 0x7efc88160370 2024-09-13T16:02:21.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.345+0000 7efc87400640 1 --2- 172.21.15.70:0/914824415 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efc6806ac00 0x7efc6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:21.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.345+0000 7efc87400640 1 --2- 172.21.15.70:0/914824415 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efc6806ac00 0x7efc6806d0c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efc780011e0 tx=0x7efc78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:21.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.349+0000 7efc7f400640 1 -- 172.21.15.70:0/914824415 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efc80054fe0 con 0x7efc88160370 2024-09-13T16:02:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.519+0000 7efc8e400640 1 -- 172.21.15.70:0/914824415 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc881611b0 con 0x7efc6806ac00 2024-09-13T16:02:21.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.525+0000 7efc7f400640 1 -- 172.21.15.70:0/914824415 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274153 (secure 0 0 0) 0x7efc780013f0 con 0x7efc6806ac00 2024-09-13T16:02:21.530 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:21.532 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-13T16:02:21.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.530+0000 7efc8e400640 1 -- 172.21.15.70:0/914824415 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efc6806ac00 msgr2=0x7efc6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:21.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.530+0000 7efc8e400640 1 --2- 172.21.15.70:0/914824415 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efc6806ac00 0x7efc6806d0c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efc780011e0 tx=0x7efc78009040 comp rx=0 tx=0).stop 2024-09-13T16:02:21.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.530+0000 7efc8e400640 1 -- 172.21.15.70:0/914824415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc88160370 msgr2=0x7efc88141dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:21.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.530+0000 7efc8e400640 1 --2- 172.21.15.70:0/914824415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc88160370 0x7efc88141dd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efc8000cf20 tx=0x7efc8000a7d0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.530+0000 7efc8e400640 1 -- 172.21.15.70:0/914824415 shutdown_connections 2024-09-13T16:02:21.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.530+0000 7efc8e400640 1 --2- 172.21.15.70:0/914824415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc88160370 0x7efc88141dd0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.530+0000 7efc8e400640 1 --2- 172.21.15.70:0/914824415 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc880b3a40 0x7efc88153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.530+0000 7efc8e400640 1 --2- 172.21.15.70:0/914824415 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7efc6806ac00 0x7efc6806d0c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.530+0000 7efc8e400640 1 --2- 172.21.15.70:0/914824415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc880b2e90 0x7efc881f1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.530+0000 7efc8e400640 1 -- 172.21.15.70:0/914824415 >> 172.21.15.70:0/914824415 conn(0x7efc880b0510 msgr2=0x7efc880b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:21.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.530+0000 7efc8e400640 1 -- 172.21.15.70:0/914824415 shutdown_connections 2024-09-13T16:02:21.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.530+0000 7efc8e400640 1 -- 172.21.15.70:0/914824415 wait complete. 2024-09-13T16:02:21.547 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-09-13T16:02:20.028866+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":236360,"kb_used_data":3780,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738360,"statfs":{"total":773094113280,"available":772852080640,"internally_reserved":0,"allocated":3870720,"data_stored":2193541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.455611"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T16:02:11.151867+0000","last_change":"2024-09-13T16:01:07.580186+0000","last_active":"2024-09-13T16:02:11.151867+0000","last_peered":"2024-09-13T16:02:11.151867+0000","last_clean":"2024-09-13T16:02:11.151867+0000","last_became_active":"2024-09-13T16:01:07.579877+0000","last_became_peered":"2024-09-13T16:01:07.579877+0000","last_unstale":"2024-09-13T16:02:11.151867+0000","last_undegraded":"2024-09-13T16:02:11.151867+0000","last_fullsized":"2024-09-13T16:02:11.151867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_clean_scrub_stamp":"2024-09-13T16:01:06.070807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:40.645649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":929792,"data_stored":717096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.61699999999999999}]},{"osd":1,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.498},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.53200000000000003}]},{"osd":3,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.442}]},{"osd":5,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.67600000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.749},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.57599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27364,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":335872,"data_stored":126728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.626}]},{"osd":7,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":126728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.628}]},{"osd":1,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.57899999999999996}]},{"osd":2,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.1230000000000002,"5min":5.1230000000000002,"15min":5.1230000000000002},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.0750000000000002,"5min":5.0750000000000002,"15min":5.0750000000000002},"last":0.754},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.88},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.86899999999999999}]},{"osd":6,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.94499999999999995}]},{"osd":7,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.91900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.621},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.56100000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.68300000000000005}]},{"osd":2,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.77200000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.753}]},{"osd":5,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.80400000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.84399999999999997}]},{"osd":7,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.874},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.93000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31444,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":335872,"data_stored":126728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.37}]},{"osd":1,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.61599999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.99099999999999999}]},{"osd":5,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.85799999999999998}]},{"osd":7,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.82399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31444,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":335872,"data_stored":126728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46500000000000002}]},{"osd":1,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.379},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.43099999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.54600000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.51800000000000002}]},{"osd":7,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.55800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31444,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":335872,"data_stored":126728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.309},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.436}]},{"osd":2,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.45100000000000001}]},{"osd":3,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.46100000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.71999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":925696,"data_stored":716077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.42499999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.376},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.39400000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.51500000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:02:21.551 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T16:02:21.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.736+0000 7fd082800640 1 Processor -- start 2024-09-13T16:02:21.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.737+0000 7fd082800640 1 -- start start 2024-09-13T16:02:21.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.739+0000 7fd082800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd07c15a520 0x7fd07c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:21.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.739+0000 7fd082800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd07c0ce020 0x7fd07c15a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:21.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.739+0000 7fd082800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd07c06bc00 con 0x7fd07c0b1b00 2024-09-13T16:02:21.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.739+0000 7fd082800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd07c06bea0 con 0x7fd07c15a520 2024-09-13T16:02:21.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.739+0000 7fd082800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c06c180 con 0x7fd07c0ce020 2024-09-13T16:02:21.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.739+0000 7fd07be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd07c0ce020 0x7fd07c15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:21.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.739+0000 7fd07aa00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fd07c0b1b00 0x7fd07c0cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:42084/0 (socket says 172.21.15.70:42084) 2024-09-13T16:02:21.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.739+0000 7fd07aa00640 1 -- 172.21.15.70:0/3942427032 learned_addr learned my addr 172.21.15.70:0/3942427032 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:21.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.739+0000 7fd07b400640 1 --2- 172.21.15.70:0/3942427032 >> v2:172.21.15.107:3300/0 conn(0x7fd07c15a520 0x7fd07c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:21.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.739+0000 7fd07be00640 1 -- 172.21.15.70:0/3942427032 >> v2:172.21.15.107:3300/0 conn(0x7fd07c15a520 msgr2=0x7fd07c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:21.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.739+0000 7fd07be00640 1 --2- 172.21.15.70:0/3942427032 >> v2:172.21.15.107:3300/0 conn(0x7fd07c15a520 0x7fd07c06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.739+0000 7fd07be00640 1 -- 172.21.15.70:0/3942427032 >> v1:172.21.15.107:6789/0 conn(0x7fd07c0b1b00 legacy=0x7fd07c0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:21.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.739+0000 7fd07be00640 1 -- 172.21.15.70:0/3942427032 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd07c06c460 con 0x7fd07c0ce020 2024-09-13T16:02:21.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.739+0000 7fd07b400640 1 --2- 172.21.15.70:0/3942427032 >> v2:172.21.15.107:3300/0 conn(0x7fd07c15a520 0x7fd07c06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:21.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.740+0000 7fd07be00640 1 --2- 172.21.15.70:0/3942427032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd07c0ce020 0x7fd07c15a900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd074009d90 tx=0x7fd07402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc7c0383f1a96547 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:21.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.740+0000 7fd07a000640 1 -- 172.21.15.70:0/3942427032 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074031600 con 0x7fd07c0ce020 2024-09-13T16:02:21.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.740+0000 7fd07a000640 1 -- 172.21.15.70:0/3942427032 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07402d050 con 0x7fd07c0ce020 2024-09-13T16:02:21.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.740+0000 7fd07a000640 1 -- 172.21.15.70:0/3942427032 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074031980 con 0x7fd07c0ce020 2024-09-13T16:02:21.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.741+0000 7fd082800640 1 -- 172.21.15.70:0/3942427032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd07c0ce020 msgr2=0x7fd07c15a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:21.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.741+0000 7fd082800640 1 --2- 172.21.15.70:0/3942427032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd07c0ce020 0x7fd07c15a900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd074009d90 tx=0x7fd07402a5d0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.741+0000 7fd082800640 1 -- 172.21.15.70:0/3942427032 shutdown_connections 2024-09-13T16:02:21.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.741+0000 7fd082800640 1 --2- 172.21.15.70:0/3942427032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd07c0ce020 0x7fd07c15a900 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.741+0000 7fd082800640 1 --2- 172.21.15.70:0/3942427032 >> v2:172.21.15.107:3300/0 conn(0x7fd07c15a520 0x7fd07c06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.741+0000 7fd082800640 1 -- 172.21.15.70:0/3942427032 >> 172.21.15.70:0/3942427032 conn(0x7fd07c0b0510 msgr2=0x7fd07c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:21.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.741+0000 7fd082800640 1 -- 172.21.15.70:0/3942427032 shutdown_connections 2024-09-13T16:02:21.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.741+0000 7fd082800640 1 -- 172.21.15.70:0/3942427032 wait complete. 2024-09-13T16:02:21.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.742+0000 7fd082800640 1 Processor -- start 2024-09-13T16:02:21.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.743+0000 7fd082800640 1 -- start start 2024-09-13T16:02:21.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.743+0000 7fd082800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd07c0b1b00 0x7fd07c153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:21.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.743+0000 7fd082800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd07c0ce020 0x7fd07c14b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:21.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.743+0000 7fd082800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd07c15a520 0x7fd07c152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:21.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.743+0000 7fd082800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c155080 con 0x7fd07c0b1b00 2024-09-13T16:02:21.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.743+0000 7fd082800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c154400 con 0x7fd07c0ce020 2024-09-13T16:02:21.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.743+0000 7fd082800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c1546e0 con 0x7fd07c15a520 2024-09-13T16:02:21.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.744+0000 7fd07b400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd07c0b1b00 0x7fd07c153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:21.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.744+0000 7fd07b400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd07c0b1b00 0x7fd07c153bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37056/0 (socket says 172.21.15.70:37056) 2024-09-13T16:02:21.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.744+0000 7fd07b400640 1 -- 172.21.15.70:0/3698712626 learned_addr learned my addr 172.21.15.70:0/3698712626 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:21.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.744+0000 7fd07aa00640 1 --2- 172.21.15.70:0/3698712626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd07c0ce020 0x7fd07c14b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:21.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.744+0000 7fd07be00640 1 --2- 172.21.15.70:0/3698712626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd07c15a520 0x7fd07c152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:21.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.744+0000 7fd07b400640 1 -- 172.21.15.70:0/3698712626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd07c15a520 msgr2=0x7fd07c152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:21.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.744+0000 7fd07b400640 1 --2- 172.21.15.70:0/3698712626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd07c15a520 0x7fd07c152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.744+0000 7fd07b400640 1 -- 172.21.15.70:0/3698712626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd07c0ce020 msgr2=0x7fd07c14b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:21.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.744+0000 7fd07b400640 1 --2- 172.21.15.70:0/3698712626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd07c0ce020 0x7fd07c14b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.744+0000 7fd07b400640 1 -- 172.21.15.70:0/3698712626 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c009400 con 0x7fd07c0b1b00 2024-09-13T16:02:21.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.744+0000 7fd07b400640 1 --2- 172.21.15.70:0/3698712626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd07c0b1b00 0x7fd07c153bd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd06c00e960 tx=0x7fd06c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:21.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.745+0000 7fd073400640 1 -- 172.21.15.70:0/3698712626 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06c00ca00 con 0x7fd07c0b1b00 2024-09-13T16:02:21.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.745+0000 7fd073400640 1 -- 172.21.15.70:0/3698712626 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06c00cb60 con 0x7fd07c0b1b00 2024-09-13T16:02:21.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.745+0000 7fd082800640 1 -- 172.21.15.70:0/3698712626 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd074009a70 con 0x7fd07c0b1b00 2024-09-13T16:02:21.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.745+0000 7fd073400640 1 -- 172.21.15.70:0/3698712626 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06c013470 con 0x7fd07c0b1b00 2024-09-13T16:02:21.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.745+0000 7fd082800640 1 -- 172.21.15.70:0/3698712626 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd07c154ca0 con 0x7fd07c0b1b00 2024-09-13T16:02:21.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.746+0000 7fd082800640 1 -- 172.21.15.70:0/3698712626 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07c1552f0 con 0x7fd07c0b1b00 2024-09-13T16:02:21.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.747+0000 7fd073400640 1 -- 172.21.15.70:0/3698712626 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd06c0135d0 con 0x7fd07c0b1b00 2024-09-13T16:02:21.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.747+0000 7fd073400640 1 --2- 172.21.15.70:0/3698712626 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd05c06ac00 0x7fd05c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:21.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.748+0000 7fd073400640 1 -- 172.21.15.70:0/3698712626 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd06c089650 con 0x7fd07c0b1b00 2024-09-13T16:02:21.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.748+0000 7fd07aa00640 1 --2- 172.21.15.70:0/3698712626 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd05c06ac00 0x7fd05c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:21.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.748+0000 7fd07aa00640 1 --2- 172.21.15.70:0/3698712626 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd05c06ac00 0x7fd05c06d0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd07c15d7c0 tx=0x7fd068009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:21.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.752+0000 7fd073400640 1 -- 172.21.15.70:0/3698712626 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd06c0547b0 con 0x7fd07c0b1b00 2024-09-13T16:02:21.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.917+0000 7fd082800640 1 -- 172.21.15.70:0/3698712626 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd07c0b0e60 con 0x7fd05c06ac00 2024-09-13T16:02:21.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.924+0000 7fd073400640 1 -- 172.21.15.70:0/3698712626 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274153 (secure 0 0 0) 0x7fd07c0b0e60 con 0x7fd05c06ac00 2024-09-13T16:02:21.929 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:21.930 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-13T16:02:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.929+0000 7fd082800640 1 -- 172.21.15.70:0/3698712626 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd05c06ac00 msgr2=0x7fd05c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.929+0000 7fd082800640 1 --2- 172.21.15.70:0/3698712626 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd05c06ac00 0x7fd05c06d0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd07c15d7c0 tx=0x7fd068009040 comp rx=0 tx=0).stop 2024-09-13T16:02:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.929+0000 7fd082800640 1 -- 172.21.15.70:0/3698712626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd07c0b1b00 msgr2=0x7fd07c153bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.929+0000 7fd082800640 1 --2- 172.21.15.70:0/3698712626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd07c0b1b00 0x7fd07c153bd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd06c00e960 tx=0x7fd06c00ee20 comp rx=0 tx=0).stop 2024-09-13T16:02:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.929+0000 7fd082800640 1 -- 172.21.15.70:0/3698712626 shutdown_connections 2024-09-13T16:02:21.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.929+0000 7fd082800640 1 --2- 172.21.15.70:0/3698712626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd07c15a520 0x7fd07c152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.929+0000 7fd082800640 1 --2- 172.21.15.70:0/3698712626 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd05c06ac00 0x7fd05c06d0c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.929+0000 7fd082800640 1 --2- 172.21.15.70:0/3698712626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd07c0ce020 0x7fd07c14b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.929+0000 7fd082800640 1 --2- 172.21.15.70:0/3698712626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd07c0b1b00 0x7fd07c153bd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:21.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.929+0000 7fd082800640 1 -- 172.21.15.70:0/3698712626 >> 172.21.15.70:0/3698712626 conn(0x7fd07c0b0510 msgr2=0x7fd07c1576a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:21.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.929+0000 7fd082800640 1 -- 172.21.15.70:0/3698712626 shutdown_connections 2024-09-13T16:02:21.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:21.929+0000 7fd082800640 1 -- 172.21.15.70:0/3698712626 wait complete. 2024-09-13T16:02:21.947 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-09-13T16:02:20.028866+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":236360,"kb_used_data":3780,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738360,"statfs":{"total":773094113280,"available":772852080640,"internally_reserved":0,"allocated":3870720,"data_stored":2193541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.455611"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:16.572438+0000","last_change":"2024-09-13T16:02:16.572438+0000","last_active":"2024-09-13T16:02:16.572438+0000","last_peered":"2024-09-13T16:02:16.572438+0000","last_clean":"2024-09-13T16:02:16.572438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:16.572438+0000","last_undegraded":"2024-09-13T16:02:16.572438+0000","last_fullsized":"2024-09-13T16:02:16.572438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T16:02:15.569550+0000","last_change":"2024-09-13T16:02:15.569550+0000","last_active":"2024-09-13T16:02:15.569550+0000","last_peered":"2024-09-13T16:02:15.569550+0000","last_clean":"2024-09-13T16:02:15.569550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T16:02:15.569550+0000","last_undegraded":"2024-09-13T16:02:15.569550+0000","last_fullsized":"2024-09-13T16:02:15.569550+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-13T16:02:11.151867+0000","last_change":"2024-09-13T16:01:07.580186+0000","last_active":"2024-09-13T16:02:11.151867+0000","last_peered":"2024-09-13T16:02:11.151867+0000","last_clean":"2024-09-13T16:02:11.151867+0000","last_became_active":"2024-09-13T16:01:07.579877+0000","last_became_peered":"2024-09-13T16:01:07.579877+0000","last_unstale":"2024-09-13T16:02:11.151867+0000","last_undegraded":"2024-09-13T16:02:11.151867+0000","last_fullsized":"2024-09-13T16:02:11.151867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_clean_scrub_stamp":"2024-09-13T16:01:06.070807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:40.645649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":929792,"data_stored":717096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.61699999999999999}]},{"osd":1,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.498},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.53200000000000003}]},{"osd":3,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.442}]},{"osd":5,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.67600000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.749},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.57599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27364,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":335872,"data_stored":126728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.626}]},{"osd":7,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":126728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.628}]},{"osd":1,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.57899999999999996}]},{"osd":2,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.1230000000000002,"5min":5.1230000000000002,"15min":5.1230000000000002},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.0750000000000002,"5min":5.0750000000000002,"15min":5.0750000000000002},"last":0.754},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.88},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.86899999999999999}]},{"osd":6,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.94499999999999995}]},{"osd":7,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.91900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.621},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.56100000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.68300000000000005}]},{"osd":2,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.77200000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.753}]},{"osd":5,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.80400000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.84399999999999997}]},{"osd":7,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.874},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.93000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31444,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":335872,"data_stored":126728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.37}]},{"osd":1,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.61599999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.99099999999999999}]},{"osd":5,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.85799999999999998}]},{"osd":7,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.82399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31444,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":335872,"data_stored":126728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46500000000000002}]},{"osd":1,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.379},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.43099999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.54600000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.51800000000000002}]},{"osd":7,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.55800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31444,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":335872,"data_stored":126728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.309},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.436}]},{"osd":2,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.45100000000000001}]},{"osd":3,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.46100000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.71999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":925696,"data_stored":716077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.42499999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.376},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.39400000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.51500000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:02:21.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-09-13T16:02:21.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-09-13T16:02:21.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-09-13T16:02:21.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-09-13T16:02:21.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-09-13T16:02:21.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-09-13T16:02:21.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-09-13T16:02:21.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-09-13T16:02:21.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-09-13T16:02:21.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-09-13T16:02:21.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-09-13T16:02:21.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-09-13T16:02:21.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-09-13T16:02:21.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-09-13T16:02:21.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-09-13T16:02:21.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-09-13T16:02:21.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-09-13T16:02:21.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-09-13T16:02:21.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-09-13T16:02:21.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-09-13T16:02:21.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-09-13T16:02:21.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-09-13T16:02:21.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-09-13T16:02:21.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-09-13T16:02:21.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-09-13T16:02:21.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-09-13T16:02:21.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-09-13T16:02:21.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-09-13T16:02:21.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-09-13T16:02:21.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-09-13T16:02:21.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-09-13T16:02:21.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-09-13T16:02:21.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-09-13T16:02:21.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-09-13T16:02:21.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-09-13T16:02:21.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-09-13T16:02:21.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-09-13T16:02:21.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-09-13T16:02:21.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-09-13T16:02:21.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-09-13T16:02:21.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-09-13T16:02:21.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-09-13T16:02:21.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-09-13T16:02:21.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-09-13T16:02:21.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-09-13T16:02:21.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-09-13T16:02:21.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-09-13T16:02:21.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-09-13T16:02:21.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-09-13T16:02:21.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-09-13T16:02:21.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-09-13T16:02:21.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-09-13T16:02:21.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-09-13T16:02:21.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-09-13T16:02:21.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-09-13T16:02:21.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-09-13T16:02:21.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-09-13T16:02:21.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-09-13T16:02:21.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-09-13T16:02:21.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-09-13T16:02:21.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-09-13T16:02:21.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-09-13T16:02:21.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-09-13T16:02:21.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-09-13T16:02:21.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-09-13T16:02:21.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-09-13T16:02:21.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-09-13T16:02:21.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-09-13T16:02:21.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-09-13T16:02:21.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-09-13T16:02:21.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-09-13T16:02:21.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-09-13T16:02:21.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-09-13T16:02:21.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-09-13T16:02:21.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-09-13T16:02:21.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-09-13T16:02:21.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-09-13T16:02:21.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-09-13T16:02:21.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-09-13T16:02:21.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-09-13T16:02:21.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-09-13T16:02:21.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-09-13T16:02:21.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-09-13T16:02:21.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-09-13T16:02:21.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-09-13T16:02:21.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-09-13T16:02:21.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-09-13T16:02:21.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-09-13T16:02:21.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-09-13T16:02:21.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-09-13T16:02:21.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-09-13T16:02:21.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-09-13T16:02:21.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-09-13T16:02:21.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-09-13T16:02:21.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-09-13T16:02:21.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:16.572438+0000', 'last_change': '2024-09-13T16:02:16.572438+0000', 'last_active': '2024-09-13T16:02:16.572438+0000', 'last_peered': '2024-09-13T16:02:16.572438+0000', 'last_clean': '2024-09-13T16:02:16.572438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:16.572438+0000', 'last_undegraded': '2024-09-13T16:02:16.572438+0000', 'last_fullsized': '2024-09-13T16:02:16.572438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:16.572438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-09-13T16:02:21.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T16:02:15.569550+0000', 'last_change': '2024-09-13T16:02:15.569550+0000', 'last_active': '2024-09-13T16:02:15.569550+0000', 'last_peered': '2024-09-13T16:02:15.569550+0000', 'last_clean': '2024-09-13T16:02:15.569550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T16:02:15.569550+0000', 'last_undegraded': '2024-09-13T16:02:15.569550+0000', 'last_fullsized': '2024-09-13T16:02:15.569550+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'last_clean_scrub_stamp': '2024-09-13T16:02:15.569550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T16:02:21.970 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T16:02:22.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.138+0000 7fe943e00640 1 Processor -- start 2024-09-13T16:02:22.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.138+0000 7fe943e00640 1 -- start start 2024-09-13T16:02:22.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.140+0000 7fe943e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe944071560 0x7fe9440ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:22.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.140+0000 7fe943e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe94406f4b0 0x7fe9440b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:22.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.140+0000 7fe943e00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9440cd850 con 0x7fe944159480 2024-09-13T16:02:22.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.140+0000 7fe943e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9440cd570 con 0x7fe944071560 2024-09-13T16:02:22.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.140+0000 7fe943e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440b1740 con 0x7fe94406f4b0 2024-09-13T16:02:22.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.140+0000 7fe942a00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe944159480 0x7fe944070e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:43180/0 (socket says 172.21.15.70:43180) 2024-09-13T16:02:22.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.140+0000 7fe942a00640 1 -- 172.21.15.70:0/3574300796 learned_addr learned my addr 172.21.15.70:0/3574300796 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:22.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.140+0000 7fe943400640 1 --2- 172.21.15.70:0/3574300796 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe94406f4b0 0x7fe9440b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:22.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.140+0000 7fe93a000640 1 --2- 172.21.15.70:0/3574300796 >> v2:172.21.15.107:3300/0 conn(0x7fe944071560 0x7fe9440ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:22.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.140+0000 7fe942000640 1 -- 172.21.15.70:0/3574300796 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146573272 0 0) 0x7fe9440cd850 con 0x7fe944159480 2024-09-13T16:02:22.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.140+0000 7fe942000640 1 -- 172.21.15.70:0/3574300796 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe928005730 con 0x7fe944159480 2024-09-13T16:02:22.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.141+0000 7fe943400640 1 -- 172.21.15.70:0/3574300796 >> v2:172.21.15.107:3300/0 conn(0x7fe944071560 msgr2=0x7fe9440ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:22.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.141+0000 7fe943400640 1 --2- 172.21.15.70:0/3574300796 >> v2:172.21.15.107:3300/0 conn(0x7fe944071560 0x7fe9440ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.141+0000 7fe943400640 1 -- 172.21.15.70:0/3574300796 >> v1:172.21.15.70:6789/0 conn(0x7fe944159480 legacy=0x7fe944070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:22.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.141+0000 7fe943400640 1 -- 172.21.15.70:0/3574300796 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9440b1a20 con 0x7fe94406f4b0 2024-09-13T16:02:22.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.141+0000 7fe93a000640 1 --2- 172.21.15.70:0/3574300796 >> v2:172.21.15.107:3300/0 conn(0x7fe944071560 0x7fe9440ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:22.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.142+0000 7fe943400640 1 --2- 172.21.15.70:0/3574300796 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe94406f4b0 0x7fe9440b2220 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009d90 tx=0x7fe93c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c56236845061b05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:22.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.142+0000 7fe942000640 1 -- 172.21.15.70:0/3574300796 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c031600 con 0x7fe94406f4b0 2024-09-13T16:02:22.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.142+0000 7fe942000640 1 -- 172.21.15.70:0/3574300796 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c02d050 con 0x7fe94406f4b0 2024-09-13T16:02:22.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.142+0000 7fe942000640 1 -- 172.21.15.70:0/3574300796 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c031960 con 0x7fe94406f4b0 2024-09-13T16:02:22.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.142+0000 7fe943e00640 1 -- 172.21.15.70:0/3574300796 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe94406f4b0 msgr2=0x7fe9440b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:22.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.142+0000 7fe943e00640 1 --2- 172.21.15.70:0/3574300796 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe94406f4b0 0x7fe9440b2220 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009d90 tx=0x7fe93c02a5d0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.142+0000 7fe943e00640 1 -- 172.21.15.70:0/3574300796 shutdown_connections 2024-09-13T16:02:22.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.142+0000 7fe943e00640 1 --2- 172.21.15.70:0/3574300796 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe94406f4b0 0x7fe9440b2220 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.142+0000 7fe943e00640 1 --2- 172.21.15.70:0/3574300796 >> v2:172.21.15.107:3300/0 conn(0x7fe944071560 0x7fe9440ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.142+0000 7fe943e00640 1 -- 172.21.15.70:0/3574300796 >> 172.21.15.70:0/3574300796 conn(0x7fe9440ae310 msgr2=0x7fe9440ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:22.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.143+0000 7fe943e00640 1 -- 172.21.15.70:0/3574300796 shutdown_connections 2024-09-13T16:02:22.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.143+0000 7fe943e00640 1 -- 172.21.15.70:0/3574300796 wait complete. 2024-09-13T16:02:22.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.144+0000 7fe943e00640 1 Processor -- start 2024-09-13T16:02:22.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.144+0000 7fe943e00640 1 -- start start 2024-09-13T16:02:22.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.145+0000 7fe943e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe94406f4b0 0x7fe94414df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:22.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.145+0000 7fe943e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe944071560 0x7fe9440c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.145+0000 7fe943e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe944159480 0x7fe9440abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.145+0000 7fe943e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440c5510 con 0x7fe94406f4b0 2024-09-13T16:02:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.145+0000 7fe943e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94414e480 con 0x7fe944159480 2024-09-13T16:02:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.145+0000 7fe943e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9441f2270 con 0x7fe944071560 2024-09-13T16:02:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.145+0000 7fe942a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe94406f4b0 0x7fe94414df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.145+0000 7fe942a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe94406f4b0 0x7fe94414df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37062/0 (socket says 172.21.15.70:37062) 2024-09-13T16:02:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.145+0000 7fe942a00640 1 -- 172.21.15.70:0/2779501998 learned_addr learned my addr 172.21.15.70:0/2779501998 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.146+0000 7fe93a000640 1 --2- 172.21.15.70:0/2779501998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe944071560 0x7fe9440c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.146+0000 7fe943400640 1 --2- 172.21.15.70:0/2779501998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe944159480 0x7fe9440abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.146+0000 7fe942a00640 1 -- 172.21.15.70:0/2779501998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe944071560 msgr2=0x7fe9440c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.146+0000 7fe942a00640 1 --2- 172.21.15.70:0/2779501998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe944071560 0x7fe9440c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.146+0000 7fe942a00640 1 -- 172.21.15.70:0/2779501998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe944159480 msgr2=0x7fe9440abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.146+0000 7fe942a00640 1 --2- 172.21.15.70:0/2779501998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe944159480 0x7fe9440abfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.146+0000 7fe942a00640 1 -- 172.21.15.70:0/2779501998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c009400 con 0x7fe94406f4b0 2024-09-13T16:02:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.146+0000 7fe942a00640 1 --2- 172.21.15.70:0/2779501998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe94406f4b0 0x7fe94414df40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe93400c440 tx=0x7fe93400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.146+0000 7fe93be00640 1 -- 172.21.15.70:0/2779501998 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934005ce0 con 0x7fe94406f4b0 2024-09-13T16:02:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.146+0000 7fe93be00640 1 -- 172.21.15.70:0/2779501998 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe934005e40 con 0x7fe94406f4b0 2024-09-13T16:02:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.146+0000 7fe93be00640 1 -- 172.21.15.70:0/2779501998 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9340072b0 con 0x7fe94406f4b0 2024-09-13T16:02:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.146+0000 7fe943e00640 1 -- 172.21.15.70:0/2779501998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93c009a70 con 0x7fe94406f4b0 2024-09-13T16:02:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.147+0000 7fe943e00640 1 -- 172.21.15.70:0/2779501998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9440c4c70 con 0x7fe94406f4b0 2024-09-13T16:02:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.148+0000 7fe943e00640 1 -- 172.21.15.70:0/2779501998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe944067360 con 0x7fe94406f4b0 2024-09-13T16:02:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.149+0000 7fe93be00640 1 -- 172.21.15.70:0/2779501998 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe934007410 con 0x7fe94406f4b0 2024-09-13T16:02:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.149+0000 7fe93be00640 1 --2- 172.21.15.70:0/2779501998 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe92006ac00 0x7fe92006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.150+0000 7fe93be00640 1 -- 172.21.15.70:0/2779501998 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe934088930 con 0x7fe94406f4b0 2024-09-13T16:02:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.150+0000 7fe93a000640 1 --2- 172.21.15.70:0/2779501998 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe92006ac00 0x7fe92006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.150+0000 7fe93a000640 1 --2- 172.21.15.70:0/2779501998 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe92006ac00 0x7fe92006d0c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe944155710 tx=0x7fe92c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.154+0000 7fe93be00640 1 -- 172.21.15.70:0/2779501998 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe934053b50 con 0x7fe94406f4b0 2024-09-13T16:02:22.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.383+0000 7fe943e00640 1 -- 172.21.15.70:0/2779501998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe94406ef90 con 0x7fe94406f4b0 2024-09-13T16:02:22.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.383+0000 7fe93be00640 1 -- 172.21.15.70:0/2779501998 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1569 (secure 0 0 0) 0x7fe934017020 con 0x7fe94406f4b0 2024-09-13T16:02:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:22.385 INFO:teuthology.orchestra.run.smithi070.stdout:{"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":89,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1726243265,"num_in_osds":8,"osd_in_since":1726243256,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":242032640,"bytes_avail":772852080640,"bytes_total":773094113280,"unknown_pgs_ratio":0.98969072103500366},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5127}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-09-13T16:02:06.026531+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T16:02:22.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.385+0000 7fe943e00640 1 -- 172.21.15.70:0/2779501998 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe92006ac00 msgr2=0x7fe92006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:22.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.385+0000 7fe943e00640 1 --2- 172.21.15.70:0/2779501998 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe92006ac00 0x7fe92006d0c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe944155710 tx=0x7fe92c009190 comp rx=0 tx=0).stop 2024-09-13T16:02:22.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.385+0000 7fe943e00640 1 -- 172.21.15.70:0/2779501998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe94406f4b0 msgr2=0x7fe94414df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:22.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.385+0000 7fe943e00640 1 --2- 172.21.15.70:0/2779501998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe94406f4b0 0x7fe94414df40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe93400c440 tx=0x7fe93400c900 comp rx=0 tx=0).stop 2024-09-13T16:02:22.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.385+0000 7fe943e00640 1 -- 172.21.15.70:0/2779501998 shutdown_connections 2024-09-13T16:02:22.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.385+0000 7fe943e00640 1 --2- 172.21.15.70:0/2779501998 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe92006ac00 0x7fe92006d0c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.385+0000 7fe943e00640 1 --2- 172.21.15.70:0/2779501998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe944159480 0x7fe9440abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.385+0000 7fe943e00640 1 --2- 172.21.15.70:0/2779501998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe944071560 0x7fe9440c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.385+0000 7fe943e00640 1 --2- 172.21.15.70:0/2779501998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe94406f4b0 0x7fe94414df40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.385+0000 7fe943e00640 1 -- 172.21.15.70:0/2779501998 >> 172.21.15.70:0/2779501998 conn(0x7fe9440ae310 msgr2=0x7fe9440cb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:22.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.386+0000 7fe943e00640 1 -- 172.21.15.70:0/2779501998 shutdown_connections 2024-09-13T16:02:22.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.386+0000 7fe943e00640 1 -- 172.21.15.70:0/2779501998 wait complete. 2024-09-13T16:02:22.402 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T16:02:22.402 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T16:02:22.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.552+0000 7f4b83c00640 1 Processor -- start 2024-09-13T16:02:22.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.552+0000 7f4b83c00640 1 -- start start 2024-09-13T16:02:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.553+0000 7f4b83c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b7c0b1b00 0x7f4b7c0cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.553+0000 7f4b83c00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4b7c0cde50 0x7f4b7c15a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.554+0000 7f4b83c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7c06bea0 con 0x7f4b7c15a520 2024-09-13T16:02:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.554+0000 7f4b83c00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7c06c180 con 0x7f4b7c0cde50 2024-09-13T16:02:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.554+0000 7f4b83c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7c06c460 con 0x7f4b7c0b1b00 2024-09-13T16:02:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.554+0000 7f4b81c00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4b7c0cde50 0x7f4b7c15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:22.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.554+0000 7f4b81c00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4b7c0cde50 0x7f4b7c15a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37076/0 (socket says 172.21.15.70:37076) 2024-09-13T16:02:22.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.554+0000 7f4b81c00640 1 -- 172.21.15.70:0/850033822 learned_addr learned my addr 172.21.15.70:0/850033822 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:22.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.554+0000 7f4b73e00640 1 --2- 172.21.15.70:0/850033822 >> v2:172.21.15.107:3300/0 conn(0x7f4b7c0b1b00 0x7f4b7c0cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:22.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.554+0000 7f4b81c00640 1 -- 172.21.15.70:0/850033822 >> v2:172.21.15.107:3300/0 conn(0x7f4b7c0b1b00 msgr2=0x7f4b7c0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:22.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.554+0000 7f4b81c00640 1 --2- 172.21.15.70:0/850033822 >> v2:172.21.15.107:3300/0 conn(0x7f4b7c0b1b00 0x7f4b7c0cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.554+0000 7f4b81c00640 1 -- 172.21.15.70:0/850033822 >> v1:172.21.15.107:6789/0 conn(0x7f4b7c15a520 legacy=0x7f4b7c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:22.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.554+0000 7f4b81c00640 1 -- 172.21.15.70:0/850033822 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c06c740 con 0x7f4b7c0cde50 2024-09-13T16:02:22.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.554+0000 7f4b73e00640 1 --2- 172.21.15.70:0/850033822 >> v2:172.21.15.107:3300/0 conn(0x7f4b7c0b1b00 0x7f4b7c0cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:22.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.555+0000 7f4b81c00640 1 --2- 172.21.15.70:0/850033822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b7c0cde50 0x7f4b7c15a900 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c06bdd0 tx=0x7f4b7402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d604095bedf8349c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:22.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.556+0000 7f4b7be00640 1 -- 172.21.15.70:0/850033822 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b74031600 con 0x7f4b7c0cde50 2024-09-13T16:02:22.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.556+0000 7f4b7be00640 1 -- 172.21.15.70:0/850033822 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7402d050 con 0x7f4b7c0cde50 2024-09-13T16:02:22.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.556+0000 7f4b7be00640 1 -- 172.21.15.70:0/850033822 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b74031980 con 0x7f4b7c0cde50 2024-09-13T16:02:22.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.556+0000 7f4b83c00640 1 -- 172.21.15.70:0/850033822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b7c0cde50 msgr2=0x7f4b7c15a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:22.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.556+0000 7f4b83c00640 1 --2- 172.21.15.70:0/850033822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b7c0cde50 0x7f4b7c15a900 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c06bdd0 tx=0x7f4b7402a730 comp rx=0 tx=0).stop 2024-09-13T16:02:22.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.556+0000 7f4b83c00640 1 -- 172.21.15.70:0/850033822 shutdown_connections 2024-09-13T16:02:22.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.556+0000 7f4b83c00640 1 --2- 172.21.15.70:0/850033822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b7c0cde50 0x7f4b7c15a900 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.556+0000 7f4b83c00640 1 --2- 172.21.15.70:0/850033822 >> v2:172.21.15.107:3300/0 conn(0x7f4b7c0b1b00 0x7f4b7c0cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.556+0000 7f4b83c00640 1 -- 172.21.15.70:0/850033822 >> 172.21.15.70:0/850033822 conn(0x7f4b7c0b0510 msgr2=0x7f4b7c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:22.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.556+0000 7f4b83c00640 1 -- 172.21.15.70:0/850033822 shutdown_connections 2024-09-13T16:02:22.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.556+0000 7f4b83c00640 1 -- 172.21.15.70:0/850033822 wait complete. 2024-09-13T16:02:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.558+0000 7f4b83c00640 1 Processor -- start 2024-09-13T16:02:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.558+0000 7f4b83c00640 1 -- start start 2024-09-13T16:02:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.559+0000 7f4b83c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b7c0b1b00 0x7f4b7c149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.559+0000 7f4b83c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b7c0cde50 0x7f4b7c1545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.559+0000 7f4b83c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b7c15a520 0x7f4b7c154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.559+0000 7f4b83c00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c151bb0 con 0x7f4b7c15a520 2024-09-13T16:02:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.559+0000 7f4b83c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c155180 con 0x7f4b7c0b1b00 2024-09-13T16:02:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.559+0000 7f4b83c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c153c50 con 0x7f4b7c0cde50 2024-09-13T16:02:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.559+0000 7f4b81200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b7c0b1b00 0x7f4b7c149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.559+0000 7f4b81c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b7c15a520 0x7f4b7c154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.559+0000 7f4b73e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b7c0cde50 0x7f4b7c1545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.559+0000 7f4b81200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b7c0b1b00 0x7f4b7c149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.70:42114/0 (socket says 172.21.15.70:42114) 2024-09-13T16:02:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.559+0000 7f4b81200640 1 -- 172.21.15.70:0/2991299355 learned_addr learned my addr 172.21.15.70:0/2991299355 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.560+0000 7f4b81200640 1 -- 172.21.15.70:0/2991299355 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b7c0cde50 msgr2=0x7f4b7c1545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.560+0000 7f4b81200640 1 --2- 172.21.15.70:0/2991299355 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b7c0cde50 0x7f4b7c1545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.560+0000 7f4b81200640 1 -- 172.21.15.70:0/2991299355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b7c15a520 msgr2=0x7f4b7c154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.560+0000 7f4b81200640 1 --2- 172.21.15.70:0/2991299355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b7c15a520 0x7f4b7c154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.560+0000 7f4b81200640 1 -- 172.21.15.70:0/2991299355 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b74009b30 con 0x7f4b7c0b1b00 2024-09-13T16:02:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.560+0000 7f4b73e00640 1 --2- 172.21.15.70:0/2991299355 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b7c0cde50 0x7f4b7c1545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.560+0000 7f4b81c00640 1 --2- 172.21.15.70:0/2991299355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b7c15a520 0x7f4b7c154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.560+0000 7f4b81200640 1 --2- 172.21.15.70:0/2991299355 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b7c0b1b00 0x7f4b7c149310 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00c430 tx=0x7f4b6c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:22.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.560+0000 7f4b79600640 1 -- 172.21.15.70:0/2991299355 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c0052d0 con 0x7f4b7c0b1b00 2024-09-13T16:02:22.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.560+0000 7f4b79600640 1 -- 172.21.15.70:0/2991299355 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c005430 con 0x7f4b7c0b1b00 2024-09-13T16:02:22.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.560+0000 7f4b79600640 1 -- 172.21.15.70:0/2991299355 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c003830 con 0x7f4b7c0b1b00 2024-09-13T16:02:22.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.560+0000 7f4b83c00640 1 -- 172.21.15.70:0/2991299355 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7c151210 con 0x7f4b7c0b1b00 2024-09-13T16:02:22.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.560+0000 7f4b83c00640 1 -- 172.21.15.70:0/2991299355 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7c1517d0 con 0x7f4b7c0b1b00 2024-09-13T16:02:22.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.561+0000 7f4b83c00640 1 -- 172.21.15.70:0/2991299355 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7c0cd910 con 0x7f4b7c0b1b00 2024-09-13T16:02:22.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.562+0000 7f4b79600640 1 -- 172.21.15.70:0/2991299355 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4b6c003990 con 0x7f4b7c0b1b00 2024-09-13T16:02:22.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.563+0000 7f4b79600640 1 --2- 172.21.15.70:0/2991299355 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4b5806ac00 0x7f4b5806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:22.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.563+0000 7f4b79600640 1 -- 172.21.15.70:0/2991299355 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b6c088860 con 0x7f4b7c0b1b00 2024-09-13T16:02:22.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.563+0000 7f4b73e00640 1 --2- 172.21.15.70:0/2991299355 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4b5806ac00 0x7f4b5806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:22.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.564+0000 7f4b73e00640 1 --2- 172.21.15.70:0/2991299355 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4b5806ac00 0x7f4b5806d0c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c06bb10 tx=0x7f4b64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.568+0000 7f4b79600640 1 -- 172.21.15.70:0/2991299355 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4b6c053ae0 con 0x7f4b7c0b1b00 2024-09-13T16:02:22.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.731+0000 7f4b83c00640 1 -- 172.21.15.70:0/2991299355 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b7c06cf40 con 0x7f4b5806ac00 2024-09-13T16:02:22.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.739+0000 7f4b79600640 1 -- 172.21.15.70:0/2991299355 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288936 (secure 0 0 0) 0x7f4b64009e20 con 0x7f4b5806ac00 2024-09-13T16:02:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:22.745 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-13T16:02:22.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.743+0000 7f4b83c00640 1 -- 172.21.15.70:0/2991299355 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4b5806ac00 msgr2=0x7f4b5806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:22.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.743+0000 7f4b83c00640 1 --2- 172.21.15.70:0/2991299355 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4b5806ac00 0x7f4b5806d0c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c06bb10 tx=0x7f4b64008040 comp rx=0 tx=0).stop 2024-09-13T16:02:22.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.743+0000 7f4b83c00640 1 -- 172.21.15.70:0/2991299355 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b7c0b1b00 msgr2=0x7f4b7c149310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:22.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.743+0000 7f4b83c00640 1 --2- 172.21.15.70:0/2991299355 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b7c0b1b00 0x7f4b7c149310 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00c430 tx=0x7f4b6c00c8f0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.743+0000 7f4b83c00640 1 -- 172.21.15.70:0/2991299355 shutdown_connections 2024-09-13T16:02:22.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.743+0000 7f4b83c00640 1 --2- 172.21.15.70:0/2991299355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b7c15a520 0x7f4b7c154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.743+0000 7f4b83c00640 1 --2- 172.21.15.70:0/2991299355 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b7c0cde50 0x7f4b7c1545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.743+0000 7f4b83c00640 1 --2- 172.21.15.70:0/2991299355 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4b5806ac00 0x7f4b5806d0c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.743+0000 7f4b83c00640 1 --2- 172.21.15.70:0/2991299355 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b7c0b1b00 0x7f4b7c149310 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:22.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.743+0000 7f4b83c00640 1 -- 172.21.15.70:0/2991299355 >> 172.21.15.70:0/2991299355 conn(0x7f4b7c0b0510 msgr2=0x7f4b7c157960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:22.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.743+0000 7f4b83c00640 1 -- 172.21.15.70:0/2991299355 shutdown_connections 2024-09-13T16:02:22.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:22.743+0000 7f4b83c00640 1 -- 172.21.15.70:0/2991299355 wait complete. 2024-09-13T16:02:22.762 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-09-13T16:02:22.029215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236836,"kb_used_data":4228,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737884,"statfs":{"total":773094113280,"available":772851593216,"internally_reserved":0,"allocated":4329472,"data_stored":2399537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000954"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.007230+0000","last_change":"2024-09-13T16:02:17.021012+0000","last_active":"2024-09-13T16:02:18.007230+0000","last_peered":"2024-09-13T16:02:18.007230+0000","last_clean":"2024-09-13T16:02:18.007230+0000","last_became_active":"2024-09-13T16:02:17.020660+0000","last_became_peered":"2024-09-13T16:02:17.020660+0000","last_unstale":"2024-09-13T16:02:18.007230+0000","last_undegraded":"2024-09-13T16:02:18.007230+0000","last_fullsized":"2024-09-13T16:02:18.007230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:28.254349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002965+0000","last_change":"2024-09-13T16:02:17.021879+0000","last_active":"2024-09-13T16:02:18.002965+0000","last_peered":"2024-09-13T16:02:18.002965+0000","last_clean":"2024-09-13T16:02:18.002965+0000","last_became_active":"2024-09-13T16:02:17.021244+0000","last_became_peered":"2024-09-13T16:02:17.021244+0000","last_unstale":"2024-09-13T16:02:18.002965+0000","last_undegraded":"2024-09-13T16:02:18.002965+0000","last_fullsized":"2024-09-13T16:02:18.002965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:44.295154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077900+0000","last_change":"2024-09-13T16:02:17.007300+0000","last_active":"2024-09-13T16:02:18.077900+0000","last_peered":"2024-09-13T16:02:18.077900+0000","last_clean":"2024-09-13T16:02:18.077900+0000","last_became_active":"2024-09-13T16:02:17.006382+0000","last_became_peered":"2024-09-13T16:02:17.006382+0000","last_unstale":"2024-09-13T16:02:18.077900+0000","last_undegraded":"2024-09-13T16:02:18.077900+0000","last_fullsized":"2024-09-13T16:02:18.077900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:20.591873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077523+0000","last_change":"2024-09-13T16:02:17.011728+0000","last_active":"2024-09-13T16:02:18.077523+0000","last_peered":"2024-09-13T16:02:18.077523+0000","last_clean":"2024-09-13T16:02:18.077523+0000","last_became_active":"2024-09-13T16:02:17.011492+0000","last_became_peered":"2024-09-13T16:02:17.011492+0000","last_unstale":"2024-09-13T16:02:18.077523+0000","last_undegraded":"2024-09-13T16:02:18.077523+0000","last_fullsized":"2024-09-13T16:02:18.077523+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:58.121306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.076986+0000","last_change":"2024-09-13T16:02:17.027754+0000","last_active":"2024-09-13T16:02:18.076986+0000","last_peered":"2024-09-13T16:02:18.076986+0000","last_clean":"2024-09-13T16:02:18.076986+0000","last_became_active":"2024-09-13T16:02:17.027467+0000","last_became_peered":"2024-09-13T16:02:17.027467+0000","last_unstale":"2024-09-13T16:02:18.076986+0000","last_undegraded":"2024-09-13T16:02:18.076986+0000","last_fullsized":"2024-09-13T16:02:18.076986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:15.496238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002672+0000","last_change":"2024-09-13T16:02:17.020269+0000","last_active":"2024-09-13T16:02:18.002672+0000","last_peered":"2024-09-13T16:02:18.002672+0000","last_clean":"2024-09-13T16:02:18.002672+0000","last_became_active":"2024-09-13T16:02:17.019590+0000","last_became_peered":"2024-09-13T16:02:17.019590+0000","last_unstale":"2024-09-13T16:02:18.002672+0000","last_undegraded":"2024-09-13T16:02:18.002672+0000","last_fullsized":"2024-09-13T16:02:18.002672+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:14.145772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006964+0000","last_change":"2024-09-13T16:02:17.020290+0000","last_active":"2024-09-13T16:02:18.006964+0000","last_peered":"2024-09-13T16:02:18.006964+0000","last_clean":"2024-09-13T16:02:18.006964+0000","last_became_active":"2024-09-13T16:02:17.020046+0000","last_became_peered":"2024-09-13T16:02:17.020046+0000","last_unstale":"2024-09-13T16:02:18.006964+0000","last_undegraded":"2024-09-13T16:02:18.006964+0000","last_fullsized":"2024-09-13T16:02:18.006964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:00.588775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006298+0000","last_change":"2024-09-13T16:02:17.010117+0000","last_active":"2024-09-13T16:02:18.006298+0000","last_peered":"2024-09-13T16:02:18.006298+0000","last_clean":"2024-09-13T16:02:18.006298+0000","last_became_active":"2024-09-13T16:02:17.009801+0000","last_became_peered":"2024-09-13T16:02:17.009801+0000","last_unstale":"2024-09-13T16:02:18.006298+0000","last_undegraded":"2024-09-13T16:02:18.006298+0000","last_fullsized":"2024-09-13T16:02:18.006298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:14.145772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078340+0000","last_change":"2024-09-13T16:02:17.011837+0000","last_active":"2024-09-13T16:02:18.078340+0000","last_peered":"2024-09-13T16:02:18.078340+0000","last_clean":"2024-09-13T16:02:18.078340+0000","last_became_active":"2024-09-13T16:02:17.011536+0000","last_became_peered":"2024-09-13T16:02:17.011536+0000","last_unstale":"2024-09-13T16:02:18.078340+0000","last_undegraded":"2024-09-13T16:02:18.078340+0000","last_fullsized":"2024-09-13T16:02:18.078340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:49.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078326+0000","last_change":"2024-09-13T16:02:17.024979+0000","last_active":"2024-09-13T16:02:18.078326+0000","last_peered":"2024-09-13T16:02:18.078326+0000","last_clean":"2024-09-13T16:02:18.078326+0000","last_became_active":"2024-09-13T16:02:17.024674+0000","last_became_peered":"2024-09-13T16:02:17.024674+0000","last_unstale":"2024-09-13T16:02:18.078326+0000","last_undegraded":"2024-09-13T16:02:18.078326+0000","last_fullsized":"2024-09-13T16:02:18.078326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:26.844415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006900+0000","last_change":"2024-09-13T16:02:17.022787+0000","last_active":"2024-09-13T16:02:18.006900+0000","last_peered":"2024-09-13T16:02:18.006900+0000","last_clean":"2024-09-13T16:02:18.006900+0000","last_became_active":"2024-09-13T16:02:17.022512+0000","last_became_peered":"2024-09-13T16:02:17.022512+0000","last_unstale":"2024-09-13T16:02:18.006900+0000","last_undegraded":"2024-09-13T16:02:18.006900+0000","last_fullsized":"2024-09-13T16:02:18.006900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:27.926940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077401+0000","last_change":"2024-09-13T16:02:17.027882+0000","last_active":"2024-09-13T16:02:18.077401+0000","last_peered":"2024-09-13T16:02:18.077401+0000","last_clean":"2024-09-13T16:02:18.077401+0000","last_became_active":"2024-09-13T16:02:17.027592+0000","last_became_peered":"2024-09-13T16:02:17.027592+0000","last_unstale":"2024-09-13T16:02:18.077401+0000","last_undegraded":"2024-09-13T16:02:18.077401+0000","last_fullsized":"2024-09-13T16:02:18.077401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:45.741525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077071+0000","last_change":"2024-09-13T16:02:17.007215+0000","last_active":"2024-09-13T16:02:18.077071+0000","last_peered":"2024-09-13T16:02:18.077071+0000","last_clean":"2024-09-13T16:02:18.077071+0000","last_became_active":"2024-09-13T16:02:17.006717+0000","last_became_peered":"2024-09-13T16:02:17.006717+0000","last_unstale":"2024-09-13T16:02:18.077071+0000","last_undegraded":"2024-09-13T16:02:18.077071+0000","last_fullsized":"2024-09-13T16:02:18.077071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:30.845399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.003024+0000","last_change":"2024-09-13T16:02:17.019077+0000","last_active":"2024-09-13T16:02:18.003024+0000","last_peered":"2024-09-13T16:02:18.003024+0000","last_clean":"2024-09-13T16:02:18.003024+0000","last_became_active":"2024-09-13T16:02:17.018820+0000","last_became_peered":"2024-09-13T16:02:17.018820+0000","last_unstale":"2024-09-13T16:02:18.003024+0000","last_undegraded":"2024-09-13T16:02:18.003024+0000","last_fullsized":"2024-09-13T16:02:18.003024+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:27.926940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077065+0000","last_change":"2024-09-13T16:02:17.018837+0000","last_active":"2024-09-13T16:02:18.077065+0000","last_peered":"2024-09-13T16:02:18.077065+0000","last_clean":"2024-09-13T16:02:18.077065+0000","last_became_active":"2024-09-13T16:02:17.018038+0000","last_became_peered":"2024-09-13T16:02:17.018038+0000","last_unstale":"2024-09-13T16:02:18.077065+0000","last_undegraded":"2024-09-13T16:02:18.077065+0000","last_fullsized":"2024-09-13T16:02:18.077065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:05.504389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006546+0000","last_change":"2024-09-13T16:02:17.027377+0000","last_active":"2024-09-13T16:02:18.006546+0000","last_peered":"2024-09-13T16:02:18.006546+0000","last_clean":"2024-09-13T16:02:18.006546+0000","last_became_active":"2024-09-13T16:02:17.027093+0000","last_became_peered":"2024-09-13T16:02:17.027093+0000","last_unstale":"2024-09-13T16:02:18.006546+0000","last_undegraded":"2024-09-13T16:02:18.006546+0000","last_fullsized":"2024-09-13T16:02:18.006546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:17.638994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006900+0000","last_change":"2024-09-13T16:02:17.023031+0000","last_active":"2024-09-13T16:02:18.006900+0000","last_peered":"2024-09-13T16:02:18.006900+0000","last_clean":"2024-09-13T16:02:18.006900+0000","last_became_active":"2024-09-13T16:02:17.022067+0000","last_became_peered":"2024-09-13T16:02:17.022067+0000","last_unstale":"2024-09-13T16:02:18.006900+0000","last_undegraded":"2024-09-13T16:02:18.006900+0000","last_fullsized":"2024-09-13T16:02:18.006900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:20.591873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.003095+0000","last_change":"2024-09-13T16:02:17.021576+0000","last_active":"2024-09-13T16:02:18.003095+0000","last_peered":"2024-09-13T16:02:18.003095+0000","last_clean":"2024-09-13T16:02:18.003095+0000","last_became_active":"2024-09-13T16:02:17.021020+0000","last_became_peered":"2024-09-13T16:02:17.021020+0000","last_unstale":"2024-09-13T16:02:18.003095+0000","last_undegraded":"2024-09-13T16:02:18.003095+0000","last_fullsized":"2024-09-13T16:02:18.003095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:05.504389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.003282+0000","last_change":"2024-09-13T16:02:17.019110+0000","last_active":"2024-09-13T16:02:18.003282+0000","last_peered":"2024-09-13T16:02:18.003282+0000","last_clean":"2024-09-13T16:02:18.003282+0000","last_became_active":"2024-09-13T16:02:17.018551+0000","last_became_peered":"2024-09-13T16:02:17.018551+0000","last_unstale":"2024-09-13T16:02:18.003282+0000","last_undegraded":"2024-09-13T16:02:18.003282+0000","last_fullsized":"2024-09-13T16:02:18.003282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:31.184566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077251+0000","last_change":"2024-09-13T16:02:17.014534+0000","last_active":"2024-09-13T16:02:18.077251+0000","last_peered":"2024-09-13T16:02:18.077251+0000","last_clean":"2024-09-13T16:02:18.077251+0000","last_became_active":"2024-09-13T16:02:17.011972+0000","last_became_peered":"2024-09-13T16:02:17.011972+0000","last_unstale":"2024-09-13T16:02:18.077251+0000","last_undegraded":"2024-09-13T16:02:18.077251+0000","last_fullsized":"2024-09-13T16:02:18.077251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:28.254349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077548+0000","last_change":"2024-09-13T16:02:17.014720+0000","last_active":"2024-09-13T16:02:18.077548+0000","last_peered":"2024-09-13T16:02:18.077548+0000","last_clean":"2024-09-13T16:02:18.077548+0000","last_became_active":"2024-09-13T16:02:17.014400+0000","last_became_peered":"2024-09-13T16:02:17.014400+0000","last_unstale":"2024-09-13T16:02:18.077548+0000","last_undegraded":"2024-09-13T16:02:18.077548+0000","last_fullsized":"2024-09-13T16:02:18.077548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:55.033127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077655+0000","last_change":"2024-09-13T16:02:17.025219+0000","last_active":"2024-09-13T16:02:18.077655+0000","last_peered":"2024-09-13T16:02:18.077655+0000","last_clean":"2024-09-13T16:02:18.077655+0000","last_became_active":"2024-09-13T16:02:17.023947+0000","last_became_peered":"2024-09-13T16:02:17.023947+0000","last_unstale":"2024-09-13T16:02:18.077655+0000","last_undegraded":"2024-09-13T16:02:18.077655+0000","last_fullsized":"2024-09-13T16:02:18.077655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:30.845399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077686+0000","last_change":"2024-09-13T16:02:17.006524+0000","last_active":"2024-09-13T16:02:18.077686+0000","last_peered":"2024-09-13T16:02:18.077686+0000","last_clean":"2024-09-13T16:02:18.077686+0000","last_became_active":"2024-09-13T16:02:17.006275+0000","last_became_peered":"2024-09-13T16:02:17.006275+0000","last_unstale":"2024-09-13T16:02:18.077686+0000","last_undegraded":"2024-09-13T16:02:18.077686+0000","last_fullsized":"2024-09-13T16:02:18.077686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:55.033127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077009+0000","last_change":"2024-09-13T16:02:17.009472+0000","last_active":"2024-09-13T16:02:18.077009+0000","last_peered":"2024-09-13T16:02:18.077009+0000","last_clean":"2024-09-13T16:02:18.077009+0000","last_became_active":"2024-09-13T16:02:17.009218+0000","last_became_peered":"2024-09-13T16:02:17.009218+0000","last_unstale":"2024-09-13T16:02:18.077009+0000","last_undegraded":"2024-09-13T16:02:18.077009+0000","last_fullsized":"2024-09-13T16:02:18.077009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:29:56.946020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078232+0000","last_change":"2024-09-13T16:02:17.010803+0000","last_active":"2024-09-13T16:02:18.078232+0000","last_peered":"2024-09-13T16:02:18.078232+0000","last_clean":"2024-09-13T16:02:18.078232+0000","last_became_active":"2024-09-13T16:02:17.010510+0000","last_became_peered":"2024-09-13T16:02:17.010510+0000","last_unstale":"2024-09-13T16:02:18.078232+0000","last_undegraded":"2024-09-13T16:02:18.078232+0000","last_fullsized":"2024-09-13T16:02:18.078232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:20.591873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.003079+0000","last_change":"2024-09-13T16:02:17.021426+0000","last_active":"2024-09-13T16:02:18.003079+0000","last_peered":"2024-09-13T16:02:18.003079+0000","last_clean":"2024-09-13T16:02:18.003079+0000","last_became_active":"2024-09-13T16:02:17.020812+0000","last_became_peered":"2024-09-13T16:02:17.020812+0000","last_unstale":"2024-09-13T16:02:18.003079+0000","last_undegraded":"2024-09-13T16:02:18.003079+0000","last_fullsized":"2024-09-13T16:02:18.003079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:45.741525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078015+0000","last_change":"2024-09-13T16:02:17.013281+0000","last_active":"2024-09-13T16:02:18.078015+0000","last_peered":"2024-09-13T16:02:18.078015+0000","last_clean":"2024-09-13T16:02:18.078015+0000","last_became_active":"2024-09-13T16:02:17.012344+0000","last_became_peered":"2024-09-13T16:02:17.012344+0000","last_unstale":"2024-09-13T16:02:18.078015+0000","last_undegraded":"2024-09-13T16:02:18.078015+0000","last_fullsized":"2024-09-13T16:02:18.078015+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:05.504389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077426+0000","last_change":"2024-09-13T16:02:17.018242+0000","last_active":"2024-09-13T16:02:18.077426+0000","last_peered":"2024-09-13T16:02:18.077426+0000","last_clean":"2024-09-13T16:02:18.077426+0000","last_became_active":"2024-09-13T16:02:17.017960+0000","last_became_peered":"2024-09-13T16:02:17.017960+0000","last_unstale":"2024-09-13T16:02:18.077426+0000","last_undegraded":"2024-09-13T16:02:18.077426+0000","last_fullsized":"2024-09-13T16:02:18.077426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:59.748693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077671+0000","last_change":"2024-09-13T16:02:17.029092+0000","last_active":"2024-09-13T16:02:18.077671+0000","last_peered":"2024-09-13T16:02:18.077671+0000","last_clean":"2024-09-13T16:02:18.077671+0000","last_became_active":"2024-09-13T16:02:17.027891+0000","last_became_peered":"2024-09-13T16:02:17.027891+0000","last_unstale":"2024-09-13T16:02:18.077671+0000","last_undegraded":"2024-09-13T16:02:18.077671+0000","last_fullsized":"2024-09-13T16:02:18.077671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:28.254349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006733+0000","last_change":"2024-09-13T16:02:17.021332+0000","last_active":"2024-09-13T16:02:18.006733+0000","last_peered":"2024-09-13T16:02:18.006733+0000","last_clean":"2024-09-13T16:02:18.006733+0000","last_became_active":"2024-09-13T16:02:17.021091+0000","last_became_peered":"2024-09-13T16:02:17.021091+0000","last_unstale":"2024-09-13T16:02:18.006733+0000","last_undegraded":"2024-09-13T16:02:18.006733+0000","last_fullsized":"2024-09-13T16:02:18.006733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:58.121306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006418+0000","last_change":"2024-09-13T16:02:17.012920+0000","last_active":"2024-09-13T16:02:18.006418+0000","last_peered":"2024-09-13T16:02:18.006418+0000","last_clean":"2024-09-13T16:02:18.006418+0000","last_became_active":"2024-09-13T16:02:17.012596+0000","last_became_peered":"2024-09-13T16:02:17.012596+0000","last_unstale":"2024-09-13T16:02:18.006418+0000","last_undegraded":"2024-09-13T16:02:18.006418+0000","last_fullsized":"2024-09-13T16:02:18.006418+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:35.696966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006381+0000","last_change":"2024-09-13T16:02:17.011671+0000","last_active":"2024-09-13T16:02:18.006381+0000","last_peered":"2024-09-13T16:02:18.006381+0000","last_clean":"2024-09-13T16:02:18.006381+0000","last_became_active":"2024-09-13T16:02:17.010990+0000","last_became_peered":"2024-09-13T16:02:17.010990+0000","last_unstale":"2024-09-13T16:02:18.006381+0000","last_undegraded":"2024-09-13T16:02:18.006381+0000","last_fullsized":"2024-09-13T16:02:18.006381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:45.741525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078051+0000","last_change":"2024-09-13T16:02:17.007346+0000","last_active":"2024-09-13T16:02:18.078051+0000","last_peered":"2024-09-13T16:02:18.078051+0000","last_clean":"2024-09-13T16:02:18.078051+0000","last_became_active":"2024-09-13T16:02:17.007116+0000","last_became_peered":"2024-09-13T16:02:17.007116+0000","last_unstale":"2024-09-13T16:02:18.078051+0000","last_undegraded":"2024-09-13T16:02:18.078051+0000","last_fullsized":"2024-09-13T16:02:18.078051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:07.145543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.007298+0000","last_change":"2024-09-13T16:02:16.604406+0000","last_active":"2024-09-13T16:02:18.007298+0000","last_peered":"2024-09-13T16:02:18.007298+0000","last_clean":"2024-09-13T16:02:18.007298+0000","last_became_active":"2024-09-13T16:02:16.604140+0000","last_became_peered":"2024-09-13T16:02:16.604140+0000","last_unstale":"2024-09-13T16:02:18.007298+0000","last_undegraded":"2024-09-13T16:02:18.007298+0000","last_fullsized":"2024-09-13T16:02:18.007298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:38.758913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.007332+0000","last_change":"2024-09-13T16:02:17.026582+0000","last_active":"2024-09-13T16:02:18.007332+0000","last_peered":"2024-09-13T16:02:18.007332+0000","last_clean":"2024-09-13T16:02:18.007332+0000","last_became_active":"2024-09-13T16:02:17.026344+0000","last_became_peered":"2024-09-13T16:02:17.026344+0000","last_unstale":"2024-09-13T16:02:18.007332+0000","last_undegraded":"2024-09-13T16:02:18.007332+0000","last_fullsized":"2024-09-13T16:02:18.007332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:30.845399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078129+0000","last_change":"2024-09-13T16:02:16.601819+0000","last_active":"2024-09-13T16:02:18.078129+0000","last_peered":"2024-09-13T16:02:18.078129+0000","last_clean":"2024-09-13T16:02:18.078129+0000","last_became_active":"2024-09-13T16:02:16.601556+0000","last_became_peered":"2024-09-13T16:02:16.601556+0000","last_unstale":"2024-09-13T16:02:18.078129+0000","last_undegraded":"2024-09-13T16:02:18.078129+0000","last_fullsized":"2024-09-13T16:02:18.078129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:12.084263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078064+0000","last_change":"2024-09-13T16:02:17.028488+0000","last_active":"2024-09-13T16:02:18.078064+0000","last_peered":"2024-09-13T16:02:18.078064+0000","last_clean":"2024-09-13T16:02:18.078064+0000","last_became_active":"2024-09-13T16:02:17.028226+0000","last_became_peered":"2024-09-13T16:02:17.028226+0000","last_unstale":"2024-09-13T16:02:18.078064+0000","last_undegraded":"2024-09-13T16:02:18.078064+0000","last_fullsized":"2024-09-13T16:02:18.078064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:07.145543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.003294+0000","last_change":"2024-09-13T16:02:16.603662+0000","last_active":"2024-09-13T16:02:18.003294+0000","last_peered":"2024-09-13T16:02:18.003294+0000","last_clean":"2024-09-13T16:02:18.003294+0000","last_became_active":"2024-09-13T16:02:16.602652+0000","last_became_peered":"2024-09-13T16:02:16.602652+0000","last_unstale":"2024-09-13T16:02:18.003294+0000","last_undegraded":"2024-09-13T16:02:18.003294+0000","last_fullsized":"2024-09-13T16:02:18.003294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:14.493350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078058+0000","last_change":"2024-09-13T16:02:17.002737+0000","last_active":"2024-09-13T16:02:18.078058+0000","last_peered":"2024-09-13T16:02:18.078058+0000","last_clean":"2024-09-13T16:02:18.078058+0000","last_became_active":"2024-09-13T16:02:17.002464+0000","last_became_peered":"2024-09-13T16:02:17.002464+0000","last_unstale":"2024-09-13T16:02:18.078058+0000","last_undegraded":"2024-09-13T16:02:18.078058+0000","last_fullsized":"2024-09-13T16:02:18.078058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:59.748693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077398+0000","last_change":"2024-09-13T16:02:16.601388+0000","last_active":"2024-09-13T16:02:18.077398+0000","last_peered":"2024-09-13T16:02:18.077398+0000","last_clean":"2024-09-13T16:02:18.077398+0000","last_became_active":"2024-09-13T16:02:16.601111+0000","last_became_peered":"2024-09-13T16:02:16.601111+0000","last_unstale":"2024-09-13T16:02:18.077398+0000","last_undegraded":"2024-09-13T16:02:18.077398+0000","last_fullsized":"2024-09-13T16:02:18.077398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:09.430427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006720+0000","last_change":"2024-09-13T16:02:17.009459+0000","last_active":"2024-09-13T16:02:18.006720+0000","last_peered":"2024-09-13T16:02:18.006720+0000","last_clean":"2024-09-13T16:02:18.006720+0000","last_became_active":"2024-09-13T16:02:17.009232+0000","last_became_peered":"2024-09-13T16:02:17.009232+0000","last_unstale":"2024-09-13T16:02:18.006720+0000","last_undegraded":"2024-09-13T16:02:18.006720+0000","last_fullsized":"2024-09-13T16:02:18.006720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:53.947070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077770+0000","last_change":"2024-09-13T16:02:16.594627+0000","last_active":"2024-09-13T16:02:18.077770+0000","last_peered":"2024-09-13T16:02:18.077770+0000","last_clean":"2024-09-13T16:02:18.077770+0000","last_became_active":"2024-09-13T16:02:16.593616+0000","last_became_peered":"2024-09-13T16:02:16.593616+0000","last_unstale":"2024-09-13T16:02:18.077770+0000","last_undegraded":"2024-09-13T16:02:18.077770+0000","last_fullsized":"2024-09-13T16:02:18.077770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:57.754965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077843+0000","last_change":"2024-09-13T16:02:17.012312+0000","last_active":"2024-09-13T16:02:18.077843+0000","last_peered":"2024-09-13T16:02:18.077843+0000","last_clean":"2024-09-13T16:02:18.077843+0000","last_became_active":"2024-09-13T16:02:17.011328+0000","last_became_peered":"2024-09-13T16:02:17.011328+0000","last_unstale":"2024-09-13T16:02:18.077843+0000","last_undegraded":"2024-09-13T16:02:18.077843+0000","last_fullsized":"2024-09-13T16:02:18.077843+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:54.449652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077751+0000","last_change":"2024-09-13T16:02:16.595426+0000","last_active":"2024-09-13T16:02:18.077751+0000","last_peered":"2024-09-13T16:02:18.077751+0000","last_clean":"2024-09-13T16:02:18.077751+0000","last_became_active":"2024-09-13T16:02:16.595174+0000","last_became_peered":"2024-09-13T16:02:16.595174+0000","last_unstale":"2024-09-13T16:02:18.077751+0000","last_undegraded":"2024-09-13T16:02:18.077751+0000","last_fullsized":"2024-09-13T16:02:18.077751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:38.758913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077377+0000","last_change":"2024-09-13T16:02:17.009384+0000","last_active":"2024-09-13T16:02:18.077377+0000","last_peered":"2024-09-13T16:02:18.077377+0000","last_clean":"2024-09-13T16:02:18.077377+0000","last_became_active":"2024-09-13T16:02:17.007174+0000","last_became_peered":"2024-09-13T16:02:17.007174+0000","last_unstale":"2024-09-13T16:02:18.077377+0000","last_undegraded":"2024-09-13T16:02:18.077377+0000","last_fullsized":"2024-09-13T16:02:18.077377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:26.844415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002586+0000","last_change":"2024-09-13T16:02:16.599637+0000","last_active":"2024-09-13T16:02:18.002586+0000","last_peered":"2024-09-13T16:02:18.002586+0000","last_clean":"2024-09-13T16:02:18.002586+0000","last_became_active":"2024-09-13T16:02:16.599367+0000","last_became_peered":"2024-09-13T16:02:16.599367+0000","last_unstale":"2024-09-13T16:02:18.002586+0000","last_undegraded":"2024-09-13T16:02:18.002586+0000","last_fullsized":"2024-09-13T16:02:18.002586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:06.569867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077199+0000","last_change":"2024-09-13T16:02:17.001770+0000","last_active":"2024-09-13T16:02:18.077199+0000","last_peered":"2024-09-13T16:02:18.077199+0000","last_clean":"2024-09-13T16:02:18.077199+0000","last_became_active":"2024-09-13T16:02:17.001515+0000","last_became_peered":"2024-09-13T16:02:17.001515+0000","last_unstale":"2024-09-13T16:02:18.077199+0000","last_undegraded":"2024-09-13T16:02:18.077199+0000","last_fullsized":"2024-09-13T16:02:18.077199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:43.671907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077484+0000","last_change":"2024-09-13T16:02:16.600501+0000","last_active":"2024-09-13T16:02:18.077484+0000","last_peered":"2024-09-13T16:02:18.077484+0000","last_clean":"2024-09-13T16:02:18.077484+0000","last_became_active":"2024-09-13T16:02:16.600221+0000","last_became_peered":"2024-09-13T16:02:16.600221+0000","last_unstale":"2024-09-13T16:02:18.077484+0000","last_undegraded":"2024-09-13T16:02:18.077484+0000","last_fullsized":"2024-09-13T16:02:18.077484+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:14:33.855669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077472+0000","last_change":"2024-09-13T16:02:17.027887+0000","last_active":"2024-09-13T16:02:18.077472+0000","last_peered":"2024-09-13T16:02:18.077472+0000","last_clean":"2024-09-13T16:02:18.077472+0000","last_became_active":"2024-09-13T16:02:17.027578+0000","last_became_peered":"2024-09-13T16:02:17.027578+0000","last_unstale":"2024-09-13T16:02:18.077472+0000","last_undegraded":"2024-09-13T16:02:18.077472+0000","last_fullsized":"2024-09-13T16:02:18.077472+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:53.947070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.003150+0000","last_change":"2024-09-13T16:02:16.599147+0000","last_active":"2024-09-13T16:02:18.003150+0000","last_peered":"2024-09-13T16:02:18.003150+0000","last_clean":"2024-09-13T16:02:18.003150+0000","last_became_active":"2024-09-13T16:02:16.598876+0000","last_became_peered":"2024-09-13T16:02:16.598876+0000","last_unstale":"2024-09-13T16:02:18.003150+0000","last_undegraded":"2024-09-13T16:02:18.003150+0000","last_fullsized":"2024-09-13T16:02:18.003150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:29.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.003111+0000","last_change":"2024-09-13T16:02:17.024684+0000","last_active":"2024-09-13T16:02:18.003111+0000","last_peered":"2024-09-13T16:02:18.003111+0000","last_clean":"2024-09-13T16:02:18.003111+0000","last_became_active":"2024-09-13T16:02:17.024052+0000","last_became_peered":"2024-09-13T16:02:17.024052+0000","last_unstale":"2024-09-13T16:02:18.003111+0000","last_undegraded":"2024-09-13T16:02:18.003111+0000","last_fullsized":"2024-09-13T16:02:18.003111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:54.449652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078261+0000","last_change":"2024-09-13T16:02:16.595161+0000","last_active":"2024-09-13T16:02:18.078261+0000","last_peered":"2024-09-13T16:02:18.078261+0000","last_clean":"2024-09-13T16:02:18.078261+0000","last_became_active":"2024-09-13T16:02:16.594890+0000","last_became_peered":"2024-09-13T16:02:16.594890+0000","last_unstale":"2024-09-13T16:02:18.078261+0000","last_undegraded":"2024-09-13T16:02:18.078261+0000","last_fullsized":"2024-09-13T16:02:18.078261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:19.882133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002871+0000","last_change":"2024-09-13T16:02:17.026791+0000","last_active":"2024-09-13T16:02:18.002871+0000","last_peered":"2024-09-13T16:02:18.002871+0000","last_clean":"2024-09-13T16:02:18.002871+0000","last_became_active":"2024-09-13T16:02:17.026509+0000","last_became_peered":"2024-09-13T16:02:17.026509+0000","last_unstale":"2024-09-13T16:02:18.002871+0000","last_undegraded":"2024-09-13T16:02:18.002871+0000","last_fullsized":"2024-09-13T16:02:18.002871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:17.638994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077798+0000","last_change":"2024-09-13T16:02:16.606186+0000","last_active":"2024-09-13T16:02:18.077798+0000","last_peered":"2024-09-13T16:02:18.077798+0000","last_clean":"2024-09-13T16:02:18.077798+0000","last_became_active":"2024-09-13T16:02:16.605950+0000","last_became_peered":"2024-09-13T16:02:16.605950+0000","last_unstale":"2024-09-13T16:02:18.077798+0000","last_undegraded":"2024-09-13T16:02:18.077798+0000","last_fullsized":"2024-09-13T16:02:18.077798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:06.569867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077654+0000","last_change":"2024-09-13T16:02:17.008892+0000","last_active":"2024-09-13T16:02:18.077654+0000","last_peered":"2024-09-13T16:02:18.077654+0000","last_clean":"2024-09-13T16:02:18.077654+0000","last_became_active":"2024-09-13T16:02:17.008609+0000","last_became_peered":"2024-09-13T16:02:17.008609+0000","last_unstale":"2024-09-13T16:02:18.077654+0000","last_undegraded":"2024-09-13T16:02:18.077654+0000","last_fullsized":"2024-09-13T16:02:18.077654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:58.121306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002956+0000","last_change":"2024-09-13T16:02:16.591720+0000","last_active":"2024-09-13T16:02:18.002956+0000","last_peered":"2024-09-13T16:02:18.002956+0000","last_clean":"2024-09-13T16:02:18.002956+0000","last_became_active":"2024-09-13T16:02:16.591458+0000","last_became_peered":"2024-09-13T16:02:16.591458+0000","last_unstale":"2024-09-13T16:02:18.002956+0000","last_undegraded":"2024-09-13T16:02:18.002956+0000","last_fullsized":"2024-09-13T16:02:18.002956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:37.928621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077172+0000","last_change":"2024-09-13T16:02:17.005923+0000","last_active":"2024-09-13T16:02:18.077172+0000","last_peered":"2024-09-13T16:02:18.077172+0000","last_clean":"2024-09-13T16:02:18.077172+0000","last_became_active":"2024-09-13T16:02:17.004279+0000","last_became_peered":"2024-09-13T16:02:17.004279+0000","last_unstale":"2024-09-13T16:02:18.077172+0000","last_undegraded":"2024-09-13T16:02:18.077172+0000","last_fullsized":"2024-09-13T16:02:18.077172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:02.305735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077857+0000","last_change":"2024-09-13T16:02:16.602875+0000","last_active":"2024-09-13T16:02:18.077857+0000","last_peered":"2024-09-13T16:02:18.077857+0000","last_clean":"2024-09-13T16:02:18.077857+0000","last_became_active":"2024-09-13T16:02:16.602631+0000","last_became_peered":"2024-09-13T16:02:16.602631+0000","last_unstale":"2024-09-13T16:02:18.077857+0000","last_undegraded":"2024-09-13T16:02:18.077857+0000","last_fullsized":"2024-09-13T16:02:18.077857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:14.394285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002880+0000","last_change":"2024-09-13T16:02:17.019692+0000","last_active":"2024-09-13T16:02:18.002880+0000","last_peered":"2024-09-13T16:02:18.002880+0000","last_clean":"2024-09-13T16:02:18.002880+0000","last_became_active":"2024-09-13T16:02:17.019450+0000","last_became_peered":"2024-09-13T16:02:17.019450+0000","last_unstale":"2024-09-13T16:02:18.002880+0000","last_undegraded":"2024-09-13T16:02:18.002880+0000","last_fullsized":"2024-09-13T16:02:18.002880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:18.458355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077245+0000","last_change":"2024-09-13T16:02:16.594716+0000","last_active":"2024-09-13T16:02:18.077245+0000","last_peered":"2024-09-13T16:02:18.077245+0000","last_clean":"2024-09-13T16:02:18.077245+0000","last_became_active":"2024-09-13T16:02:16.594422+0000","last_became_peered":"2024-09-13T16:02:16.594422+0000","last_unstale":"2024-09-13T16:02:18.077245+0000","last_undegraded":"2024-09-13T16:02:18.077245+0000","last_fullsized":"2024-09-13T16:02:18.077245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:12.084263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006389+0000","last_change":"2024-09-13T16:02:17.011930+0000","last_active":"2024-09-13T16:02:18.006389+0000","last_peered":"2024-09-13T16:02:18.006389+0000","last_clean":"2024-09-13T16:02:18.006389+0000","last_became_active":"2024-09-13T16:02:17.011385+0000","last_became_peered":"2024-09-13T16:02:17.011385+0000","last_unstale":"2024-09-13T16:02:18.006389+0000","last_undegraded":"2024-09-13T16:02:18.006389+0000","last_fullsized":"2024-09-13T16:02:18.006389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:29:56.946020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002963+0000","last_change":"2024-09-13T16:02:16.598258+0000","last_active":"2024-09-13T16:02:18.002963+0000","last_peered":"2024-09-13T16:02:18.002963+0000","last_clean":"2024-09-13T16:02:18.002963+0000","last_became_active":"2024-09-13T16:02:16.597935+0000","last_became_peered":"2024-09-13T16:02:16.597935+0000","last_unstale":"2024-09-13T16:02:18.002963+0000","last_undegraded":"2024-09-13T16:02:18.002963+0000","last_fullsized":"2024-09-13T16:02:18.002963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:27.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006373+0000","last_change":"2024-09-13T16:02:17.021713+0000","last_active":"2024-09-13T16:02:18.006373+0000","last_peered":"2024-09-13T16:02:18.006373+0000","last_clean":"2024-09-13T16:02:18.006373+0000","last_became_active":"2024-09-13T16:02:17.021512+0000","last_became_peered":"2024-09-13T16:02:17.021512+0000","last_unstale":"2024-09-13T16:02:18.006373+0000","last_undegraded":"2024-09-13T16:02:18.006373+0000","last_fullsized":"2024-09-13T16:02:18.006373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:15.496238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002614+0000","last_change":"2024-09-13T16:02:16.592804+0000","last_active":"2024-09-13T16:02:18.002614+0000","last_peered":"2024-09-13T16:02:18.002614+0000","last_clean":"2024-09-13T16:02:18.002614+0000","last_became_active":"2024-09-13T16:02:16.589675+0000","last_became_peered":"2024-09-13T16:02:16.589675+0000","last_unstale":"2024-09-13T16:02:18.002614+0000","last_undegraded":"2024-09-13T16:02:18.002614+0000","last_fullsized":"2024-09-13T16:02:18.002614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:34.694078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078156+0000","last_change":"2024-09-13T16:02:17.009599+0000","last_active":"2024-09-13T16:02:18.078156+0000","last_peered":"2024-09-13T16:02:18.078156+0000","last_clean":"2024-09-13T16:02:18.078156+0000","last_became_active":"2024-09-13T16:02:17.009327+0000","last_became_peered":"2024-09-13T16:02:17.009327+0000","last_unstale":"2024-09-13T16:02:18.078156+0000","last_undegraded":"2024-09-13T16:02:18.078156+0000","last_fullsized":"2024-09-13T16:02:18.078156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:49.653104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078277+0000","last_change":"2024-09-13T16:02:16.590303+0000","last_active":"2024-09-13T16:02:18.078277+0000","last_peered":"2024-09-13T16:02:18.078277+0000","last_clean":"2024-09-13T16:02:18.078277+0000","last_became_active":"2024-09-13T16:02:16.588684+0000","last_became_peered":"2024-09-13T16:02:16.588684+0000","last_unstale":"2024-09-13T16:02:18.078277+0000","last_undegraded":"2024-09-13T16:02:18.078277+0000","last_fullsized":"2024-09-13T16:02:18.078277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:14.493350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077690+0000","last_change":"2024-09-13T16:02:17.005884+0000","last_active":"2024-09-13T16:02:18.077690+0000","last_peered":"2024-09-13T16:02:18.077690+0000","last_clean":"2024-09-13T16:02:18.077690+0000","last_became_active":"2024-09-13T16:02:17.005519+0000","last_became_peered":"2024-09-13T16:02:17.005519+0000","last_unstale":"2024-09-13T16:02:18.077690+0000","last_undegraded":"2024-09-13T16:02:18.077690+0000","last_fullsized":"2024-09-13T16:02:18.077690+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:49.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078161+0000","last_change":"2024-09-13T16:02:16.602658+0000","last_active":"2024-09-13T16:02:18.078161+0000","last_peered":"2024-09-13T16:02:18.078161+0000","last_clean":"2024-09-13T16:02:18.078161+0000","last_became_active":"2024-09-13T16:02:16.602281+0000","last_became_peered":"2024-09-13T16:02:16.602281+0000","last_unstale":"2024-09-13T16:02:18.078161+0000","last_undegraded":"2024-09-13T16:02:18.078161+0000","last_fullsized":"2024-09-13T16:02:18.078161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:32.769302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077579+0000","last_change":"2024-09-13T16:02:17.010957+0000","last_active":"2024-09-13T16:02:18.077579+0000","last_peered":"2024-09-13T16:02:18.077579+0000","last_clean":"2024-09-13T16:02:18.077579+0000","last_became_active":"2024-09-13T16:02:17.010715+0000","last_became_peered":"2024-09-13T16:02:17.010715+0000","last_unstale":"2024-09-13T16:02:18.077579+0000","last_undegraded":"2024-09-13T16:02:18.077579+0000","last_fullsized":"2024-09-13T16:02:18.077579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:00.588775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078259+0000","last_change":"2024-09-13T16:02:16.598347+0000","last_active":"2024-09-13T16:02:18.078259+0000","last_peered":"2024-09-13T16:02:18.078259+0000","last_clean":"2024-09-13T16:02:18.078259+0000","last_became_active":"2024-09-13T16:02:16.596589+0000","last_became_peered":"2024-09-13T16:02:16.596589+0000","last_unstale":"2024-09-13T16:02:18.078259+0000","last_undegraded":"2024-09-13T16:02:18.078259+0000","last_fullsized":"2024-09-13T16:02:18.078259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:32.486418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077307+0000","last_change":"2024-09-13T16:02:17.016873+0000","last_active":"2024-09-13T16:02:18.077307+0000","last_peered":"2024-09-13T16:02:18.077307+0000","last_clean":"2024-09-13T16:02:18.077307+0000","last_became_active":"2024-09-13T16:02:17.012593+0000","last_became_peered":"2024-09-13T16:02:17.012593+0000","last_unstale":"2024-09-13T16:02:18.077307+0000","last_undegraded":"2024-09-13T16:02:18.077307+0000","last_fullsized":"2024-09-13T16:02:18.077307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:07.145543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078051+0000","last_change":"2024-09-13T16:02:16.593657+0000","last_active":"2024-09-13T16:02:18.078051+0000","last_peered":"2024-09-13T16:02:18.078051+0000","last_clean":"2024-09-13T16:02:18.078051+0000","last_became_active":"2024-09-13T16:02:16.593327+0000","last_became_peered":"2024-09-13T16:02:16.593327+0000","last_unstale":"2024-09-13T16:02:18.078051+0000","last_undegraded":"2024-09-13T16:02:18.078051+0000","last_fullsized":"2024-09-13T16:02:18.078051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:55.806687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077525+0000","last_change":"2024-09-13T16:02:17.011616+0000","last_active":"2024-09-13T16:02:18.077525+0000","last_peered":"2024-09-13T16:02:18.077525+0000","last_clean":"2024-09-13T16:02:18.077525+0000","last_became_active":"2024-09-13T16:02:17.009920+0000","last_became_peered":"2024-09-13T16:02:17.009920+0000","last_unstale":"2024-09-13T16:02:18.077525+0000","last_undegraded":"2024-09-13T16:02:18.077525+0000","last_fullsized":"2024-09-13T16:02:18.077525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:14:43.228578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078014+0000","last_change":"2024-09-13T16:02:16.601809+0000","last_active":"2024-09-13T16:02:18.078014+0000","last_peered":"2024-09-13T16:02:18.078014+0000","last_clean":"2024-09-13T16:02:18.078014+0000","last_became_active":"2024-09-13T16:02:16.601538+0000","last_became_peered":"2024-09-13T16:02:16.601538+0000","last_unstale":"2024-09-13T16:02:18.078014+0000","last_undegraded":"2024-09-13T16:02:18.078014+0000","last_fullsized":"2024-09-13T16:02:18.078014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:10.324853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077161+0000","last_change":"2024-09-13T16:02:17.007842+0000","last_active":"2024-09-13T16:02:18.077161+0000","last_peered":"2024-09-13T16:02:18.077161+0000","last_clean":"2024-09-13T16:02:18.077161+0000","last_became_active":"2024-09-13T16:02:17.004409+0000","last_became_peered":"2024-09-13T16:02:17.004409+0000","last_unstale":"2024-09-13T16:02:18.077161+0000","last_undegraded":"2024-09-13T16:02:18.077161+0000","last_fullsized":"2024-09-13T16:02:18.077161+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:38.931509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006744+0000","last_change":"2024-09-13T16:02:16.604767+0000","last_active":"2024-09-13T16:02:18.006744+0000","last_peered":"2024-09-13T16:02:18.006744+0000","last_clean":"2024-09-13T16:02:18.006744+0000","last_became_active":"2024-09-13T16:02:16.604586+0000","last_became_peered":"2024-09-13T16:02:16.604586+0000","last_unstale":"2024-09-13T16:02:18.006744+0000","last_undegraded":"2024-09-13T16:02:18.006744+0000","last_fullsized":"2024-09-13T16:02:18.006744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:55.806687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.076986+0000","last_change":"2024-09-13T16:02:17.006721+0000","last_active":"2024-09-13T16:02:18.076986+0000","last_peered":"2024-09-13T16:02:18.076986+0000","last_clean":"2024-09-13T16:02:18.076986+0000","last_became_active":"2024-09-13T16:02:17.004077+0000","last_became_peered":"2024-09-13T16:02:17.004077+0000","last_unstale":"2024-09-13T16:02:18.076986+0000","last_undegraded":"2024-09-13T16:02:18.076986+0000","last_fullsized":"2024-09-13T16:02:18.076986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:35.696966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077385+0000","last_change":"2024-09-13T16:02:16.602660+0000","last_active":"2024-09-13T16:02:18.077385+0000","last_peered":"2024-09-13T16:02:18.077385+0000","last_clean":"2024-09-13T16:02:18.077385+0000","last_became_active":"2024-09-13T16:02:16.602389+0000","last_became_peered":"2024-09-13T16:02:16.602389+0000","last_unstale":"2024-09-13T16:02:18.077385+0000","last_undegraded":"2024-09-13T16:02:18.077385+0000","last_fullsized":"2024-09-13T16:02:18.077385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:13.942163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006547+0000","last_change":"2024-09-13T16:02:17.017027+0000","last_active":"2024-09-13T16:02:18.006547+0000","last_peered":"2024-09-13T16:02:18.006547+0000","last_clean":"2024-09-13T16:02:18.006547+0000","last_became_active":"2024-09-13T16:02:17.016771+0000","last_became_peered":"2024-09-13T16:02:17.016771+0000","last_unstale":"2024-09-13T16:02:18.006547+0000","last_undegraded":"2024-09-13T16:02:18.006547+0000","last_fullsized":"2024-09-13T16:02:18.006547+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:05.504389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.076999+0000","last_change":"2024-09-13T16:02:16.606070+0000","last_active":"2024-09-13T16:02:18.076999+0000","last_peered":"2024-09-13T16:02:18.076999+0000","last_clean":"2024-09-13T16:02:18.076999+0000","last_became_active":"2024-09-13T16:02:16.605867+0000","last_became_peered":"2024-09-13T16:02:16.605867+0000","last_unstale":"2024-09-13T16:02:18.076999+0000","last_undegraded":"2024-09-13T16:02:18.076999+0000","last_fullsized":"2024-09-13T16:02:18.076999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:34.694078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077200+0000","last_change":"2024-09-13T16:02:17.012052+0000","last_active":"2024-09-13T16:02:18.077200+0000","last_peered":"2024-09-13T16:02:18.077200+0000","last_clean":"2024-09-13T16:02:18.077200+0000","last_became_active":"2024-09-13T16:02:17.011806+0000","last_became_peered":"2024-09-13T16:02:17.011806+0000","last_unstale":"2024-09-13T16:02:18.077200+0000","last_undegraded":"2024-09-13T16:02:18.077200+0000","last_fullsized":"2024-09-13T16:02:18.077200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:55.033127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078293+0000","last_change":"2024-09-13T16:02:16.600846+0000","last_active":"2024-09-13T16:02:18.078293+0000","last_peered":"2024-09-13T16:02:18.078293+0000","last_clean":"2024-09-13T16:02:18.078293+0000","last_became_active":"2024-09-13T16:02:16.600554+0000","last_became_peered":"2024-09-13T16:02:16.600554+0000","last_unstale":"2024-09-13T16:02:18.078293+0000","last_undegraded":"2024-09-13T16:02:18.078293+0000","last_fullsized":"2024-09-13T16:02:18.078293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:06.569867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077775+0000","last_change":"2024-09-13T16:02:17.011881+0000","last_active":"2024-09-13T16:02:18.077775+0000","last_peered":"2024-09-13T16:02:18.077775+0000","last_clean":"2024-09-13T16:02:18.077775+0000","last_became_active":"2024-09-13T16:02:17.011647+0000","last_became_peered":"2024-09-13T16:02:17.011647+0000","last_unstale":"2024-09-13T16:02:18.077775+0000","last_undegraded":"2024-09-13T16:02:18.077775+0000","last_fullsized":"2024-09-13T16:02:18.077775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:00.588775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:19.564431+0000","last_change":"2024-09-13T16:02:16.602651+0000","last_active":"2024-09-13T16:02:19.564431+0000","last_peered":"2024-09-13T16:02:19.564431+0000","last_clean":"2024-09-13T16:02:19.564431+0000","last_became_active":"2024-09-13T16:02:16.602419+0000","last_became_peered":"2024-09-13T16:02:16.602419+0000","last_unstale":"2024-09-13T16:02:19.564431+0000","last_undegraded":"2024-09-13T16:02:19.564431+0000","last_fullsized":"2024-09-13T16:02:19.564431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:18.827176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077883+0000","last_change":"2024-09-13T16:02:17.006060+0000","last_active":"2024-09-13T16:02:18.077883+0000","last_peered":"2024-09-13T16:02:18.077883+0000","last_clean":"2024-09-13T16:02:18.077883+0000","last_became_active":"2024-09-13T16:02:17.005165+0000","last_became_peered":"2024-09-13T16:02:17.005165+0000","last_unstale":"2024-09-13T16:02:18.077883+0000","last_undegraded":"2024-09-13T16:02:18.077883+0000","last_fullsized":"2024-09-13T16:02:18.077883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:35:16.887890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077671+0000","last_change":"2024-09-13T16:02:16.597613+0000","last_active":"2024-09-13T16:02:18.077671+0000","last_peered":"2024-09-13T16:02:18.077671+0000","last_clean":"2024-09-13T16:02:18.077671+0000","last_became_active":"2024-09-13T16:02:16.597038+0000","last_became_peered":"2024-09-13T16:02:16.597038+0000","last_unstale":"2024-09-13T16:02:18.077671+0000","last_undegraded":"2024-09-13T16:02:18.077671+0000","last_fullsized":"2024-09-13T16:02:18.077671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:10.324853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006664+0000","last_change":"2024-09-13T16:02:17.018422+0000","last_active":"2024-09-13T16:02:18.006664+0000","last_peered":"2024-09-13T16:02:18.006664+0000","last_clean":"2024-09-13T16:02:18.006664+0000","last_became_active":"2024-09-13T16:02:17.018201+0000","last_became_peered":"2024-09-13T16:02:17.018201+0000","last_unstale":"2024-09-13T16:02:18.006664+0000","last_undegraded":"2024-09-13T16:02:18.006664+0000","last_fullsized":"2024-09-13T16:02:18.006664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:38.931509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078086+0000","last_change":"2024-09-13T16:02:16.603301+0000","last_active":"2024-09-13T16:02:18.078086+0000","last_peered":"2024-09-13T16:02:18.078086+0000","last_clean":"2024-09-13T16:02:18.078086+0000","last_became_active":"2024-09-13T16:02:16.603060+0000","last_became_peered":"2024-09-13T16:02:16.603060+0000","last_unstale":"2024-09-13T16:02:18.078086+0000","last_undegraded":"2024-09-13T16:02:18.078086+0000","last_fullsized":"2024-09-13T16:02:18.078086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:57.754965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077970+0000","last_change":"2024-09-13T16:02:17.018422+0000","last_active":"2024-09-13T16:02:18.077970+0000","last_peered":"2024-09-13T16:02:18.077970+0000","last_clean":"2024-09-13T16:02:18.077970+0000","last_became_active":"2024-09-13T16:02:17.018149+0000","last_became_peered":"2024-09-13T16:02:17.018149+0000","last_unstale":"2024-09-13T16:02:18.077970+0000","last_undegraded":"2024-09-13T16:02:18.077970+0000","last_fullsized":"2024-09-13T16:02:18.077970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:28.254349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077323+0000","last_change":"2024-09-13T16:02:16.600821+0000","last_active":"2024-09-13T16:02:18.077323+0000","last_peered":"2024-09-13T16:02:18.077323+0000","last_clean":"2024-09-13T16:02:18.077323+0000","last_became_active":"2024-09-13T16:02:16.600545+0000","last_became_peered":"2024-09-13T16:02:16.600545+0000","last_unstale":"2024-09-13T16:02:18.077323+0000","last_undegraded":"2024-09-13T16:02:18.077323+0000","last_fullsized":"2024-09-13T16:02:18.077323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:34.694078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002525+0000","last_change":"2024-09-13T16:02:17.019187+0000","last_active":"2024-09-13T16:02:18.002525+0000","last_peered":"2024-09-13T16:02:18.002525+0000","last_clean":"2024-09-13T16:02:18.002525+0000","last_became_active":"2024-09-13T16:02:17.018964+0000","last_became_peered":"2024-09-13T16:02:17.018964+0000","last_unstale":"2024-09-13T16:02:18.002525+0000","last_undegraded":"2024-09-13T16:02:18.002525+0000","last_fullsized":"2024-09-13T16:02:18.002525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:29:56.946020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077467+0000","last_change":"2024-09-13T16:02:16.599389+0000","last_active":"2024-09-13T16:02:18.077467+0000","last_peered":"2024-09-13T16:02:18.077467+0000","last_clean":"2024-09-13T16:02:18.077467+0000","last_became_active":"2024-09-13T16:02:16.599128+0000","last_became_peered":"2024-09-13T16:02:16.599128+0000","last_unstale":"2024-09-13T16:02:18.077467+0000","last_undegraded":"2024-09-13T16:02:18.077467+0000","last_fullsized":"2024-09-13T16:02:18.077467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:09.430427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077297+0000","last_change":"2024-09-13T16:02:17.024752+0000","last_active":"2024-09-13T16:02:18.077297+0000","last_peered":"2024-09-13T16:02:18.077297+0000","last_clean":"2024-09-13T16:02:18.077297+0000","last_became_active":"2024-09-13T16:02:17.024451+0000","last_became_peered":"2024-09-13T16:02:17.024451+0000","last_unstale":"2024-09-13T16:02:18.077297+0000","last_undegraded":"2024-09-13T16:02:18.077297+0000","last_fullsized":"2024-09-13T16:02:18.077297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:35:16.887890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002748+0000","last_change":"2024-09-13T16:02:16.604629+0000","last_active":"2024-09-13T16:02:18.002748+0000","last_peered":"2024-09-13T16:02:18.002748+0000","last_clean":"2024-09-13T16:02:18.002748+0000","last_became_active":"2024-09-13T16:02:16.603554+0000","last_became_peered":"2024-09-13T16:02:16.603554+0000","last_unstale":"2024-09-13T16:02:18.002748+0000","last_undegraded":"2024-09-13T16:02:18.002748+0000","last_fullsized":"2024-09-13T16:02:18.002748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:54.030239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006778+0000","last_change":"2024-09-13T16:02:17.017663+0000","last_active":"2024-09-13T16:02:18.006778+0000","last_peered":"2024-09-13T16:02:18.006778+0000","last_clean":"2024-09-13T16:02:18.006778+0000","last_became_active":"2024-09-13T16:02:17.017437+0000","last_became_peered":"2024-09-13T16:02:17.017437+0000","last_unstale":"2024-09-13T16:02:18.006778+0000","last_undegraded":"2024-09-13T16:02:18.006778+0000","last_fullsized":"2024-09-13T16:02:18.006778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:54.449652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.007041+0000","last_change":"2024-09-13T16:02:16.599664+0000","last_active":"2024-09-13T16:02:18.007041+0000","last_peered":"2024-09-13T16:02:18.007041+0000","last_clean":"2024-09-13T16:02:18.007041+0000","last_became_active":"2024-09-13T16:02:16.599369+0000","last_became_peered":"2024-09-13T16:02:16.599369+0000","last_unstale":"2024-09-13T16:02:18.007041+0000","last_undegraded":"2024-09-13T16:02:18.007041+0000","last_fullsized":"2024-09-13T16:02:18.007041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:32.769302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T16:02:17.001825+0000","last_change":"2024-09-13T16:01:07.580186+0000","last_active":"2024-09-13T16:02:17.001825+0000","last_peered":"2024-09-13T16:02:17.001825+0000","last_clean":"2024-09-13T16:02:17.001825+0000","last_became_active":"2024-09-13T16:01:07.579877+0000","last_became_peered":"2024-09-13T16:01:07.579877+0000","last_unstale":"2024-09-13T16:02:17.001825+0000","last_undegraded":"2024-09-13T16:02:17.001825+0000","last_fullsized":"2024-09-13T16:02:17.001825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_clean_scrub_stamp":"2024-09-13T16:01:06.070807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:40.645649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":742345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.89400000000000002}]},{"osd":1,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.84399999999999997}]},{"osd":2,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.86299999999999999}]},{"osd":3,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.79600000000000004}]},{"osd":4,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.621},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.81000000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.82499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":393216,"data_stored":152503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.97099999999999997}]},{"osd":1,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.94799999999999995}]},{"osd":2,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":1.022}]},{"osd":3,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.70299999999999996}]},{"osd":4,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.873}]},{"osd":5,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":1.0649999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.505}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":152559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.875},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.80400000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.1230000000000002,"5min":5.1230000000000002,"15min":5.1230000000000002},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.81899999999999995}]},{"osd":3,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.0750000000000002,"5min":5.0750000000000002,"15min":5.0750000000000002},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.83299999999999996}]},{"osd":4,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.64900000000000002}]},{"osd":6,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.745},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.89600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":151991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.75},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.72199999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.78800000000000003}]},{"osd":5,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.54900000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.66900000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":401408,"data_stored":153473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.57399999999999995}]},{"osd":1,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.49099999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.71999999999999997}]},{"osd":5,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.629}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":389120,"data_stored":151957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.443},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.63}]},{"osd":5,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.72099999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.66500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":401408,"data_stored":153473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.35799999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.377}]},{"osd":3,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.52400000000000002}]},{"osd":5,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.496}]},{"osd":7,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.55700000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":974848,"data_stored":741236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.42499999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.376},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.39400000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.51500000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:02:25.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T16:02:25.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.928+0000 7fe5a8600640 1 Processor -- start 2024-09-13T16:02:25.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.928+0000 7fe5a8600640 1 -- start start 2024-09-13T16:02:25.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.929+0000 7fe5a8600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5a015a520 0x7fe5a006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:25.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.929+0000 7fe5a8600640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe5a00b1b00 0x7fe5a00cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:25.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.929+0000 7fe5a8600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a006bc00 con 0x7fe5a00cde50 2024-09-13T16:02:25.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.929+0000 7fe5a8600640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a006bea0 con 0x7fe5a00b1b00 2024-09-13T16:02:25.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.929+0000 7fe5a8600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a006c180 con 0x7fe5a015a520 2024-09-13T16:02:25.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.929+0000 7fe5a5200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe5a00b1b00 0x7fe5a00cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:25.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.929+0000 7fe5a5200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe5a00b1b00 0x7fe5a00cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37086/0 (socket says 172.21.15.70:37086) 2024-09-13T16:02:25.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.929+0000 7fe5a5200640 1 -- 172.21.15.70:0/2602902976 learned_addr learned my addr 172.21.15.70:0/2602902976 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:25.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.930+0000 7fe5a5c00640 1 --2- 172.21.15.70:0/2602902976 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5a015a520 0x7fe5a006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:25.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.930+0000 7fe5a5200640 1 -- 172.21.15.70:0/2602902976 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5a015a520 msgr2=0x7fe5a006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:25.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.930+0000 7fe5a5200640 1 --2- 172.21.15.70:0/2602902976 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5a015a520 0x7fe5a006b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:25.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.930+0000 7fe5a5200640 1 -- 172.21.15.70:0/2602902976 >> v1:172.21.15.107:6789/0 conn(0x7fe5a00cde50 legacy=0x7fe5a00b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:25.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.930+0000 7fe5a5200640 1 -- 172.21.15.70:0/2602902976 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a006c460 con 0x7fe5a00b1b00 2024-09-13T16:02:25.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.930+0000 7fe5a5c00640 1 --2- 172.21.15.70:0/2602902976 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5a015a520 0x7fe5a006b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:25.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.931+0000 7fe5a5200640 1 --2- 172.21.15.70:0/2602902976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5a00b1b00 0x7fe5a00cd910 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0098a0 tx=0x7fe58c02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51c274f4244d90a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:25.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.931+0000 7fe59fe00640 1 -- 172.21.15.70:0/2602902976 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c032440 con 0x7fe5a00b1b00 2024-09-13T16:02:25.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.931+0000 7fe59fe00640 1 -- 172.21.15.70:0/2602902976 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c0325a0 con 0x7fe5a00b1b00 2024-09-13T16:02:25.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.931+0000 7fe59fe00640 1 -- 172.21.15.70:0/2602902976 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c032930 con 0x7fe5a00b1b00 2024-09-13T16:02:25.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.932+0000 7fe5a8600640 1 -- 172.21.15.70:0/2602902976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5a00b1b00 msgr2=0x7fe5a00cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:25.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.932+0000 7fe5a8600640 1 --2- 172.21.15.70:0/2602902976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5a00b1b00 0x7fe5a00cd910 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0098a0 tx=0x7fe58c02a290 comp rx=0 tx=0).stop 2024-09-13T16:02:25.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.932+0000 7fe5a8600640 1 -- 172.21.15.70:0/2602902976 shutdown_connections 2024-09-13T16:02:25.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.932+0000 7fe5a8600640 1 --2- 172.21.15.70:0/2602902976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5a00b1b00 0x7fe5a00cd910 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:25.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.932+0000 7fe5a8600640 1 --2- 172.21.15.70:0/2602902976 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5a015a520 0x7fe5a006b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:25.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.932+0000 7fe5a8600640 1 -- 172.21.15.70:0/2602902976 >> 172.21.15.70:0/2602902976 conn(0x7fe5a00b0510 msgr2=0x7fe5a00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:25.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.932+0000 7fe5a8600640 1 -- 172.21.15.70:0/2602902976 shutdown_connections 2024-09-13T16:02:25.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.932+0000 7fe5a8600640 1 -- 172.21.15.70:0/2602902976 wait complete. 2024-09-13T16:02:25.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.933+0000 7fe5a8600640 1 Processor -- start 2024-09-13T16:02:25.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.934+0000 7fe5a8600640 1 -- start start 2024-09-13T16:02:25.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.934+0000 7fe5a8600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5a00b1b00 0x7fe5a013f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:25.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.934+0000 7fe5a8600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5a00cde50 0x7fe5a01e7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:25.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.934+0000 7fe5a8600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5a015a520 0x7fe5a01e7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:25.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.934+0000 7fe5a8600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a0140ec0 con 0x7fe5a00b1b00 2024-09-13T16:02:25.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.934+0000 7fe5a8600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a01e5540 con 0x7fe5a015a520 2024-09-13T16:02:25.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.934+0000 7fe5a8600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a01402b0 con 0x7fe5a00cde50 2024-09-13T16:02:25.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.935+0000 7fe5a5c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5a00b1b00 0x7fe5a013f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.935+0000 7fe5a5c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5a00b1b00 0x7fe5a013f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37090/0 (socket says 172.21.15.70:37090) 2024-09-13T16:02:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.935+0000 7fe5a5c00640 1 -- 172.21.15.70:0/3197197306 learned_addr learned my addr 172.21.15.70:0/3197197306 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.935+0000 7fe5a5200640 1 --2- 172.21.15.70:0/3197197306 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5a00cde50 0x7fe5a01e7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.935+0000 7fe5a6600640 1 --2- 172.21.15.70:0/3197197306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5a015a520 0x7fe5a01e7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.935+0000 7fe5a5c00640 1 -- 172.21.15.70:0/3197197306 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5a00cde50 msgr2=0x7fe5a01e7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.935+0000 7fe5a5c00640 1 --2- 172.21.15.70:0/3197197306 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5a00cde50 0x7fe5a01e7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.935+0000 7fe5a5c00640 1 -- 172.21.15.70:0/3197197306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5a015a520 msgr2=0x7fe5a01e7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.935+0000 7fe5a5c00640 1 --2- 172.21.15.70:0/3197197306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5a015a520 0x7fe5a01e7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.935+0000 7fe5a5c00640 1 -- 172.21.15.70:0/3197197306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58c0094d0 con 0x7fe5a00b1b00 2024-09-13T16:02:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.935+0000 7fe5a5c00640 1 --2- 172.21.15.70:0/3197197306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5a00b1b00 0x7fe5a013f770 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe594007ef0 tx=0x7fe59400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.936+0000 7fe59d600640 1 -- 172.21.15.70:0/3197197306 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe594003b90 con 0x7fe5a00b1b00 2024-09-13T16:02:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.936+0000 7fe59d600640 1 -- 172.21.15.70:0/3197197306 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59400f040 con 0x7fe5a00b1b00 2024-09-13T16:02:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.936+0000 7fe59d600640 1 -- 172.21.15.70:0/3197197306 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59400de80 con 0x7fe5a00b1b00 2024-09-13T16:02:25.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.936+0000 7fe5a8600640 1 -- 172.21.15.70:0/3197197306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a0140590 con 0x7fe5a00b1b00 2024-09-13T16:02:25.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.936+0000 7fe5a8600640 1 -- 172.21.15.70:0/3197197306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a0140b50 con 0x7fe5a00b1b00 2024-09-13T16:02:25.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.937+0000 7fe5a8600640 1 -- 172.21.15.70:0/3197197306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a00cd910 con 0x7fe5a00b1b00 2024-09-13T16:02:25.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.938+0000 7fe59d600640 1 -- 172.21.15.70:0/3197197306 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe594004030 con 0x7fe5a00b1b00 2024-09-13T16:02:25.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.938+0000 7fe59d600640 1 --2- 172.21.15.70:0/3197197306 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe58006ac00 0x7fe58006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:25.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.939+0000 7fe59d600640 1 -- 172.21.15.70:0/3197197306 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5940896b0 con 0x7fe5a00b1b00 2024-09-13T16:02:25.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.939+0000 7fe5a5200640 1 --2- 172.21.15.70:0/3197197306 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe58006ac00 0x7fe58006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:25.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.939+0000 7fe5a5200640 1 --2- 172.21.15.70:0/3197197306 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe58006ac00 0x7fe58006d0c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe58c034000 tx=0x7fe58c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:25.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:25.943+0000 7fe59d600640 1 -- 172.21.15.70:0/3197197306 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe5940548a0 con 0x7fe5a00b1b00 2024-09-13T16:02:26.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.110+0000 7fe5a8600640 1 -- 172.21.15.70:0/3197197306 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe5a00ce300 con 0x7fe58006ac00 2024-09-13T16:02:26.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.117+0000 7fe59d600640 1 -- 172.21.15.70:0/3197197306 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288854 (secure 0 0 0) 0x7fe58c0329c0 con 0x7fe58006ac00 2024-09-13T16:02:26.122 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:26.123 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-13T16:02:26.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.121+0000 7fe5a8600640 1 -- 172.21.15.70:0/3197197306 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe58006ac00 msgr2=0x7fe58006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:26.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.121+0000 7fe5a8600640 1 --2- 172.21.15.70:0/3197197306 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe58006ac00 0x7fe58006d0c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe58c034000 tx=0x7fe58c02e000 comp rx=0 tx=0).stop 2024-09-13T16:02:26.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.121+0000 7fe5a8600640 1 -- 172.21.15.70:0/3197197306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5a00b1b00 msgr2=0x7fe5a013f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:26.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.121+0000 7fe5a8600640 1 --2- 172.21.15.70:0/3197197306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5a00b1b00 0x7fe5a013f770 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe594007ef0 tx=0x7fe59400d4a0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.122+0000 7fe5a8600640 1 -- 172.21.15.70:0/3197197306 shutdown_connections 2024-09-13T16:02:26.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.122+0000 7fe5a8600640 1 --2- 172.21.15.70:0/3197197306 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe58006ac00 0x7fe58006d0c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.122+0000 7fe5a8600640 1 --2- 172.21.15.70:0/3197197306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5a015a520 0x7fe5a01e7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.122+0000 7fe5a8600640 1 --2- 172.21.15.70:0/3197197306 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5a00cde50 0x7fe5a01e7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.122+0000 7fe5a8600640 1 --2- 172.21.15.70:0/3197197306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5a00b1b00 0x7fe5a013f770 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.122+0000 7fe5a8600640 1 -- 172.21.15.70:0/3197197306 >> 172.21.15.70:0/3197197306 conn(0x7fe5a00b0510 msgr2=0x7fe5a00ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:26.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.122+0000 7fe5a8600640 1 -- 172.21.15.70:0/3197197306 shutdown_connections 2024-09-13T16:02:26.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.122+0000 7fe5a8600640 1 -- 172.21.15.70:0/3197197306 wait complete. 2024-09-13T16:02:26.139 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-13T16:02:26.030083+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236836,"kb_used_data":4228,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737884,"statfs":{"total":773094113280,"available":772851593216,"internally_reserved":0,"allocated":4329472,"data_stored":2399537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.038332"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.007230+0000","last_change":"2024-09-13T16:02:17.021012+0000","last_active":"2024-09-13T16:02:18.007230+0000","last_peered":"2024-09-13T16:02:18.007230+0000","last_clean":"2024-09-13T16:02:18.007230+0000","last_became_active":"2024-09-13T16:02:17.020660+0000","last_became_peered":"2024-09-13T16:02:17.020660+0000","last_unstale":"2024-09-13T16:02:18.007230+0000","last_undegraded":"2024-09-13T16:02:18.007230+0000","last_fullsized":"2024-09-13T16:02:18.007230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:28.254349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002965+0000","last_change":"2024-09-13T16:02:17.021879+0000","last_active":"2024-09-13T16:02:18.002965+0000","last_peered":"2024-09-13T16:02:18.002965+0000","last_clean":"2024-09-13T16:02:18.002965+0000","last_became_active":"2024-09-13T16:02:17.021244+0000","last_became_peered":"2024-09-13T16:02:17.021244+0000","last_unstale":"2024-09-13T16:02:18.002965+0000","last_undegraded":"2024-09-13T16:02:18.002965+0000","last_fullsized":"2024-09-13T16:02:18.002965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:44.295154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077900+0000","last_change":"2024-09-13T16:02:17.007300+0000","last_active":"2024-09-13T16:02:18.077900+0000","last_peered":"2024-09-13T16:02:18.077900+0000","last_clean":"2024-09-13T16:02:18.077900+0000","last_became_active":"2024-09-13T16:02:17.006382+0000","last_became_peered":"2024-09-13T16:02:17.006382+0000","last_unstale":"2024-09-13T16:02:18.077900+0000","last_undegraded":"2024-09-13T16:02:18.077900+0000","last_fullsized":"2024-09-13T16:02:18.077900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:20.591873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077523+0000","last_change":"2024-09-13T16:02:17.011728+0000","last_active":"2024-09-13T16:02:18.077523+0000","last_peered":"2024-09-13T16:02:18.077523+0000","last_clean":"2024-09-13T16:02:18.077523+0000","last_became_active":"2024-09-13T16:02:17.011492+0000","last_became_peered":"2024-09-13T16:02:17.011492+0000","last_unstale":"2024-09-13T16:02:18.077523+0000","last_undegraded":"2024-09-13T16:02:18.077523+0000","last_fullsized":"2024-09-13T16:02:18.077523+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:58.121306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.076986+0000","last_change":"2024-09-13T16:02:17.027754+0000","last_active":"2024-09-13T16:02:18.076986+0000","last_peered":"2024-09-13T16:02:18.076986+0000","last_clean":"2024-09-13T16:02:18.076986+0000","last_became_active":"2024-09-13T16:02:17.027467+0000","last_became_peered":"2024-09-13T16:02:17.027467+0000","last_unstale":"2024-09-13T16:02:18.076986+0000","last_undegraded":"2024-09-13T16:02:18.076986+0000","last_fullsized":"2024-09-13T16:02:18.076986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:15.496238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002672+0000","last_change":"2024-09-13T16:02:17.020269+0000","last_active":"2024-09-13T16:02:18.002672+0000","last_peered":"2024-09-13T16:02:18.002672+0000","last_clean":"2024-09-13T16:02:18.002672+0000","last_became_active":"2024-09-13T16:02:17.019590+0000","last_became_peered":"2024-09-13T16:02:17.019590+0000","last_unstale":"2024-09-13T16:02:18.002672+0000","last_undegraded":"2024-09-13T16:02:18.002672+0000","last_fullsized":"2024-09-13T16:02:18.002672+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:14.145772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006964+0000","last_change":"2024-09-13T16:02:17.020290+0000","last_active":"2024-09-13T16:02:18.006964+0000","last_peered":"2024-09-13T16:02:18.006964+0000","last_clean":"2024-09-13T16:02:18.006964+0000","last_became_active":"2024-09-13T16:02:17.020046+0000","last_became_peered":"2024-09-13T16:02:17.020046+0000","last_unstale":"2024-09-13T16:02:18.006964+0000","last_undegraded":"2024-09-13T16:02:18.006964+0000","last_fullsized":"2024-09-13T16:02:18.006964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:00.588775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006298+0000","last_change":"2024-09-13T16:02:17.010117+0000","last_active":"2024-09-13T16:02:18.006298+0000","last_peered":"2024-09-13T16:02:18.006298+0000","last_clean":"2024-09-13T16:02:18.006298+0000","last_became_active":"2024-09-13T16:02:17.009801+0000","last_became_peered":"2024-09-13T16:02:17.009801+0000","last_unstale":"2024-09-13T16:02:18.006298+0000","last_undegraded":"2024-09-13T16:02:18.006298+0000","last_fullsized":"2024-09-13T16:02:18.006298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:14.145772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078340+0000","last_change":"2024-09-13T16:02:17.011837+0000","last_active":"2024-09-13T16:02:18.078340+0000","last_peered":"2024-09-13T16:02:18.078340+0000","last_clean":"2024-09-13T16:02:18.078340+0000","last_became_active":"2024-09-13T16:02:17.011536+0000","last_became_peered":"2024-09-13T16:02:17.011536+0000","last_unstale":"2024-09-13T16:02:18.078340+0000","last_undegraded":"2024-09-13T16:02:18.078340+0000","last_fullsized":"2024-09-13T16:02:18.078340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:49.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078326+0000","last_change":"2024-09-13T16:02:17.024979+0000","last_active":"2024-09-13T16:02:18.078326+0000","last_peered":"2024-09-13T16:02:18.078326+0000","last_clean":"2024-09-13T16:02:18.078326+0000","last_became_active":"2024-09-13T16:02:17.024674+0000","last_became_peered":"2024-09-13T16:02:17.024674+0000","last_unstale":"2024-09-13T16:02:18.078326+0000","last_undegraded":"2024-09-13T16:02:18.078326+0000","last_fullsized":"2024-09-13T16:02:18.078326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:26.844415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006900+0000","last_change":"2024-09-13T16:02:17.022787+0000","last_active":"2024-09-13T16:02:18.006900+0000","last_peered":"2024-09-13T16:02:18.006900+0000","last_clean":"2024-09-13T16:02:18.006900+0000","last_became_active":"2024-09-13T16:02:17.022512+0000","last_became_peered":"2024-09-13T16:02:17.022512+0000","last_unstale":"2024-09-13T16:02:18.006900+0000","last_undegraded":"2024-09-13T16:02:18.006900+0000","last_fullsized":"2024-09-13T16:02:18.006900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:27.926940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077401+0000","last_change":"2024-09-13T16:02:17.027882+0000","last_active":"2024-09-13T16:02:18.077401+0000","last_peered":"2024-09-13T16:02:18.077401+0000","last_clean":"2024-09-13T16:02:18.077401+0000","last_became_active":"2024-09-13T16:02:17.027592+0000","last_became_peered":"2024-09-13T16:02:17.027592+0000","last_unstale":"2024-09-13T16:02:18.077401+0000","last_undegraded":"2024-09-13T16:02:18.077401+0000","last_fullsized":"2024-09-13T16:02:18.077401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:45.741525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077071+0000","last_change":"2024-09-13T16:02:17.007215+0000","last_active":"2024-09-13T16:02:18.077071+0000","last_peered":"2024-09-13T16:02:18.077071+0000","last_clean":"2024-09-13T16:02:18.077071+0000","last_became_active":"2024-09-13T16:02:17.006717+0000","last_became_peered":"2024-09-13T16:02:17.006717+0000","last_unstale":"2024-09-13T16:02:18.077071+0000","last_undegraded":"2024-09-13T16:02:18.077071+0000","last_fullsized":"2024-09-13T16:02:18.077071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:30.845399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.003024+0000","last_change":"2024-09-13T16:02:17.019077+0000","last_active":"2024-09-13T16:02:18.003024+0000","last_peered":"2024-09-13T16:02:18.003024+0000","last_clean":"2024-09-13T16:02:18.003024+0000","last_became_active":"2024-09-13T16:02:17.018820+0000","last_became_peered":"2024-09-13T16:02:17.018820+0000","last_unstale":"2024-09-13T16:02:18.003024+0000","last_undegraded":"2024-09-13T16:02:18.003024+0000","last_fullsized":"2024-09-13T16:02:18.003024+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:27.926940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077065+0000","last_change":"2024-09-13T16:02:17.018837+0000","last_active":"2024-09-13T16:02:18.077065+0000","last_peered":"2024-09-13T16:02:18.077065+0000","last_clean":"2024-09-13T16:02:18.077065+0000","last_became_active":"2024-09-13T16:02:17.018038+0000","last_became_peered":"2024-09-13T16:02:17.018038+0000","last_unstale":"2024-09-13T16:02:18.077065+0000","last_undegraded":"2024-09-13T16:02:18.077065+0000","last_fullsized":"2024-09-13T16:02:18.077065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:05.504389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006546+0000","last_change":"2024-09-13T16:02:17.027377+0000","last_active":"2024-09-13T16:02:18.006546+0000","last_peered":"2024-09-13T16:02:18.006546+0000","last_clean":"2024-09-13T16:02:18.006546+0000","last_became_active":"2024-09-13T16:02:17.027093+0000","last_became_peered":"2024-09-13T16:02:17.027093+0000","last_unstale":"2024-09-13T16:02:18.006546+0000","last_undegraded":"2024-09-13T16:02:18.006546+0000","last_fullsized":"2024-09-13T16:02:18.006546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:17.638994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006900+0000","last_change":"2024-09-13T16:02:17.023031+0000","last_active":"2024-09-13T16:02:18.006900+0000","last_peered":"2024-09-13T16:02:18.006900+0000","last_clean":"2024-09-13T16:02:18.006900+0000","last_became_active":"2024-09-13T16:02:17.022067+0000","last_became_peered":"2024-09-13T16:02:17.022067+0000","last_unstale":"2024-09-13T16:02:18.006900+0000","last_undegraded":"2024-09-13T16:02:18.006900+0000","last_fullsized":"2024-09-13T16:02:18.006900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:20.591873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.003095+0000","last_change":"2024-09-13T16:02:17.021576+0000","last_active":"2024-09-13T16:02:18.003095+0000","last_peered":"2024-09-13T16:02:18.003095+0000","last_clean":"2024-09-13T16:02:18.003095+0000","last_became_active":"2024-09-13T16:02:17.021020+0000","last_became_peered":"2024-09-13T16:02:17.021020+0000","last_unstale":"2024-09-13T16:02:18.003095+0000","last_undegraded":"2024-09-13T16:02:18.003095+0000","last_fullsized":"2024-09-13T16:02:18.003095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:05.504389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.003282+0000","last_change":"2024-09-13T16:02:17.019110+0000","last_active":"2024-09-13T16:02:18.003282+0000","last_peered":"2024-09-13T16:02:18.003282+0000","last_clean":"2024-09-13T16:02:18.003282+0000","last_became_active":"2024-09-13T16:02:17.018551+0000","last_became_peered":"2024-09-13T16:02:17.018551+0000","last_unstale":"2024-09-13T16:02:18.003282+0000","last_undegraded":"2024-09-13T16:02:18.003282+0000","last_fullsized":"2024-09-13T16:02:18.003282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:31.184566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077251+0000","last_change":"2024-09-13T16:02:17.014534+0000","last_active":"2024-09-13T16:02:18.077251+0000","last_peered":"2024-09-13T16:02:18.077251+0000","last_clean":"2024-09-13T16:02:18.077251+0000","last_became_active":"2024-09-13T16:02:17.011972+0000","last_became_peered":"2024-09-13T16:02:17.011972+0000","last_unstale":"2024-09-13T16:02:18.077251+0000","last_undegraded":"2024-09-13T16:02:18.077251+0000","last_fullsized":"2024-09-13T16:02:18.077251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:28.254349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077548+0000","last_change":"2024-09-13T16:02:17.014720+0000","last_active":"2024-09-13T16:02:18.077548+0000","last_peered":"2024-09-13T16:02:18.077548+0000","last_clean":"2024-09-13T16:02:18.077548+0000","last_became_active":"2024-09-13T16:02:17.014400+0000","last_became_peered":"2024-09-13T16:02:17.014400+0000","last_unstale":"2024-09-13T16:02:18.077548+0000","last_undegraded":"2024-09-13T16:02:18.077548+0000","last_fullsized":"2024-09-13T16:02:18.077548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:55.033127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077655+0000","last_change":"2024-09-13T16:02:17.025219+0000","last_active":"2024-09-13T16:02:18.077655+0000","last_peered":"2024-09-13T16:02:18.077655+0000","last_clean":"2024-09-13T16:02:18.077655+0000","last_became_active":"2024-09-13T16:02:17.023947+0000","last_became_peered":"2024-09-13T16:02:17.023947+0000","last_unstale":"2024-09-13T16:02:18.077655+0000","last_undegraded":"2024-09-13T16:02:18.077655+0000","last_fullsized":"2024-09-13T16:02:18.077655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:30.845399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077686+0000","last_change":"2024-09-13T16:02:17.006524+0000","last_active":"2024-09-13T16:02:18.077686+0000","last_peered":"2024-09-13T16:02:18.077686+0000","last_clean":"2024-09-13T16:02:18.077686+0000","last_became_active":"2024-09-13T16:02:17.006275+0000","last_became_peered":"2024-09-13T16:02:17.006275+0000","last_unstale":"2024-09-13T16:02:18.077686+0000","last_undegraded":"2024-09-13T16:02:18.077686+0000","last_fullsized":"2024-09-13T16:02:18.077686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:55.033127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077009+0000","last_change":"2024-09-13T16:02:17.009472+0000","last_active":"2024-09-13T16:02:18.077009+0000","last_peered":"2024-09-13T16:02:18.077009+0000","last_clean":"2024-09-13T16:02:18.077009+0000","last_became_active":"2024-09-13T16:02:17.009218+0000","last_became_peered":"2024-09-13T16:02:17.009218+0000","last_unstale":"2024-09-13T16:02:18.077009+0000","last_undegraded":"2024-09-13T16:02:18.077009+0000","last_fullsized":"2024-09-13T16:02:18.077009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:29:56.946020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078232+0000","last_change":"2024-09-13T16:02:17.010803+0000","last_active":"2024-09-13T16:02:18.078232+0000","last_peered":"2024-09-13T16:02:18.078232+0000","last_clean":"2024-09-13T16:02:18.078232+0000","last_became_active":"2024-09-13T16:02:17.010510+0000","last_became_peered":"2024-09-13T16:02:17.010510+0000","last_unstale":"2024-09-13T16:02:18.078232+0000","last_undegraded":"2024-09-13T16:02:18.078232+0000","last_fullsized":"2024-09-13T16:02:18.078232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:20.591873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.003079+0000","last_change":"2024-09-13T16:02:17.021426+0000","last_active":"2024-09-13T16:02:18.003079+0000","last_peered":"2024-09-13T16:02:18.003079+0000","last_clean":"2024-09-13T16:02:18.003079+0000","last_became_active":"2024-09-13T16:02:17.020812+0000","last_became_peered":"2024-09-13T16:02:17.020812+0000","last_unstale":"2024-09-13T16:02:18.003079+0000","last_undegraded":"2024-09-13T16:02:18.003079+0000","last_fullsized":"2024-09-13T16:02:18.003079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:45.741525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078015+0000","last_change":"2024-09-13T16:02:17.013281+0000","last_active":"2024-09-13T16:02:18.078015+0000","last_peered":"2024-09-13T16:02:18.078015+0000","last_clean":"2024-09-13T16:02:18.078015+0000","last_became_active":"2024-09-13T16:02:17.012344+0000","last_became_peered":"2024-09-13T16:02:17.012344+0000","last_unstale":"2024-09-13T16:02:18.078015+0000","last_undegraded":"2024-09-13T16:02:18.078015+0000","last_fullsized":"2024-09-13T16:02:18.078015+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:05.504389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077426+0000","last_change":"2024-09-13T16:02:17.018242+0000","last_active":"2024-09-13T16:02:18.077426+0000","last_peered":"2024-09-13T16:02:18.077426+0000","last_clean":"2024-09-13T16:02:18.077426+0000","last_became_active":"2024-09-13T16:02:17.017960+0000","last_became_peered":"2024-09-13T16:02:17.017960+0000","last_unstale":"2024-09-13T16:02:18.077426+0000","last_undegraded":"2024-09-13T16:02:18.077426+0000","last_fullsized":"2024-09-13T16:02:18.077426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:59.748693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077671+0000","last_change":"2024-09-13T16:02:17.029092+0000","last_active":"2024-09-13T16:02:18.077671+0000","last_peered":"2024-09-13T16:02:18.077671+0000","last_clean":"2024-09-13T16:02:18.077671+0000","last_became_active":"2024-09-13T16:02:17.027891+0000","last_became_peered":"2024-09-13T16:02:17.027891+0000","last_unstale":"2024-09-13T16:02:18.077671+0000","last_undegraded":"2024-09-13T16:02:18.077671+0000","last_fullsized":"2024-09-13T16:02:18.077671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:28.254349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006733+0000","last_change":"2024-09-13T16:02:17.021332+0000","last_active":"2024-09-13T16:02:18.006733+0000","last_peered":"2024-09-13T16:02:18.006733+0000","last_clean":"2024-09-13T16:02:18.006733+0000","last_became_active":"2024-09-13T16:02:17.021091+0000","last_became_peered":"2024-09-13T16:02:17.021091+0000","last_unstale":"2024-09-13T16:02:18.006733+0000","last_undegraded":"2024-09-13T16:02:18.006733+0000","last_fullsized":"2024-09-13T16:02:18.006733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:58.121306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006418+0000","last_change":"2024-09-13T16:02:17.012920+0000","last_active":"2024-09-13T16:02:18.006418+0000","last_peered":"2024-09-13T16:02:18.006418+0000","last_clean":"2024-09-13T16:02:18.006418+0000","last_became_active":"2024-09-13T16:02:17.012596+0000","last_became_peered":"2024-09-13T16:02:17.012596+0000","last_unstale":"2024-09-13T16:02:18.006418+0000","last_undegraded":"2024-09-13T16:02:18.006418+0000","last_fullsized":"2024-09-13T16:02:18.006418+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:35.696966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006381+0000","last_change":"2024-09-13T16:02:17.011671+0000","last_active":"2024-09-13T16:02:18.006381+0000","last_peered":"2024-09-13T16:02:18.006381+0000","last_clean":"2024-09-13T16:02:18.006381+0000","last_became_active":"2024-09-13T16:02:17.010990+0000","last_became_peered":"2024-09-13T16:02:17.010990+0000","last_unstale":"2024-09-13T16:02:18.006381+0000","last_undegraded":"2024-09-13T16:02:18.006381+0000","last_fullsized":"2024-09-13T16:02:18.006381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:45.741525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078051+0000","last_change":"2024-09-13T16:02:17.007346+0000","last_active":"2024-09-13T16:02:18.078051+0000","last_peered":"2024-09-13T16:02:18.078051+0000","last_clean":"2024-09-13T16:02:18.078051+0000","last_became_active":"2024-09-13T16:02:17.007116+0000","last_became_peered":"2024-09-13T16:02:17.007116+0000","last_unstale":"2024-09-13T16:02:18.078051+0000","last_undegraded":"2024-09-13T16:02:18.078051+0000","last_fullsized":"2024-09-13T16:02:18.078051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:07.145543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.007298+0000","last_change":"2024-09-13T16:02:16.604406+0000","last_active":"2024-09-13T16:02:18.007298+0000","last_peered":"2024-09-13T16:02:18.007298+0000","last_clean":"2024-09-13T16:02:18.007298+0000","last_became_active":"2024-09-13T16:02:16.604140+0000","last_became_peered":"2024-09-13T16:02:16.604140+0000","last_unstale":"2024-09-13T16:02:18.007298+0000","last_undegraded":"2024-09-13T16:02:18.007298+0000","last_fullsized":"2024-09-13T16:02:18.007298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:38.758913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.007332+0000","last_change":"2024-09-13T16:02:17.026582+0000","last_active":"2024-09-13T16:02:18.007332+0000","last_peered":"2024-09-13T16:02:18.007332+0000","last_clean":"2024-09-13T16:02:18.007332+0000","last_became_active":"2024-09-13T16:02:17.026344+0000","last_became_peered":"2024-09-13T16:02:17.026344+0000","last_unstale":"2024-09-13T16:02:18.007332+0000","last_undegraded":"2024-09-13T16:02:18.007332+0000","last_fullsized":"2024-09-13T16:02:18.007332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:30.845399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078129+0000","last_change":"2024-09-13T16:02:16.601819+0000","last_active":"2024-09-13T16:02:18.078129+0000","last_peered":"2024-09-13T16:02:18.078129+0000","last_clean":"2024-09-13T16:02:18.078129+0000","last_became_active":"2024-09-13T16:02:16.601556+0000","last_became_peered":"2024-09-13T16:02:16.601556+0000","last_unstale":"2024-09-13T16:02:18.078129+0000","last_undegraded":"2024-09-13T16:02:18.078129+0000","last_fullsized":"2024-09-13T16:02:18.078129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:12.084263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078064+0000","last_change":"2024-09-13T16:02:17.028488+0000","last_active":"2024-09-13T16:02:18.078064+0000","last_peered":"2024-09-13T16:02:18.078064+0000","last_clean":"2024-09-13T16:02:18.078064+0000","last_became_active":"2024-09-13T16:02:17.028226+0000","last_became_peered":"2024-09-13T16:02:17.028226+0000","last_unstale":"2024-09-13T16:02:18.078064+0000","last_undegraded":"2024-09-13T16:02:18.078064+0000","last_fullsized":"2024-09-13T16:02:18.078064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:07.145543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.003294+0000","last_change":"2024-09-13T16:02:16.603662+0000","last_active":"2024-09-13T16:02:18.003294+0000","last_peered":"2024-09-13T16:02:18.003294+0000","last_clean":"2024-09-13T16:02:18.003294+0000","last_became_active":"2024-09-13T16:02:16.602652+0000","last_became_peered":"2024-09-13T16:02:16.602652+0000","last_unstale":"2024-09-13T16:02:18.003294+0000","last_undegraded":"2024-09-13T16:02:18.003294+0000","last_fullsized":"2024-09-13T16:02:18.003294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:14.493350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078058+0000","last_change":"2024-09-13T16:02:17.002737+0000","last_active":"2024-09-13T16:02:18.078058+0000","last_peered":"2024-09-13T16:02:18.078058+0000","last_clean":"2024-09-13T16:02:18.078058+0000","last_became_active":"2024-09-13T16:02:17.002464+0000","last_became_peered":"2024-09-13T16:02:17.002464+0000","last_unstale":"2024-09-13T16:02:18.078058+0000","last_undegraded":"2024-09-13T16:02:18.078058+0000","last_fullsized":"2024-09-13T16:02:18.078058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:59.748693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077398+0000","last_change":"2024-09-13T16:02:16.601388+0000","last_active":"2024-09-13T16:02:18.077398+0000","last_peered":"2024-09-13T16:02:18.077398+0000","last_clean":"2024-09-13T16:02:18.077398+0000","last_became_active":"2024-09-13T16:02:16.601111+0000","last_became_peered":"2024-09-13T16:02:16.601111+0000","last_unstale":"2024-09-13T16:02:18.077398+0000","last_undegraded":"2024-09-13T16:02:18.077398+0000","last_fullsized":"2024-09-13T16:02:18.077398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:09.430427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006720+0000","last_change":"2024-09-13T16:02:17.009459+0000","last_active":"2024-09-13T16:02:18.006720+0000","last_peered":"2024-09-13T16:02:18.006720+0000","last_clean":"2024-09-13T16:02:18.006720+0000","last_became_active":"2024-09-13T16:02:17.009232+0000","last_became_peered":"2024-09-13T16:02:17.009232+0000","last_unstale":"2024-09-13T16:02:18.006720+0000","last_undegraded":"2024-09-13T16:02:18.006720+0000","last_fullsized":"2024-09-13T16:02:18.006720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:53.947070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077770+0000","last_change":"2024-09-13T16:02:16.594627+0000","last_active":"2024-09-13T16:02:18.077770+0000","last_peered":"2024-09-13T16:02:18.077770+0000","last_clean":"2024-09-13T16:02:18.077770+0000","last_became_active":"2024-09-13T16:02:16.593616+0000","last_became_peered":"2024-09-13T16:02:16.593616+0000","last_unstale":"2024-09-13T16:02:18.077770+0000","last_undegraded":"2024-09-13T16:02:18.077770+0000","last_fullsized":"2024-09-13T16:02:18.077770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:57.754965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077843+0000","last_change":"2024-09-13T16:02:17.012312+0000","last_active":"2024-09-13T16:02:18.077843+0000","last_peered":"2024-09-13T16:02:18.077843+0000","last_clean":"2024-09-13T16:02:18.077843+0000","last_became_active":"2024-09-13T16:02:17.011328+0000","last_became_peered":"2024-09-13T16:02:17.011328+0000","last_unstale":"2024-09-13T16:02:18.077843+0000","last_undegraded":"2024-09-13T16:02:18.077843+0000","last_fullsized":"2024-09-13T16:02:18.077843+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:54.449652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077751+0000","last_change":"2024-09-13T16:02:16.595426+0000","last_active":"2024-09-13T16:02:18.077751+0000","last_peered":"2024-09-13T16:02:18.077751+0000","last_clean":"2024-09-13T16:02:18.077751+0000","last_became_active":"2024-09-13T16:02:16.595174+0000","last_became_peered":"2024-09-13T16:02:16.595174+0000","last_unstale":"2024-09-13T16:02:18.077751+0000","last_undegraded":"2024-09-13T16:02:18.077751+0000","last_fullsized":"2024-09-13T16:02:18.077751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:38.758913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077377+0000","last_change":"2024-09-13T16:02:17.009384+0000","last_active":"2024-09-13T16:02:18.077377+0000","last_peered":"2024-09-13T16:02:18.077377+0000","last_clean":"2024-09-13T16:02:18.077377+0000","last_became_active":"2024-09-13T16:02:17.007174+0000","last_became_peered":"2024-09-13T16:02:17.007174+0000","last_unstale":"2024-09-13T16:02:18.077377+0000","last_undegraded":"2024-09-13T16:02:18.077377+0000","last_fullsized":"2024-09-13T16:02:18.077377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:26.844415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002586+0000","last_change":"2024-09-13T16:02:16.599637+0000","last_active":"2024-09-13T16:02:18.002586+0000","last_peered":"2024-09-13T16:02:18.002586+0000","last_clean":"2024-09-13T16:02:18.002586+0000","last_became_active":"2024-09-13T16:02:16.599367+0000","last_became_peered":"2024-09-13T16:02:16.599367+0000","last_unstale":"2024-09-13T16:02:18.002586+0000","last_undegraded":"2024-09-13T16:02:18.002586+0000","last_fullsized":"2024-09-13T16:02:18.002586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:06.569867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077199+0000","last_change":"2024-09-13T16:02:17.001770+0000","last_active":"2024-09-13T16:02:18.077199+0000","last_peered":"2024-09-13T16:02:18.077199+0000","last_clean":"2024-09-13T16:02:18.077199+0000","last_became_active":"2024-09-13T16:02:17.001515+0000","last_became_peered":"2024-09-13T16:02:17.001515+0000","last_unstale":"2024-09-13T16:02:18.077199+0000","last_undegraded":"2024-09-13T16:02:18.077199+0000","last_fullsized":"2024-09-13T16:02:18.077199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:43.671907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077484+0000","last_change":"2024-09-13T16:02:16.600501+0000","last_active":"2024-09-13T16:02:18.077484+0000","last_peered":"2024-09-13T16:02:18.077484+0000","last_clean":"2024-09-13T16:02:18.077484+0000","last_became_active":"2024-09-13T16:02:16.600221+0000","last_became_peered":"2024-09-13T16:02:16.600221+0000","last_unstale":"2024-09-13T16:02:18.077484+0000","last_undegraded":"2024-09-13T16:02:18.077484+0000","last_fullsized":"2024-09-13T16:02:18.077484+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:14:33.855669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077472+0000","last_change":"2024-09-13T16:02:17.027887+0000","last_active":"2024-09-13T16:02:18.077472+0000","last_peered":"2024-09-13T16:02:18.077472+0000","last_clean":"2024-09-13T16:02:18.077472+0000","last_became_active":"2024-09-13T16:02:17.027578+0000","last_became_peered":"2024-09-13T16:02:17.027578+0000","last_unstale":"2024-09-13T16:02:18.077472+0000","last_undegraded":"2024-09-13T16:02:18.077472+0000","last_fullsized":"2024-09-13T16:02:18.077472+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:53.947070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.003150+0000","last_change":"2024-09-13T16:02:16.599147+0000","last_active":"2024-09-13T16:02:18.003150+0000","last_peered":"2024-09-13T16:02:18.003150+0000","last_clean":"2024-09-13T16:02:18.003150+0000","last_became_active":"2024-09-13T16:02:16.598876+0000","last_became_peered":"2024-09-13T16:02:16.598876+0000","last_unstale":"2024-09-13T16:02:18.003150+0000","last_undegraded":"2024-09-13T16:02:18.003150+0000","last_fullsized":"2024-09-13T16:02:18.003150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:29.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.003111+0000","last_change":"2024-09-13T16:02:17.024684+0000","last_active":"2024-09-13T16:02:18.003111+0000","last_peered":"2024-09-13T16:02:18.003111+0000","last_clean":"2024-09-13T16:02:18.003111+0000","last_became_active":"2024-09-13T16:02:17.024052+0000","last_became_peered":"2024-09-13T16:02:17.024052+0000","last_unstale":"2024-09-13T16:02:18.003111+0000","last_undegraded":"2024-09-13T16:02:18.003111+0000","last_fullsized":"2024-09-13T16:02:18.003111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:54.449652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078261+0000","last_change":"2024-09-13T16:02:16.595161+0000","last_active":"2024-09-13T16:02:18.078261+0000","last_peered":"2024-09-13T16:02:18.078261+0000","last_clean":"2024-09-13T16:02:18.078261+0000","last_became_active":"2024-09-13T16:02:16.594890+0000","last_became_peered":"2024-09-13T16:02:16.594890+0000","last_unstale":"2024-09-13T16:02:18.078261+0000","last_undegraded":"2024-09-13T16:02:18.078261+0000","last_fullsized":"2024-09-13T16:02:18.078261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:19.882133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002871+0000","last_change":"2024-09-13T16:02:17.026791+0000","last_active":"2024-09-13T16:02:18.002871+0000","last_peered":"2024-09-13T16:02:18.002871+0000","last_clean":"2024-09-13T16:02:18.002871+0000","last_became_active":"2024-09-13T16:02:17.026509+0000","last_became_peered":"2024-09-13T16:02:17.026509+0000","last_unstale":"2024-09-13T16:02:18.002871+0000","last_undegraded":"2024-09-13T16:02:18.002871+0000","last_fullsized":"2024-09-13T16:02:18.002871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:17.638994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077798+0000","last_change":"2024-09-13T16:02:16.606186+0000","last_active":"2024-09-13T16:02:18.077798+0000","last_peered":"2024-09-13T16:02:18.077798+0000","last_clean":"2024-09-13T16:02:18.077798+0000","last_became_active":"2024-09-13T16:02:16.605950+0000","last_became_peered":"2024-09-13T16:02:16.605950+0000","last_unstale":"2024-09-13T16:02:18.077798+0000","last_undegraded":"2024-09-13T16:02:18.077798+0000","last_fullsized":"2024-09-13T16:02:18.077798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:06.569867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077654+0000","last_change":"2024-09-13T16:02:17.008892+0000","last_active":"2024-09-13T16:02:18.077654+0000","last_peered":"2024-09-13T16:02:18.077654+0000","last_clean":"2024-09-13T16:02:18.077654+0000","last_became_active":"2024-09-13T16:02:17.008609+0000","last_became_peered":"2024-09-13T16:02:17.008609+0000","last_unstale":"2024-09-13T16:02:18.077654+0000","last_undegraded":"2024-09-13T16:02:18.077654+0000","last_fullsized":"2024-09-13T16:02:18.077654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:58.121306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002956+0000","last_change":"2024-09-13T16:02:16.591720+0000","last_active":"2024-09-13T16:02:18.002956+0000","last_peered":"2024-09-13T16:02:18.002956+0000","last_clean":"2024-09-13T16:02:18.002956+0000","last_became_active":"2024-09-13T16:02:16.591458+0000","last_became_peered":"2024-09-13T16:02:16.591458+0000","last_unstale":"2024-09-13T16:02:18.002956+0000","last_undegraded":"2024-09-13T16:02:18.002956+0000","last_fullsized":"2024-09-13T16:02:18.002956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:37.928621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077172+0000","last_change":"2024-09-13T16:02:17.005923+0000","last_active":"2024-09-13T16:02:18.077172+0000","last_peered":"2024-09-13T16:02:18.077172+0000","last_clean":"2024-09-13T16:02:18.077172+0000","last_became_active":"2024-09-13T16:02:17.004279+0000","last_became_peered":"2024-09-13T16:02:17.004279+0000","last_unstale":"2024-09-13T16:02:18.077172+0000","last_undegraded":"2024-09-13T16:02:18.077172+0000","last_fullsized":"2024-09-13T16:02:18.077172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:02.305735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077857+0000","last_change":"2024-09-13T16:02:16.602875+0000","last_active":"2024-09-13T16:02:18.077857+0000","last_peered":"2024-09-13T16:02:18.077857+0000","last_clean":"2024-09-13T16:02:18.077857+0000","last_became_active":"2024-09-13T16:02:16.602631+0000","last_became_peered":"2024-09-13T16:02:16.602631+0000","last_unstale":"2024-09-13T16:02:18.077857+0000","last_undegraded":"2024-09-13T16:02:18.077857+0000","last_fullsized":"2024-09-13T16:02:18.077857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:14.394285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002880+0000","last_change":"2024-09-13T16:02:17.019692+0000","last_active":"2024-09-13T16:02:18.002880+0000","last_peered":"2024-09-13T16:02:18.002880+0000","last_clean":"2024-09-13T16:02:18.002880+0000","last_became_active":"2024-09-13T16:02:17.019450+0000","last_became_peered":"2024-09-13T16:02:17.019450+0000","last_unstale":"2024-09-13T16:02:18.002880+0000","last_undegraded":"2024-09-13T16:02:18.002880+0000","last_fullsized":"2024-09-13T16:02:18.002880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:18.458355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077245+0000","last_change":"2024-09-13T16:02:16.594716+0000","last_active":"2024-09-13T16:02:18.077245+0000","last_peered":"2024-09-13T16:02:18.077245+0000","last_clean":"2024-09-13T16:02:18.077245+0000","last_became_active":"2024-09-13T16:02:16.594422+0000","last_became_peered":"2024-09-13T16:02:16.594422+0000","last_unstale":"2024-09-13T16:02:18.077245+0000","last_undegraded":"2024-09-13T16:02:18.077245+0000","last_fullsized":"2024-09-13T16:02:18.077245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:12.084263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006389+0000","last_change":"2024-09-13T16:02:17.011930+0000","last_active":"2024-09-13T16:02:18.006389+0000","last_peered":"2024-09-13T16:02:18.006389+0000","last_clean":"2024-09-13T16:02:18.006389+0000","last_became_active":"2024-09-13T16:02:17.011385+0000","last_became_peered":"2024-09-13T16:02:17.011385+0000","last_unstale":"2024-09-13T16:02:18.006389+0000","last_undegraded":"2024-09-13T16:02:18.006389+0000","last_fullsized":"2024-09-13T16:02:18.006389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:29:56.946020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002963+0000","last_change":"2024-09-13T16:02:16.598258+0000","last_active":"2024-09-13T16:02:18.002963+0000","last_peered":"2024-09-13T16:02:18.002963+0000","last_clean":"2024-09-13T16:02:18.002963+0000","last_became_active":"2024-09-13T16:02:16.597935+0000","last_became_peered":"2024-09-13T16:02:16.597935+0000","last_unstale":"2024-09-13T16:02:18.002963+0000","last_undegraded":"2024-09-13T16:02:18.002963+0000","last_fullsized":"2024-09-13T16:02:18.002963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:27.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006373+0000","last_change":"2024-09-13T16:02:17.021713+0000","last_active":"2024-09-13T16:02:18.006373+0000","last_peered":"2024-09-13T16:02:18.006373+0000","last_clean":"2024-09-13T16:02:18.006373+0000","last_became_active":"2024-09-13T16:02:17.021512+0000","last_became_peered":"2024-09-13T16:02:17.021512+0000","last_unstale":"2024-09-13T16:02:18.006373+0000","last_undegraded":"2024-09-13T16:02:18.006373+0000","last_fullsized":"2024-09-13T16:02:18.006373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:15.496238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002614+0000","last_change":"2024-09-13T16:02:16.592804+0000","last_active":"2024-09-13T16:02:18.002614+0000","last_peered":"2024-09-13T16:02:18.002614+0000","last_clean":"2024-09-13T16:02:18.002614+0000","last_became_active":"2024-09-13T16:02:16.589675+0000","last_became_peered":"2024-09-13T16:02:16.589675+0000","last_unstale":"2024-09-13T16:02:18.002614+0000","last_undegraded":"2024-09-13T16:02:18.002614+0000","last_fullsized":"2024-09-13T16:02:18.002614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:34.694078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078156+0000","last_change":"2024-09-13T16:02:17.009599+0000","last_active":"2024-09-13T16:02:18.078156+0000","last_peered":"2024-09-13T16:02:18.078156+0000","last_clean":"2024-09-13T16:02:18.078156+0000","last_became_active":"2024-09-13T16:02:17.009327+0000","last_became_peered":"2024-09-13T16:02:17.009327+0000","last_unstale":"2024-09-13T16:02:18.078156+0000","last_undegraded":"2024-09-13T16:02:18.078156+0000","last_fullsized":"2024-09-13T16:02:18.078156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:49.653104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078277+0000","last_change":"2024-09-13T16:02:16.590303+0000","last_active":"2024-09-13T16:02:18.078277+0000","last_peered":"2024-09-13T16:02:18.078277+0000","last_clean":"2024-09-13T16:02:18.078277+0000","last_became_active":"2024-09-13T16:02:16.588684+0000","last_became_peered":"2024-09-13T16:02:16.588684+0000","last_unstale":"2024-09-13T16:02:18.078277+0000","last_undegraded":"2024-09-13T16:02:18.078277+0000","last_fullsized":"2024-09-13T16:02:18.078277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:14.493350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077690+0000","last_change":"2024-09-13T16:02:17.005884+0000","last_active":"2024-09-13T16:02:18.077690+0000","last_peered":"2024-09-13T16:02:18.077690+0000","last_clean":"2024-09-13T16:02:18.077690+0000","last_became_active":"2024-09-13T16:02:17.005519+0000","last_became_peered":"2024-09-13T16:02:17.005519+0000","last_unstale":"2024-09-13T16:02:18.077690+0000","last_undegraded":"2024-09-13T16:02:18.077690+0000","last_fullsized":"2024-09-13T16:02:18.077690+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:49.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078161+0000","last_change":"2024-09-13T16:02:16.602658+0000","last_active":"2024-09-13T16:02:18.078161+0000","last_peered":"2024-09-13T16:02:18.078161+0000","last_clean":"2024-09-13T16:02:18.078161+0000","last_became_active":"2024-09-13T16:02:16.602281+0000","last_became_peered":"2024-09-13T16:02:16.602281+0000","last_unstale":"2024-09-13T16:02:18.078161+0000","last_undegraded":"2024-09-13T16:02:18.078161+0000","last_fullsized":"2024-09-13T16:02:18.078161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:32.769302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077579+0000","last_change":"2024-09-13T16:02:17.010957+0000","last_active":"2024-09-13T16:02:18.077579+0000","last_peered":"2024-09-13T16:02:18.077579+0000","last_clean":"2024-09-13T16:02:18.077579+0000","last_became_active":"2024-09-13T16:02:17.010715+0000","last_became_peered":"2024-09-13T16:02:17.010715+0000","last_unstale":"2024-09-13T16:02:18.077579+0000","last_undegraded":"2024-09-13T16:02:18.077579+0000","last_fullsized":"2024-09-13T16:02:18.077579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:00.588775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078259+0000","last_change":"2024-09-13T16:02:16.598347+0000","last_active":"2024-09-13T16:02:18.078259+0000","last_peered":"2024-09-13T16:02:18.078259+0000","last_clean":"2024-09-13T16:02:18.078259+0000","last_became_active":"2024-09-13T16:02:16.596589+0000","last_became_peered":"2024-09-13T16:02:16.596589+0000","last_unstale":"2024-09-13T16:02:18.078259+0000","last_undegraded":"2024-09-13T16:02:18.078259+0000","last_fullsized":"2024-09-13T16:02:18.078259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:32.486418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077307+0000","last_change":"2024-09-13T16:02:17.016873+0000","last_active":"2024-09-13T16:02:18.077307+0000","last_peered":"2024-09-13T16:02:18.077307+0000","last_clean":"2024-09-13T16:02:18.077307+0000","last_became_active":"2024-09-13T16:02:17.012593+0000","last_became_peered":"2024-09-13T16:02:17.012593+0000","last_unstale":"2024-09-13T16:02:18.077307+0000","last_undegraded":"2024-09-13T16:02:18.077307+0000","last_fullsized":"2024-09-13T16:02:18.077307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:07.145543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078051+0000","last_change":"2024-09-13T16:02:16.593657+0000","last_active":"2024-09-13T16:02:18.078051+0000","last_peered":"2024-09-13T16:02:18.078051+0000","last_clean":"2024-09-13T16:02:18.078051+0000","last_became_active":"2024-09-13T16:02:16.593327+0000","last_became_peered":"2024-09-13T16:02:16.593327+0000","last_unstale":"2024-09-13T16:02:18.078051+0000","last_undegraded":"2024-09-13T16:02:18.078051+0000","last_fullsized":"2024-09-13T16:02:18.078051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:55.806687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077525+0000","last_change":"2024-09-13T16:02:17.011616+0000","last_active":"2024-09-13T16:02:18.077525+0000","last_peered":"2024-09-13T16:02:18.077525+0000","last_clean":"2024-09-13T16:02:18.077525+0000","last_became_active":"2024-09-13T16:02:17.009920+0000","last_became_peered":"2024-09-13T16:02:17.009920+0000","last_unstale":"2024-09-13T16:02:18.077525+0000","last_undegraded":"2024-09-13T16:02:18.077525+0000","last_fullsized":"2024-09-13T16:02:18.077525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:14:43.228578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078014+0000","last_change":"2024-09-13T16:02:16.601809+0000","last_active":"2024-09-13T16:02:18.078014+0000","last_peered":"2024-09-13T16:02:18.078014+0000","last_clean":"2024-09-13T16:02:18.078014+0000","last_became_active":"2024-09-13T16:02:16.601538+0000","last_became_peered":"2024-09-13T16:02:16.601538+0000","last_unstale":"2024-09-13T16:02:18.078014+0000","last_undegraded":"2024-09-13T16:02:18.078014+0000","last_fullsized":"2024-09-13T16:02:18.078014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:10.324853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077161+0000","last_change":"2024-09-13T16:02:17.007842+0000","last_active":"2024-09-13T16:02:18.077161+0000","last_peered":"2024-09-13T16:02:18.077161+0000","last_clean":"2024-09-13T16:02:18.077161+0000","last_became_active":"2024-09-13T16:02:17.004409+0000","last_became_peered":"2024-09-13T16:02:17.004409+0000","last_unstale":"2024-09-13T16:02:18.077161+0000","last_undegraded":"2024-09-13T16:02:18.077161+0000","last_fullsized":"2024-09-13T16:02:18.077161+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:38.931509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006744+0000","last_change":"2024-09-13T16:02:16.604767+0000","last_active":"2024-09-13T16:02:18.006744+0000","last_peered":"2024-09-13T16:02:18.006744+0000","last_clean":"2024-09-13T16:02:18.006744+0000","last_became_active":"2024-09-13T16:02:16.604586+0000","last_became_peered":"2024-09-13T16:02:16.604586+0000","last_unstale":"2024-09-13T16:02:18.006744+0000","last_undegraded":"2024-09-13T16:02:18.006744+0000","last_fullsized":"2024-09-13T16:02:18.006744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:55.806687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.076986+0000","last_change":"2024-09-13T16:02:17.006721+0000","last_active":"2024-09-13T16:02:18.076986+0000","last_peered":"2024-09-13T16:02:18.076986+0000","last_clean":"2024-09-13T16:02:18.076986+0000","last_became_active":"2024-09-13T16:02:17.004077+0000","last_became_peered":"2024-09-13T16:02:17.004077+0000","last_unstale":"2024-09-13T16:02:18.076986+0000","last_undegraded":"2024-09-13T16:02:18.076986+0000","last_fullsized":"2024-09-13T16:02:18.076986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:35.696966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077385+0000","last_change":"2024-09-13T16:02:16.602660+0000","last_active":"2024-09-13T16:02:18.077385+0000","last_peered":"2024-09-13T16:02:18.077385+0000","last_clean":"2024-09-13T16:02:18.077385+0000","last_became_active":"2024-09-13T16:02:16.602389+0000","last_became_peered":"2024-09-13T16:02:16.602389+0000","last_unstale":"2024-09-13T16:02:18.077385+0000","last_undegraded":"2024-09-13T16:02:18.077385+0000","last_fullsized":"2024-09-13T16:02:18.077385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:13.942163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006547+0000","last_change":"2024-09-13T16:02:17.017027+0000","last_active":"2024-09-13T16:02:18.006547+0000","last_peered":"2024-09-13T16:02:18.006547+0000","last_clean":"2024-09-13T16:02:18.006547+0000","last_became_active":"2024-09-13T16:02:17.016771+0000","last_became_peered":"2024-09-13T16:02:17.016771+0000","last_unstale":"2024-09-13T16:02:18.006547+0000","last_undegraded":"2024-09-13T16:02:18.006547+0000","last_fullsized":"2024-09-13T16:02:18.006547+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:05.504389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.076999+0000","last_change":"2024-09-13T16:02:16.606070+0000","last_active":"2024-09-13T16:02:18.076999+0000","last_peered":"2024-09-13T16:02:18.076999+0000","last_clean":"2024-09-13T16:02:18.076999+0000","last_became_active":"2024-09-13T16:02:16.605867+0000","last_became_peered":"2024-09-13T16:02:16.605867+0000","last_unstale":"2024-09-13T16:02:18.076999+0000","last_undegraded":"2024-09-13T16:02:18.076999+0000","last_fullsized":"2024-09-13T16:02:18.076999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:34.694078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077200+0000","last_change":"2024-09-13T16:02:17.012052+0000","last_active":"2024-09-13T16:02:18.077200+0000","last_peered":"2024-09-13T16:02:18.077200+0000","last_clean":"2024-09-13T16:02:18.077200+0000","last_became_active":"2024-09-13T16:02:17.011806+0000","last_became_peered":"2024-09-13T16:02:17.011806+0000","last_unstale":"2024-09-13T16:02:18.077200+0000","last_undegraded":"2024-09-13T16:02:18.077200+0000","last_fullsized":"2024-09-13T16:02:18.077200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:55.033127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078293+0000","last_change":"2024-09-13T16:02:16.600846+0000","last_active":"2024-09-13T16:02:18.078293+0000","last_peered":"2024-09-13T16:02:18.078293+0000","last_clean":"2024-09-13T16:02:18.078293+0000","last_became_active":"2024-09-13T16:02:16.600554+0000","last_became_peered":"2024-09-13T16:02:16.600554+0000","last_unstale":"2024-09-13T16:02:18.078293+0000","last_undegraded":"2024-09-13T16:02:18.078293+0000","last_fullsized":"2024-09-13T16:02:18.078293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:06.569867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077775+0000","last_change":"2024-09-13T16:02:17.011881+0000","last_active":"2024-09-13T16:02:18.077775+0000","last_peered":"2024-09-13T16:02:18.077775+0000","last_clean":"2024-09-13T16:02:18.077775+0000","last_became_active":"2024-09-13T16:02:17.011647+0000","last_became_peered":"2024-09-13T16:02:17.011647+0000","last_unstale":"2024-09-13T16:02:18.077775+0000","last_undegraded":"2024-09-13T16:02:18.077775+0000","last_fullsized":"2024-09-13T16:02:18.077775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:00.588775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:19.564431+0000","last_change":"2024-09-13T16:02:16.602651+0000","last_active":"2024-09-13T16:02:19.564431+0000","last_peered":"2024-09-13T16:02:19.564431+0000","last_clean":"2024-09-13T16:02:19.564431+0000","last_became_active":"2024-09-13T16:02:16.602419+0000","last_became_peered":"2024-09-13T16:02:16.602419+0000","last_unstale":"2024-09-13T16:02:19.564431+0000","last_undegraded":"2024-09-13T16:02:19.564431+0000","last_fullsized":"2024-09-13T16:02:19.564431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:18.827176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077883+0000","last_change":"2024-09-13T16:02:17.006060+0000","last_active":"2024-09-13T16:02:18.077883+0000","last_peered":"2024-09-13T16:02:18.077883+0000","last_clean":"2024-09-13T16:02:18.077883+0000","last_became_active":"2024-09-13T16:02:17.005165+0000","last_became_peered":"2024-09-13T16:02:17.005165+0000","last_unstale":"2024-09-13T16:02:18.077883+0000","last_undegraded":"2024-09-13T16:02:18.077883+0000","last_fullsized":"2024-09-13T16:02:18.077883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:35:16.887890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077671+0000","last_change":"2024-09-13T16:02:16.597613+0000","last_active":"2024-09-13T16:02:18.077671+0000","last_peered":"2024-09-13T16:02:18.077671+0000","last_clean":"2024-09-13T16:02:18.077671+0000","last_became_active":"2024-09-13T16:02:16.597038+0000","last_became_peered":"2024-09-13T16:02:16.597038+0000","last_unstale":"2024-09-13T16:02:18.077671+0000","last_undegraded":"2024-09-13T16:02:18.077671+0000","last_fullsized":"2024-09-13T16:02:18.077671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:10.324853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006664+0000","last_change":"2024-09-13T16:02:17.018422+0000","last_active":"2024-09-13T16:02:18.006664+0000","last_peered":"2024-09-13T16:02:18.006664+0000","last_clean":"2024-09-13T16:02:18.006664+0000","last_became_active":"2024-09-13T16:02:17.018201+0000","last_became_peered":"2024-09-13T16:02:17.018201+0000","last_unstale":"2024-09-13T16:02:18.006664+0000","last_undegraded":"2024-09-13T16:02:18.006664+0000","last_fullsized":"2024-09-13T16:02:18.006664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:38.931509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.078086+0000","last_change":"2024-09-13T16:02:16.603301+0000","last_active":"2024-09-13T16:02:18.078086+0000","last_peered":"2024-09-13T16:02:18.078086+0000","last_clean":"2024-09-13T16:02:18.078086+0000","last_became_active":"2024-09-13T16:02:16.603060+0000","last_became_peered":"2024-09-13T16:02:16.603060+0000","last_unstale":"2024-09-13T16:02:18.078086+0000","last_undegraded":"2024-09-13T16:02:18.078086+0000","last_fullsized":"2024-09-13T16:02:18.078086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:57.754965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077970+0000","last_change":"2024-09-13T16:02:17.018422+0000","last_active":"2024-09-13T16:02:18.077970+0000","last_peered":"2024-09-13T16:02:18.077970+0000","last_clean":"2024-09-13T16:02:18.077970+0000","last_became_active":"2024-09-13T16:02:17.018149+0000","last_became_peered":"2024-09-13T16:02:17.018149+0000","last_unstale":"2024-09-13T16:02:18.077970+0000","last_undegraded":"2024-09-13T16:02:18.077970+0000","last_fullsized":"2024-09-13T16:02:18.077970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:28.254349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077323+0000","last_change":"2024-09-13T16:02:16.600821+0000","last_active":"2024-09-13T16:02:18.077323+0000","last_peered":"2024-09-13T16:02:18.077323+0000","last_clean":"2024-09-13T16:02:18.077323+0000","last_became_active":"2024-09-13T16:02:16.600545+0000","last_became_peered":"2024-09-13T16:02:16.600545+0000","last_unstale":"2024-09-13T16:02:18.077323+0000","last_undegraded":"2024-09-13T16:02:18.077323+0000","last_fullsized":"2024-09-13T16:02:18.077323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:34.694078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002525+0000","last_change":"2024-09-13T16:02:17.019187+0000","last_active":"2024-09-13T16:02:18.002525+0000","last_peered":"2024-09-13T16:02:18.002525+0000","last_clean":"2024-09-13T16:02:18.002525+0000","last_became_active":"2024-09-13T16:02:17.018964+0000","last_became_peered":"2024-09-13T16:02:17.018964+0000","last_unstale":"2024-09-13T16:02:18.002525+0000","last_undegraded":"2024-09-13T16:02:18.002525+0000","last_fullsized":"2024-09-13T16:02:18.002525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:29:56.946020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077467+0000","last_change":"2024-09-13T16:02:16.599389+0000","last_active":"2024-09-13T16:02:18.077467+0000","last_peered":"2024-09-13T16:02:18.077467+0000","last_clean":"2024-09-13T16:02:18.077467+0000","last_became_active":"2024-09-13T16:02:16.599128+0000","last_became_peered":"2024-09-13T16:02:16.599128+0000","last_unstale":"2024-09-13T16:02:18.077467+0000","last_undegraded":"2024-09-13T16:02:18.077467+0000","last_fullsized":"2024-09-13T16:02:18.077467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:09.430427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.077297+0000","last_change":"2024-09-13T16:02:17.024752+0000","last_active":"2024-09-13T16:02:18.077297+0000","last_peered":"2024-09-13T16:02:18.077297+0000","last_clean":"2024-09-13T16:02:18.077297+0000","last_became_active":"2024-09-13T16:02:17.024451+0000","last_became_peered":"2024-09-13T16:02:17.024451+0000","last_unstale":"2024-09-13T16:02:18.077297+0000","last_undegraded":"2024-09-13T16:02:18.077297+0000","last_fullsized":"2024-09-13T16:02:18.077297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:35:16.887890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.002748+0000","last_change":"2024-09-13T16:02:16.604629+0000","last_active":"2024-09-13T16:02:18.002748+0000","last_peered":"2024-09-13T16:02:18.002748+0000","last_clean":"2024-09-13T16:02:18.002748+0000","last_became_active":"2024-09-13T16:02:16.603554+0000","last_became_peered":"2024-09-13T16:02:16.603554+0000","last_unstale":"2024-09-13T16:02:18.002748+0000","last_undegraded":"2024-09-13T16:02:18.002748+0000","last_fullsized":"2024-09-13T16:02:18.002748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:54.030239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.006778+0000","last_change":"2024-09-13T16:02:17.017663+0000","last_active":"2024-09-13T16:02:18.006778+0000","last_peered":"2024-09-13T16:02:18.006778+0000","last_clean":"2024-09-13T16:02:18.006778+0000","last_became_active":"2024-09-13T16:02:17.017437+0000","last_became_peered":"2024-09-13T16:02:17.017437+0000","last_unstale":"2024-09-13T16:02:18.006778+0000","last_undegraded":"2024-09-13T16:02:18.006778+0000","last_fullsized":"2024-09-13T16:02:18.006778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:16.572438+0000","last_clean_scrub_stamp":"2024-09-13T16:02:16.572438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:54.449652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T16:02:18.007041+0000","last_change":"2024-09-13T16:02:16.599664+0000","last_active":"2024-09-13T16:02:18.007041+0000","last_peered":"2024-09-13T16:02:18.007041+0000","last_clean":"2024-09-13T16:02:18.007041+0000","last_became_active":"2024-09-13T16:02:16.599369+0000","last_became_peered":"2024-09-13T16:02:16.599369+0000","last_unstale":"2024-09-13T16:02:18.007041+0000","last_undegraded":"2024-09-13T16:02:18.007041+0000","last_fullsized":"2024-09-13T16:02:18.007041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:02:15.569550+0000","last_clean_scrub_stamp":"2024-09-13T16:02:15.569550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:32.769302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T16:02:17.001825+0000","last_change":"2024-09-13T16:01:07.580186+0000","last_active":"2024-09-13T16:02:17.001825+0000","last_peered":"2024-09-13T16:02:17.001825+0000","last_clean":"2024-09-13T16:02:17.001825+0000","last_became_active":"2024-09-13T16:01:07.579877+0000","last_became_peered":"2024-09-13T16:01:07.579877+0000","last_unstale":"2024-09-13T16:02:17.001825+0000","last_undegraded":"2024-09-13T16:02:17.001825+0000","last_fullsized":"2024-09-13T16:02:17.001825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_clean_scrub_stamp":"2024-09-13T16:01:06.070807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:40.645649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":742345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.68200000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.751},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.65100000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.73799999999999999}]},{"osd":3,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.55300000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.53400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":393216,"data_stored":152503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.872},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.74099999999999999}]},{"osd":1,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.92400000000000004}]},{"osd":2,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.78400000000000003}]},{"osd":3,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.71299999999999997}]},{"osd":4,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.89500000000000002}]},{"osd":5,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.94899999999999995}]},{"osd":7,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.99399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":152559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.53100000000000003}]},{"osd":1,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.65800000000000003}]},{"osd":2,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.1230000000000002,"5min":5.1230000000000002,"15min":5.1230000000000002},"last":0.62},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.0750000000000002,"5min":5.0750000000000002,"15min":5.0750000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.753},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.65100000000000002}]},{"osd":7,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.67400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":151991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.55300000000000005}]},{"osd":2,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.63800000000000001}]},{"osd":3,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.44600000000000001}]},{"osd":6,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.5}]},{"osd":7,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":401408,"data_stored":153473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.59599999999999997}]},{"osd":4,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.83899999999999997}]},{"osd":5,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.77000000000000002}]},{"osd":6,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.879}]},{"osd":7,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.73499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":389120,"data_stored":151957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.60199999999999998}]},{"osd":1,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.69899999999999995}]},{"osd":3,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.746}]},{"osd":4,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.86299999999999999}]},{"osd":5,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.872}]},{"osd":6,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.84699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":401408,"data_stored":153473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.746},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.503}]},{"osd":4,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.76700000000000002}]},{"osd":6,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.73499999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.72699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":974848,"data_stored":741236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.315},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.377},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.39400000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.58399999999999996}]},{"osd":6,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.51200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:02:26.144 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T16:02:26.144 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T16:02:26.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.334+0000 7f050fa00640 1 Processor -- start 2024-09-13T16:02:26.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.334+0000 7f050fa00640 1 -- start start 2024-09-13T16:02:26.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.335+0000 7f050fa00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f050806ff90 0x7f05080ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:26.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.335+0000 7f050fa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0508070a80 0x7f050806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:26.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.335+0000 7f050fa00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050806b900 con 0x7f05080adc00 2024-09-13T16:02:26.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.335+0000 7f050fa00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050806d400 con 0x7f050806ff90 2024-09-13T16:02:26.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.335+0000 7f050fa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05080cbff0 con 0x7f0508070a80 2024-09-13T16:02:26.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.335+0000 7f0507e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f05080adc00 0x7f0508070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:43184/0 (socket says 172.21.15.70:43184) 2024-09-13T16:02:26.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.335+0000 7f0507e00640 1 -- 172.21.15.70:0/1805165045 learned_addr learned my addr 172.21.15.70:0/1805165045 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:26.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.336+0000 7f050d000640 1 --2- 172.21.15.70:0/1805165045 >> v2:172.21.15.107:3300/0 conn(0x7f050806ff90 0x7f05080ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:26.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.336+0000 7f050da00640 1 --2- 172.21.15.70:0/1805165045 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0508070a80 0x7f050806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:26.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.336+0000 7f0507400640 1 -- 172.21.15.70:0/1805165045 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998104345 0 0) 0x7f050806b900 con 0x7f05080adc00 2024-09-13T16:02:26.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.336+0000 7f0507400640 1 -- 172.21.15.70:0/1805165045 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04f0003520 con 0x7f05080adc00 2024-09-13T16:02:26.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.336+0000 7f050d000640 1 -- 172.21.15.70:0/1805165045 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0508070a80 msgr2=0x7f050806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:26.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.336+0000 7f050d000640 1 --2- 172.21.15.70:0/1805165045 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0508070a80 0x7f050806c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.336+0000 7f050d000640 1 -- 172.21.15.70:0/1805165045 >> v1:172.21.15.70:6789/0 conn(0x7f05080adc00 legacy=0x7f0508070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:26.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.336+0000 7f050d000640 1 -- 172.21.15.70:0/1805165045 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05080ae180 con 0x7f050806ff90 2024-09-13T16:02:26.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.337+0000 7f050d000640 1 --2- 172.21.15.70:0/1805165045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f050806ff90 0x7f05080ad6c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0097a0 tx=0x7f04fc02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e2f2b999cf32b9a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:26.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.337+0000 7f0507400640 1 -- 172.21.15.70:0/1805165045 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc02ae50 con 0x7f050806ff90 2024-09-13T16:02:26.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.337+0000 7f0507400640 1 -- 172.21.15.70:0/1805165045 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04fc032440 con 0x7f050806ff90 2024-09-13T16:02:26.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.337+0000 7f0507400640 1 -- 172.21.15.70:0/1805165045 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc0327d0 con 0x7f050806ff90 2024-09-13T16:02:26.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.338+0000 7f050fa00640 1 -- 172.21.15.70:0/1805165045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f050806ff90 msgr2=0x7f05080ad6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:26.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.338+0000 7f050fa00640 1 --2- 172.21.15.70:0/1805165045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f050806ff90 0x7f05080ad6c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0097a0 tx=0x7f04fc02a100 comp rx=0 tx=0).stop 2024-09-13T16:02:26.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.338+0000 7f050fa00640 1 -- 172.21.15.70:0/1805165045 shutdown_connections 2024-09-13T16:02:26.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.338+0000 7f050fa00640 1 --2- 172.21.15.70:0/1805165045 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0508070a80 0x7f050806c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.338+0000 7f050fa00640 1 --2- 172.21.15.70:0/1805165045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f050806ff90 0x7f05080ad6c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.338+0000 7f050fa00640 1 -- 172.21.15.70:0/1805165045 >> 172.21.15.70:0/1805165045 conn(0x7f05080b0580 msgr2=0x7f05080b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:26.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.338+0000 7f050fa00640 1 -- 172.21.15.70:0/1805165045 shutdown_connections 2024-09-13T16:02:26.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.338+0000 7f050fa00640 1 -- 172.21.15.70:0/1805165045 wait complete. 2024-09-13T16:02:26.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.340+0000 7f050fa00640 1 Processor -- start 2024-09-13T16:02:26.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.340+0000 7f050fa00640 1 -- start start 2024-09-13T16:02:26.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.341+0000 7f050fa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f050806ff90 0x7f0508154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.341+0000 7f050fa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0508070a80 0x7f0508155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.341+0000 7f050fa00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05080adc00 0x7f0508146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.341+0000 7f050fa00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05081f2970 con 0x7f05080adc00 2024-09-13T16:02:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.341+0000 7f050fa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0508145a60 con 0x7f0508070a80 2024-09-13T16:02:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.341+0000 7f050fa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0508156290 con 0x7f050806ff90 2024-09-13T16:02:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.341+0000 7f050da00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05080adc00 0x7f0508146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.341+0000 7f050da00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05080adc00 0x7f0508146210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37104/0 (socket says 172.21.15.70:37104) 2024-09-13T16:02:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.341+0000 7f050da00640 1 -- 172.21.15.70:0/1903493940 learned_addr learned my addr 172.21.15.70:0/1903493940 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.341+0000 7f050d000640 1 --2- 172.21.15.70:0/1903493940 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f050806ff90 0x7f0508154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.341+0000 7f0507e00640 1 --2- 172.21.15.70:0/1903493940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0508070a80 0x7f0508155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.341+0000 7f050da00640 1 -- 172.21.15.70:0/1903493940 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f050806ff90 msgr2=0x7f0508154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.341+0000 7f050da00640 1 --2- 172.21.15.70:0/1903493940 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f050806ff90 0x7f0508154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.341+0000 7f050da00640 1 -- 172.21.15.70:0/1903493940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0508070a80 msgr2=0x7f0508155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:26.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.341+0000 7f050da00640 1 --2- 172.21.15.70:0/1903493940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0508070a80 0x7f0508155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.341+0000 7f050da00640 1 -- 172.21.15.70:0/1903493940 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04fc009400 con 0x7f05080adc00 2024-09-13T16:02:26.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.341+0000 7f050d000640 1 --2- 172.21.15.70:0/1903493940 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f050806ff90 0x7f0508154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:26.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.342+0000 7f050da00640 1 --2- 172.21.15.70:0/1903493940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05080adc00 0x7f0508146210 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f050000efc0 tx=0x7f050000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.342+0000 7f0504c00640 1 -- 172.21.15.70:0/1903493940 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500009ba0 con 0x7f05080adc00 2024-09-13T16:02:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.342+0000 7f0504c00640 1 -- 172.21.15.70:0/1903493940 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050000f040 con 0x7f05080adc00 2024-09-13T16:02:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.342+0000 7f0504c00640 1 -- 172.21.15.70:0/1903493940 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05000146c0 con 0x7f05080adc00 2024-09-13T16:02:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.342+0000 7f050fa00640 1 -- 172.21.15.70:0/1903493940 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05081559f0 con 0x7f05080adc00 2024-09-13T16:02:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.342+0000 7f050fa00640 1 -- 172.21.15.70:0/1903493940 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0508155fb0 con 0x7f05080adc00 2024-09-13T16:02:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.343+0000 7f050fa00640 1 -- 172.21.15.70:0/1903493940 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05080cbbb0 con 0x7f05080adc00 2024-09-13T16:02:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.344+0000 7f0504c00640 1 -- 172.21.15.70:0/1903493940 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0500014820 con 0x7f05080adc00 2024-09-13T16:02:26.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.345+0000 7f0504c00640 1 --2- 172.21.15.70:0/1903493940 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f04e806ac00 0x7f04e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:26.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.345+0000 7f0504c00640 1 -- 172.21.15.70:0/1903493940 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f050008a1d0 con 0x7f05080adc00 2024-09-13T16:02:26.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.345+0000 7f050d000640 1 --2- 172.21.15.70:0/1903493940 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f04e806ac00 0x7f04e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:26.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.346+0000 7f050d000640 1 --2- 172.21.15.70:0/1903493940 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f04e806ac00 0x7f04e806d0c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f04fc034000 tx=0x7f04fc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:26.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.349+0000 7f0504c00640 1 -- 172.21.15.70:0/1903493940 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f05000553a0 con 0x7f05080adc00 2024-09-13T16:02:26.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.580+0000 7f050fa00640 1 -- 172.21.15.70:0/1903493940 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f05080cd1e0 con 0x7f05080adc00 2024-09-13T16:02:26.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.584+0000 7f0504c00640 1 -- 172.21.15.70:0/1903493940 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+0 (secure 0 0 0) 0x7f05000589c0 con 0x7f05080adc00 2024-09-13T16:02:26.585 INFO:teuthology.orchestra.run.smithi070.stderr:updated caps for client.0 2024-09-13T16:02:26.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.586+0000 7f050fa00640 1 -- 172.21.15.70:0/1903493940 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f04e806ac00 msgr2=0x7f04e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:26.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.586+0000 7f050fa00640 1 --2- 172.21.15.70:0/1903493940 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f04e806ac00 0x7f04e806d0c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f04fc034000 tx=0x7f04fc02e000 comp rx=0 tx=0).stop 2024-09-13T16:02:26.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.586+0000 7f050fa00640 1 -- 172.21.15.70:0/1903493940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05080adc00 msgr2=0x7f0508146210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:26.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.586+0000 7f050fa00640 1 --2- 172.21.15.70:0/1903493940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05080adc00 0x7f0508146210 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f050000efc0 tx=0x7f050000c490 comp rx=0 tx=0).stop 2024-09-13T16:02:26.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.586+0000 7f050fa00640 1 -- 172.21.15.70:0/1903493940 shutdown_connections 2024-09-13T16:02:26.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.586+0000 7f050fa00640 1 --2- 172.21.15.70:0/1903493940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05080adc00 0x7f0508146210 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.586+0000 7f050fa00640 1 --2- 172.21.15.70:0/1903493940 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f04e806ac00 0x7f04e806d0c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.586+0000 7f050fa00640 1 --2- 172.21.15.70:0/1903493940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0508070a80 0x7f0508155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.586+0000 7f050fa00640 1 --2- 172.21.15.70:0/1903493940 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f050806ff90 0x7f0508154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.586+0000 7f050fa00640 1 -- 172.21.15.70:0/1903493940 >> 172.21.15.70:0/1903493940 conn(0x7f05080b0580 msgr2=0x7f05080ad0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:26.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.586+0000 7f050fa00640 1 -- 172.21.15.70:0/1903493940 shutdown_connections 2024-09-13T16:02:26.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.586+0000 7f050fa00640 1 -- 172.21.15.70:0/1903493940 wait complete. 2024-09-13T16:02:26.603 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:02:26.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.753+0000 7ff4c1e00640 1 Processor -- start 2024-09-13T16:02:26.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.753+0000 7ff4c1e00640 1 -- start start 2024-09-13T16:02:26.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.754+0000 7ff4c1e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4bc15a520 0x7ff4bc06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:26.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.755+0000 7ff4c1e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff4bc0ce020 0x7ff4bc15a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:26.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.755+0000 7ff4c1e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc06bc00 con 0x7ff4bc0b1b00 2024-09-13T16:02:26.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.755+0000 7ff4c1e00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4bc06bea0 con 0x7ff4bc0ce020 2024-09-13T16:02:26.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.755+0000 7ff4c1e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc06c180 con 0x7ff4bc15a520 2024-09-13T16:02:26.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.755+0000 7ff4bb400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff4bc0ce020 0x7ff4bc15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:26.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.755+0000 7ff4bb400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff4bc0ce020 0x7ff4bc15a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37120/0 (socket says 172.21.15.70:37120) 2024-09-13T16:02:26.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.755+0000 7ff4bb400640 1 -- 172.21.15.70:0/1937665650 learned_addr learned my addr 172.21.15.70:0/1937665650 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:26.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.755+0000 7ff4baa00640 1 --2- 172.21.15.70:0/1937665650 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4bc15a520 0x7ff4bc06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:26.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.755+0000 7ff4bb400640 1 -- 172.21.15.70:0/1937665650 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4bc15a520 msgr2=0x7ff4bc06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:26.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.755+0000 7ff4bb400640 1 --2- 172.21.15.70:0/1937665650 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4bc15a520 0x7ff4bc06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.755+0000 7ff4bb400640 1 -- 172.21.15.70:0/1937665650 >> v1:172.21.15.107:6789/0 conn(0x7ff4bc0b1b00 legacy=0x7ff4bc0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:26.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.755+0000 7ff4bb400640 1 -- 172.21.15.70:0/1937665650 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc06c460 con 0x7ff4bc0ce020 2024-09-13T16:02:26.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.756+0000 7ff4bb400640 1 --2- 172.21.15.70:0/1937665650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4bc0ce020 0x7ff4bc15a900 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009e50 tx=0x7ff4b402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d0e5f16810cc3b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:26.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.756+0000 7ff4ba000640 1 -- 172.21.15.70:0/1937665650 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4031600 con 0x7ff4bc0ce020 2024-09-13T16:02:26.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.757+0000 7ff4ba000640 1 -- 172.21.15.70:0/1937665650 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b402d050 con 0x7ff4bc0ce020 2024-09-13T16:02:26.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.757+0000 7ff4ba000640 1 -- 172.21.15.70:0/1937665650 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4031980 con 0x7ff4bc0ce020 2024-09-13T16:02:26.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.757+0000 7ff4c1e00640 1 -- 172.21.15.70:0/1937665650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4bc0ce020 msgr2=0x7ff4bc15a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:26.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.757+0000 7ff4c1e00640 1 --2- 172.21.15.70:0/1937665650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4bc0ce020 0x7ff4bc15a900 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009e50 tx=0x7ff4b402a710 comp rx=0 tx=0).stop 2024-09-13T16:02:26.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.757+0000 7ff4c1e00640 1 -- 172.21.15.70:0/1937665650 shutdown_connections 2024-09-13T16:02:26.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.757+0000 7ff4c1e00640 1 --2- 172.21.15.70:0/1937665650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4bc0ce020 0x7ff4bc15a900 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.757+0000 7ff4c1e00640 1 --2- 172.21.15.70:0/1937665650 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4bc15a520 0x7ff4bc06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.757+0000 7ff4c1e00640 1 -- 172.21.15.70:0/1937665650 >> 172.21.15.70:0/1937665650 conn(0x7ff4bc0b0510 msgr2=0x7ff4bc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:26.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.757+0000 7ff4c1e00640 1 -- 172.21.15.70:0/1937665650 shutdown_connections 2024-09-13T16:02:26.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.757+0000 7ff4c1e00640 1 -- 172.21.15.70:0/1937665650 wait complete. 2024-09-13T16:02:26.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.759+0000 7ff4c1e00640 1 Processor -- start 2024-09-13T16:02:26.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.759+0000 7ff4c1e00640 1 -- start start 2024-09-13T16:02:26.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.760+0000 7ff4c1e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4bc0b1b00 0x7ff4bc151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:26.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.760+0000 7ff4c1e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4bc0ce020 0x7ff4bc143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:26.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.760+0000 7ff4c1e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4bc15a520 0x7ff4bc1449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:26.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.760+0000 7ff4c1e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc14b490 con 0x7ff4bc15a520 2024-09-13T16:02:26.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.760+0000 7ff4c1e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc152b60 con 0x7ff4bc0ce020 2024-09-13T16:02:26.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.760+0000 7ff4c1e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc152e40 con 0x7ff4bc0b1b00 2024-09-13T16:02:26.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.760+0000 7ff4bb400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4bc15a520 0x7ff4bc1449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:26.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.760+0000 7ff4bb400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4bc15a520 0x7ff4bc1449d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37134/0 (socket says 172.21.15.70:37134) 2024-09-13T16:02:26.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.760+0000 7ff4bb400640 1 -- 172.21.15.70:0/3237723564 learned_addr learned my addr 172.21.15.70:0/3237723564 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:26.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.760+0000 7ff4baa00640 1 --2- 172.21.15.70:0/3237723564 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4bc0b1b00 0x7ff4bc151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:26.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.760+0000 7ff4bb400640 1 -- 172.21.15.70:0/3237723564 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4bc0b1b00 msgr2=0x7ff4bc151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:26.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.760+0000 7ff4bb400640 1 --2- 172.21.15.70:0/3237723564 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4bc0b1b00 0x7ff4bc151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.760+0000 7ff4bb400640 1 -- 172.21.15.70:0/3237723564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4bc0ce020 msgr2=0x7ff4bc143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:26.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.760+0000 7ff4bb400640 1 --2- 172.21.15.70:0/3237723564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4bc0ce020 0x7ff4bc143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.761+0000 7ff4bb400640 1 -- 172.21.15.70:0/3237723564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b4009b30 con 0x7ff4bc15a520 2024-09-13T16:02:26.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.761+0000 7ff4baa00640 1 --2- 172.21.15.70:0/3237723564 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4bc0b1b00 0x7ff4bc151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:26.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.761+0000 7ff4bb400640 1 --2- 172.21.15.70:0/3237723564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4bc15a520 0x7ff4bc1449d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4034040 tx=0x7ff4b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:26.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.761+0000 7ff4b3e00640 1 -- 172.21.15.70:0/3237723564 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b403d860 con 0x7ff4bc15a520 2024-09-13T16:02:26.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.761+0000 7ff4b3e00640 1 -- 172.21.15.70:0/3237723564 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b403d9c0 con 0x7ff4bc15a520 2024-09-13T16:02:26.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.761+0000 7ff4b3e00640 1 -- 172.21.15.70:0/3237723564 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b403dd70 con 0x7ff4bc15a520 2024-09-13T16:02:26.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.761+0000 7ff4c1e00640 1 -- 172.21.15.70:0/3237723564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4bc153120 con 0x7ff4bc15a520 2024-09-13T16:02:26.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.761+0000 7ff4c1e00640 1 -- 172.21.15.70:0/3237723564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4bc1536e0 con 0x7ff4bc15a520 2024-09-13T16:02:26.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.762+0000 7ff4c1e00640 1 -- 172.21.15.70:0/3237723564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4bc1538d0 con 0x7ff4bc15a520 2024-09-13T16:02:26.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.763+0000 7ff4b3e00640 1 -- 172.21.15.70:0/3237723564 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff4b403b400 con 0x7ff4bc15a520 2024-09-13T16:02:26.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.764+0000 7ff4b3e00640 1 --2- 172.21.15.70:0/3237723564 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ff49806ac00 0x7ff49806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:26.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.764+0000 7ff4b3e00640 1 -- 172.21.15.70:0/3237723564 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4b40aa2c0 con 0x7ff4bc15a520 2024-09-13T16:02:26.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.764+0000 7ff4baa00640 1 --2- 172.21.15.70:0/3237723564 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ff49806ac00 0x7ff49806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:26.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.765+0000 7ff4baa00640 1 --2- 172.21.15.70:0/3237723564 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ff49806ac00 0x7ff49806d0c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009a20 tx=0x7ff4ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:26.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.769+0000 7ff4b3e00640 1 -- 172.21.15.70:0/3237723564 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff4b4075400 con 0x7ff4bc15a520 2024-09-13T16:02:26.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.971+0000 7ff4c1e00640 1 -- 172.21.15.70:0/3237723564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4bc15a900 con 0x7ff4bc15a520 2024-09-13T16:02:26.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.972+0000 7ff4b3e00640 1 -- 172.21.15.70:0/3237723564 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4740 (secure 0 0 0) 0x7ff4b4009510 con 0x7ff4bc15a520 2024-09-13T16:02:26.973 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:26.973 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/1247927631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1247927631},{"type":"v1","addr":"172.21.15.70:6836","nonce":1247927631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/1077617661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1077617661},{"type":"v1","addr":"172.21.15.107:6834","nonce":1077617661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2709979655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2709979655},{"type":"v1","addr":"172.21.15.107:6835","nonce":2709979655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:02:16.987283+0000","modified":"2024-09-13T16:02:20.008275+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6837/3554365995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":3554365995},{"type":"v1","addr":"172.21.15.70:6837","nonce":3554365995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T16:02:26.974 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 16 2024-09-13T16:02:26.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.974+0000 7ff4c1e00640 1 -- 172.21.15.70:0/3237723564 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ff49806ac00 msgr2=0x7ff49806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:26.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.974+0000 7ff4c1e00640 1 --2- 172.21.15.70:0/3237723564 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ff49806ac00 0x7ff49806d0c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009a20 tx=0x7ff4ac008040 comp rx=0 tx=0).stop 2024-09-13T16:02:26.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.974+0000 7ff4c1e00640 1 -- 172.21.15.70:0/3237723564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4bc15a520 msgr2=0x7ff4bc1449d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:26.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.974+0000 7ff4c1e00640 1 --2- 172.21.15.70:0/3237723564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4bc15a520 0x7ff4bc1449d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4034040 tx=0x7ff4b4004a40 comp rx=0 tx=0).stop 2024-09-13T16:02:26.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.974+0000 7ff4c1e00640 1 -- 172.21.15.70:0/3237723564 shutdown_connections 2024-09-13T16:02:26.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.974+0000 7ff4c1e00640 1 --2- 172.21.15.70:0/3237723564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4bc15a520 0x7ff4bc1449d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.974+0000 7ff4c1e00640 1 --2- 172.21.15.70:0/3237723564 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ff49806ac00 0x7ff49806d0c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.974+0000 7ff4c1e00640 1 --2- 172.21.15.70:0/3237723564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4bc0ce020 0x7ff4bc143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.974+0000 7ff4c1e00640 1 --2- 172.21.15.70:0/3237723564 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4bc0b1b00 0x7ff4bc151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:26.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.974+0000 7ff4c1e00640 1 -- 172.21.15.70:0/3237723564 >> 172.21.15.70:0/3237723564 conn(0x7ff4bc0b0510 msgr2=0x7ff4bc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:26.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.974+0000 7ff4c1e00640 1 -- 172.21.15.70:0/3237723564 shutdown_connections 2024-09-13T16:02:26.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:26.974+0000 7ff4c1e00640 1 -- 172.21.15.70:0/3237723564 wait complete. 2024-09-13T16:02:27.394 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T16:02:16.987283+0000', 'modified': '2024-09-13T16:02:20.008275+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5127}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5127': {'gid': 5127, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.70:6837/3554365995', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6835', 'nonce': 3554365995}, {'type': 'v1', 'addr': '172.21.15.70:6837', 'nonce': 3554365995}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T16:02:27.394 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T16:02:27.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T16:02:27.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.548+0000 7f1815400640 1 Processor -- start 2024-09-13T16:02:27.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.548+0000 7f1815400640 1 -- start start 2024-09-13T16:02:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.549+0000 7f1815400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18100b3080 0x7f18100b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.549+0000 7f1815400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f18100cd080 0x7f18100cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.550+0000 7f1815400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18100b3a00 con 0x7f1810159610 2024-09-13T16:02:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.550+0000 7f1815400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18101599f0 con 0x7f18100cd080 2024-09-13T16:02:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.550+0000 7f1815400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1810070710 con 0x7f18100b3080 2024-09-13T16:02:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.550+0000 7f1807e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18100b3080 0x7f18100b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.550+0000 7f1807e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18100b3080 0x7f18100b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:39052/0 (socket says 172.21.15.70:39052) 2024-09-13T16:02:27.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.550+0000 7f180e800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f1810159610 0x7f1810070000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:42122/0 (socket says 172.21.15.70:42122) 2024-09-13T16:02:27.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.550+0000 7f1807e00640 1 -- 172.21.15.70:0/2052086416 learned_addr learned my addr 172.21.15.70:0/2052086416 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:27.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.550+0000 7f180f200640 1 --2- 172.21.15.70:0/2052086416 >> v2:172.21.15.107:3300/0 conn(0x7f18100cd080 0x7f18100cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.550+0000 7f180de00640 1 -- 172.21.15.70:0/2052086416 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388176361 0 0) 0x7f18100b3a00 con 0x7f1810159610 2024-09-13T16:02:27.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.551+0000 7f1807e00640 1 -- 172.21.15.70:0/2052086416 >> v2:172.21.15.107:3300/0 conn(0x7f18100cd080 msgr2=0x7f18100cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:27.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.551+0000 7f1807e00640 1 --2- 172.21.15.70:0/2052086416 >> v2:172.21.15.107:3300/0 conn(0x7f18100cd080 0x7f18100cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.551+0000 7f1807e00640 1 -- 172.21.15.70:0/2052086416 >> v1:172.21.15.107:6789/0 conn(0x7f1810159610 legacy=0x7f1810070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:27.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.551+0000 7f1807e00640 1 -- 172.21.15.70:0/2052086416 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18100709e0 con 0x7f18100b3080 2024-09-13T16:02:27.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.551+0000 7f180f200640 1 --2- 172.21.15.70:0/2052086416 >> v2:172.21.15.107:3300/0 conn(0x7f18100cd080 0x7f18100cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:27.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.552+0000 7f1807e00640 1 --2- 172.21.15.70:0/2052086416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18100b3080 0x7f18100b34c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009870 tx=0x7f17f802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8da0392ced94ead3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:27.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.552+0000 7f180de00640 1 -- 172.21.15.70:0/2052086416 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f8032440 con 0x7f18100b3080 2024-09-13T16:02:27.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.552+0000 7f180de00640 1 -- 172.21.15.70:0/2052086416 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f80325a0 con 0x7f18100b3080 2024-09-13T16:02:27.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.552+0000 7f180de00640 1 -- 172.21.15.70:0/2052086416 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f8032930 con 0x7f18100b3080 2024-09-13T16:02:27.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.552+0000 7f1815400640 1 -- 172.21.15.70:0/2052086416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18100b3080 msgr2=0x7f18100b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:27.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.552+0000 7f1815400640 1 --2- 172.21.15.70:0/2052086416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18100b3080 0x7f18100b34c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009870 tx=0x7f17f802a250 comp rx=0 tx=0).stop 2024-09-13T16:02:27.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.552+0000 7f1815400640 1 -- 172.21.15.70:0/2052086416 shutdown_connections 2024-09-13T16:02:27.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.552+0000 7f1815400640 1 --2- 172.21.15.70:0/2052086416 >> v2:172.21.15.107:3300/0 conn(0x7f18100cd080 0x7f18100cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.552+0000 7f1815400640 1 --2- 172.21.15.70:0/2052086416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18100b3080 0x7f18100b34c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.552+0000 7f1815400640 1 -- 172.21.15.70:0/2052086416 >> 172.21.15.70:0/2052086416 conn(0x7f18100b0510 msgr2=0x7f18100b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:27.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.553+0000 7f1815400640 1 -- 172.21.15.70:0/2052086416 shutdown_connections 2024-09-13T16:02:27.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.553+0000 7f1815400640 1 -- 172.21.15.70:0/2052086416 wait complete. 2024-09-13T16:02:27.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.554+0000 7f1815400640 1 Processor -- start 2024-09-13T16:02:27.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.554+0000 7f1815400640 1 -- start start 2024-09-13T16:02:27.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.555+0000 7f1815400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18100b3080 0x7f18101f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.555+0000 7f1815400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18100cd080 0x7f18100acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.555+0000 7f1815400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1810159610 0x7f181015bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.555+0000 7f1815400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181015af60 con 0x7f18100cd080 2024-09-13T16:02:27.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.555+0000 7f1815400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181015b800 con 0x7f18100b3080 2024-09-13T16:02:27.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.555+0000 7f1815400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1810153d40 con 0x7f1810159610 2024-09-13T16:02:27.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.555+0000 7f1807e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18100cd080 0x7f18100acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.555+0000 7f1807e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18100cd080 0x7f18100acae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37144/0 (socket says 172.21.15.70:37144) 2024-09-13T16:02:27.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.555+0000 7f1807e00640 1 -- 172.21.15.70:0/115940050 learned_addr learned my addr 172.21.15.70:0/115940050 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:27.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.556+0000 7f180e800640 1 --2- 172.21.15.70:0/115940050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18100b3080 0x7f18101f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.556+0000 7f180f200640 1 --2- 172.21.15.70:0/115940050 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1810159610 0x7f181015bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.556+0000 7f1807e00640 1 -- 172.21.15.70:0/115940050 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1810159610 msgr2=0x7f181015bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:27.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.556+0000 7f1807e00640 1 --2- 172.21.15.70:0/115940050 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1810159610 0x7f181015bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.556+0000 7f1807e00640 1 -- 172.21.15.70:0/115940050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18100b3080 msgr2=0x7f18101f2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:27.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.556+0000 7f1807e00640 1 --2- 172.21.15.70:0/115940050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18100b3080 0x7f18101f2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.556+0000 7f1807e00640 1 -- 172.21.15.70:0/115940050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1808009a70 con 0x7f18100cd080 2024-09-13T16:02:27.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.556+0000 7f180e800640 1 --2- 172.21.15.70:0/115940050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18100b3080 0x7f18101f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:27.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.556+0000 7f1807e00640 1 --2- 172.21.15.70:0/115940050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18100cd080 0x7f18100acae0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f17f802a290 tx=0x7f17f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:27.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.557+0000 7f1806a00640 1 -- 172.21.15.70:0/115940050 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f8032440 con 0x7f18100cd080 2024-09-13T16:02:27.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.557+0000 7f1806a00640 1 -- 172.21.15.70:0/115940050 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f8030980 con 0x7f18100cd080 2024-09-13T16:02:27.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.557+0000 7f1815400640 1 -- 172.21.15.70:0/115940050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f80094d0 con 0x7f18100cd080 2024-09-13T16:02:27.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.557+0000 7f1806a00640 1 -- 172.21.15.70:0/115940050 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f8030d30 con 0x7f18100cd080 2024-09-13T16:02:27.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.557+0000 7f1815400640 1 -- 172.21.15.70:0/115940050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181015b490 con 0x7f18100cd080 2024-09-13T16:02:27.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.559+0000 7f1806a00640 1 -- 172.21.15.70:0/115940050 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f17f8039040 con 0x7f18100cd080 2024-09-13T16:02:27.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.560+0000 7f1806a00640 1 --2- 172.21.15.70:0/115940050 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f17ec06ac00 0x7f17ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.560+0000 7f1806a00640 1 -- 172.21.15.70:0/115940050 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17f80a9c70 con 0x7f18100cd080 2024-09-13T16:02:27.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.561+0000 7f180e800640 1 --2- 172.21.15.70:0/115940050 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f17ec06ac00 0x7f17ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.561+0000 7f1818247740 1 Processor -- start 2024-09-13T16:02:27.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.561+0000 7f1818247740 1 -- start start 2024-09-13T16:02:27.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.561+0000 7f180e800640 1 --2- 172.21.15.70:0/115940050 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f17ec06ac00 0x7f17ec06d0c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1800000f60 tx=0x7f1800007ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:27.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.562+0000 7f1818247740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46ac84ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.562+0000 7f1818247740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46ac81e90 0x55e46acd1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.562+0000 7f1818247740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acabb80 0x55e46acd20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.562+0000 7f1818247740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e46abedab0 con 0x55e46ac846d0 2024-09-13T16:02:27.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.562+0000 7f1818247740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e46abeb240 con 0x55e46acabb80 2024-09-13T16:02:27.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.562+0000 7f1818247740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e46abe6b30 con 0x55e46ac81e90 2024-09-13T16:02:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.562+0000 7f180e800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46ac84ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.562+0000 7f180e800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46ac84ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37152/0 (socket says 172.21.15.70:37152) 2024-09-13T16:02:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.562+0000 7f180e800640 1 -- 172.21.15.70:0/1485639902 learned_addr learned my addr 172.21.15.70:0/1485639902 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.563+0000 7f180e800640 1 -- 172.21.15.70:0/1485639902 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46ac81e90 msgr2=0x55e46acd1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.563+0000 7f1807e00640 1 --2- 172.21.15.70:0/1485639902 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46ac81e90 0x55e46acd1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.563+0000 7f180f200640 1 --2- 172.21.15.70:0/1485639902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acabb80 0x55e46acd20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.563+0000 7f180e800640 1 --2- 172.21.15.70:0/1485639902 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46ac81e90 0x55e46acd1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.563+0000 7f180e800640 1 -- 172.21.15.70:0/1485639902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acabb80 msgr2=0x55e46acd20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.563+0000 7f180e800640 1 --2- 172.21.15.70:0/1485639902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acabb80 0x55e46acd20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.563+0000 7f180e800640 1 -- 172.21.15.70:0/1485639902 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e46abb1bd0 con 0x55e46ac846d0 2024-09-13T16:02:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.563+0000 7f180f200640 1 --2- 172.21.15.70:0/1485639902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acabb80 0x55e46acd20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.563+0000 7f1807e00640 1 --2- 172.21.15.70:0/1485639902 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46ac81e90 0x55e46acd1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.563+0000 7f180e800640 1 --2- 172.21.15.70:0/1485639902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46ac84ab0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1800005f20 tx=0x7f1800012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5c6a9f3d4731d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:27.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.563+0000 7f17ff400640 1 -- 172.21.15.70:0/1485639902 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800001d20 con 0x55e46ac846d0 2024-09-13T16:02:27.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.563+0000 7f17ff400640 1 -- 172.21.15.70:0/1485639902 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18000159c0 con 0x55e46ac846d0 2024-09-13T16:02:27.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.563+0000 7f17ff400640 1 -- 172.21.15.70:0/1485639902 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800015d30 con 0x55e46ac846d0 2024-09-13T16:02:27.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.564+0000 7f1818247740 1 -- 172.21.15.70:0/1485639902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 msgr2=0x55e46ac84ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:27.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.564+0000 7f1818247740 1 --2- 172.21.15.70:0/1485639902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46ac84ab0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1800005f20 tx=0x7f1800012000 comp rx=0 tx=0).stop 2024-09-13T16:02:27.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.564+0000 7f1818247740 1 -- 172.21.15.70:0/1485639902 shutdown_connections 2024-09-13T16:02:27.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.564+0000 7f1818247740 1 --2- 172.21.15.70:0/1485639902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acabb80 0x55e46acd20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.564+0000 7f1818247740 1 --2- 172.21.15.70:0/1485639902 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46ac81e90 0x55e46acd1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.564+0000 7f1818247740 1 --2- 172.21.15.70:0/1485639902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46ac84ab0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.564+0000 7f1818247740 1 -- 172.21.15.70:0/1485639902 >> 172.21.15.70:0/1485639902 conn(0x55e46ac80e00 msgr2=0x55e46acc92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:27.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.564+0000 7f1818247740 1 -- 172.21.15.70:0/1485639902 shutdown_connections 2024-09-13T16:02:27.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.564+0000 7f1818247740 1 -- 172.21.15.70:0/1485639902 wait complete. 2024-09-13T16:02:27.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.564+0000 7f1818247740 1 -- start start 2024-09-13T16:02:27.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.565+0000 7f1818247740 1 Processor -- start 2024-09-13T16:02:27.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.566+0000 7f1818247740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46acada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.566+0000 7f1818247740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46acabb80 0x55e46acaa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.566+0000 7f1818247740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acd0ca0 0x55e46ac95c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.566+0000 7f1818247740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e46ab88260 con 0x55e46ac846d0 2024-09-13T16:02:27.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.566+0000 7f1818247740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e46ab87f00 con 0x55e46acd0ca0 2024-09-13T16:02:27.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.566+0000 7f1818247740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e46a94df20 con 0x55e46acabb80 2024-09-13T16:02:27.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.566+0000 7f1818247740 10 client.0 _ll_register_callbacks cb 0x55e46abe01a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:02:27.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.566+0000 7f180e800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46acada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.566+0000 7f180e800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46acada10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37168/0 (socket says 172.21.15.70:37168) 2024-09-13T16:02:27.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.566+0000 7f180e800640 1 -- 172.21.15.70:0/511172144 learned_addr learned my addr 172.21.15.70:0/511172144 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.566+0000 7f180e800640 1 -- 172.21.15.70:0/511172144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46acabb80 msgr2=0x55e46acaa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.566+0000 7f180e800640 1 --2- 172.21.15.70:0/511172144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46acabb80 0x55e46acaa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.566+0000 7f180e800640 1 -- 172.21.15.70:0/511172144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acd0ca0 msgr2=0x55e46ac95c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.566+0000 7f180e800640 1 --2- 172.21.15.70:0/511172144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acd0ca0 0x55e46ac95c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.566+0000 7f180e800640 1 -- 172.21.15.70:0/511172144 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180000f040 con 0x55e46ac846d0 2024-09-13T16:02:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.567+0000 7f180e800640 1 --2- 172.21.15.70:0/511172144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46acada10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1800015de0 tx=0x7f1800000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fe096f38432405 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.567+0000 7f17f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-13T16:02:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.567+0000 7f17f3e00640 1 -- 172.21.15.70:0/511172144 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800001d20 con 0x55e46ac846d0 2024-09-13T16:02:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.567+0000 7f17f3e00640 1 -- 172.21.15.70:0/511172144 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1800021660 con 0x55e46ac846d0 2024-09-13T16:02:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.567+0000 7f1818247740 1 -- 172.21.15.70:0/511172144 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e46ac10cd0 con 0x55e46ac846d0 2024-09-13T16:02:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.567+0000 7f17f3e00640 1 -- 172.21.15.70:0/511172144 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1800021820 con 0x55e46ac846d0 2024-09-13T16:02:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.567+0000 7f1818247740 10 client.5322 fetch_fsmap learned FSMap version 16 2024-09-13T16:02:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.567+0000 7f1818247740 1 -- 172.21.15.70:0/511172144 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55e46abe51b0 con 0x55e46ac846d0 2024-09-13T16:02:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.567+0000 7f17f3e00640 1 -- 172.21.15.70:0/511172144 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e46ac10cd0 con 0x55e46ac846d0 2024-09-13T16:02:27.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.567+0000 7f17f3e00640 1 -- 172.21.15.70:0/511172144 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f1800021980 con 0x55e46ac846d0 2024-09-13T16:02:27.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.567+0000 7f1818247740 10 client.5322 fetch_fsmap finished waiting for FSMap version 16 2024-09-13T16:02:27.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.567+0000 7f1818247740 10 client.5322 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T16:02:27.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.567+0000 7f1818247740 20 client.5322 populate_metadata read hostname 'smithi070' 2024-09-13T16:02:27.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.567+0000 7f1818247740 1 --2- 172.21.15.70:0/511172144 >> [v2:172.21.15.70:6835/3554365995,v1:172.21.15.70:6837/3554365995] conn(0x55e46acc6200 0x55e46ac97d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.567+0000 7f1818247740 4 client.5322 mds_command: new command op to 5127 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:02:27.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.567+0000 7f1818247740 1 -- 172.21.15.70:0/511172144 --> [v2:172.21.15.70:6835/3554365995,v1:172.21.15.70:6837/3554365995] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e46a8da3c0 con 0x55e46acc6200 2024-09-13T16:02:27.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.568+0000 7f1807e00640 1 --2- 172.21.15.70:0/511172144 >> [v2:172.21.15.70:6835/3554365995,v1:172.21.15.70:6837/3554365995] conn(0x55e46acc6200 0x55e46ac97d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.568+0000 7f1807e00640 1 --2- 172.21.15.70:0/511172144 >> [v2:172.21.15.70:6835/3554365995,v1:172.21.15.70:6837/3554365995] conn(0x55e46acc6200 0x55e46ac97d20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a059cf8e4f42dea server_cookie=6e2841a5f13ca539 in_seq=0 out_seq=0 2024-09-13T16:02:27.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.568+0000 7f17f3e00640 10 client.5322 ms_handle_connect on v2:172.21.15.70:6835/3554365995 2024-09-13T16:02:27.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.569+0000 7f17f3e00640 1 -- 172.21.15.70:0/511172144 <== mds.0 v2:172.21.15.70:6835/3554365995 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e46a8da3c0 con 0x55e46acc6200 2024-09-13T16:02:27.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.569+0000 7f17f3e00640 10 client.5322 handle_command_reply: tid=0 2024-09-13T16:02:27.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.569+0000 7f1818247740 1 client.5322 shutdown 2024-09-13T16:02:27.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.569+0000 7f1818247740 1 -- 172.21.15.70:0/511172144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 msgr2=0x55e46acada10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:27.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.569+0000 7f1818247740 1 --2- 172.21.15.70:0/511172144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46acada10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1800015de0 tx=0x7f1800000ed0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.569+0000 7f1818247740 1 -- 172.21.15.70:0/511172144 shutdown_connections 2024-09-13T16:02:27.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.569+0000 7f1818247740 1 --2- 172.21.15.70:0/511172144 >> [v2:172.21.15.70:6835/3554365995,v1:172.21.15.70:6837/3554365995] conn(0x55e46acc6200 0x55e46ac97d20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.569+0000 7f1818247740 1 --2- 172.21.15.70:0/511172144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acd0ca0 0x55e46ac95c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.569+0000 7f1818247740 1 --2- 172.21.15.70:0/511172144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46acabb80 0x55e46acaa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.569+0000 7f1818247740 1 --2- 172.21.15.70:0/511172144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46acada10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.569+0000 7f17f3e00640 0 client.5322 ms_handle_reset on v2:172.21.15.70:6835/3554365995 2024-09-13T16:02:27.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.569+0000 7f1818247740 1 -- 172.21.15.70:0/511172144 >> 172.21.15.70:0/511172144 conn(0x55e46ac81e90 msgr2=0x55e46accc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:27.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.569+0000 7f1818247740 1 -- 172.21.15.70:0/511172144 shutdown_connections 2024-09-13T16:02:27.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.569+0000 7f1818247740 1 -- 172.21.15.70:0/511172144 wait complete. 2024-09-13T16:02:27.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.570+0000 7f1818247740 20 client.5322 trim_cache size 0 max 16384 2024-09-13T16:02:27.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.585+0000 7f1818247740 1 Processor -- start 2024-09-13T16:02:27.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.585+0000 7f1818247740 1 -- start start 2024-09-13T16:02:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.585+0000 7f1818247740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46accc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.585+0000 7f1818247740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46acabb80 0x55e46accccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.585+0000 7f1818247740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acd0ca0 0x55e46acc4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.586+0000 7f1818247740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e46acae4c0 con 0x55e46ac846d0 2024-09-13T16:02:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.586+0000 7f1818247740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e46accb760 con 0x55e46acd0ca0 2024-09-13T16:02:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.586+0000 7f1818247740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e46acc6f10 con 0x55e46acabb80 2024-09-13T16:02:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.586+0000 7f180e800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46accc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.586+0000 7f180e800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46accc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37170/0 (socket says 172.21.15.70:37170) 2024-09-13T16:02:27.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.586+0000 7f180e800640 1 -- 172.21.15.70:0/2261376047 learned_addr learned my addr 172.21.15.70:0/2261376047 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:27.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.586+0000 7f1807e00640 1 --2- 172.21.15.70:0/2261376047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46acabb80 0x55e46accccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.586+0000 7f180f200640 1 --2- 172.21.15.70:0/2261376047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acd0ca0 0x55e46acc4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.586+0000 7f180e800640 1 -- 172.21.15.70:0/2261376047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46acabb80 msgr2=0x55e46accccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:27.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.586+0000 7f180e800640 1 --2- 172.21.15.70:0/2261376047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46acabb80 0x55e46accccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.586+0000 7f180e800640 1 -- 172.21.15.70:0/2261376047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acd0ca0 msgr2=0x55e46acc4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:27.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.586+0000 7f180e800640 1 --2- 172.21.15.70:0/2261376047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acd0ca0 0x55e46acc4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.586+0000 7f180e800640 1 -- 172.21.15.70:0/2261376047 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e46ab87470 con 0x55e46ac846d0 2024-09-13T16:02:27.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.586+0000 7f1807e00640 1 --2- 172.21.15.70:0/2261376047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46acabb80 0x55e46accccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:27.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.586+0000 7f180e800640 1 --2- 172.21.15.70:0/2261376047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46accc770 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f18000015c0 tx=0x7f1800027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c89b3e4b6dd94b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:27.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.587+0000 7f17ffe00640 1 -- 172.21.15.70:0/2261376047 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180002b660 con 0x55e46ac846d0 2024-09-13T16:02:27.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.587+0000 7f17ffe00640 1 -- 172.21.15.70:0/2261376047 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180000b070 con 0x55e46ac846d0 2024-09-13T16:02:27.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.587+0000 7f17ffe00640 1 -- 172.21.15.70:0/2261376047 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180002bcc0 con 0x55e46ac846d0 2024-09-13T16:02:27.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.587+0000 7f1818247740 1 -- 172.21.15.70:0/2261376047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 msgr2=0x55e46accc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:27.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.587+0000 7f1818247740 1 --2- 172.21.15.70:0/2261376047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46accc770 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f18000015c0 tx=0x7f1800027000 comp rx=0 tx=0).stop 2024-09-13T16:02:27.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.587+0000 7f1818247740 1 -- 172.21.15.70:0/2261376047 shutdown_connections 2024-09-13T16:02:27.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.587+0000 7f1818247740 1 --2- 172.21.15.70:0/2261376047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acd0ca0 0x55e46acc4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.587+0000 7f1818247740 1 --2- 172.21.15.70:0/2261376047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46acabb80 0x55e46accccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.587+0000 7f1818247740 1 --2- 172.21.15.70:0/2261376047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46accc770 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.587+0000 7f1818247740 1 -- 172.21.15.70:0/2261376047 >> 172.21.15.70:0/2261376047 conn(0x55e46ac81e90 msgr2=0x55e46acad9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:27.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.587+0000 7f1818247740 1 -- 172.21.15.70:0/2261376047 shutdown_connections 2024-09-13T16:02:27.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.587+0000 7f1818247740 1 -- 172.21.15.70:0/2261376047 wait complete. 2024-09-13T16:02:27.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.588+0000 7f1818247740 1 -- start start 2024-09-13T16:02:27.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.588+0000 7f1818247740 1 Processor -- start 2024-09-13T16:02:27.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.589+0000 7f1818247740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46ad29560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.589+0000 7f1818247740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acabb80 0x55e46ad36a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.589+0000 7f1818247740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46acd0ca0 0x55e46acc9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.589+0000 7f1818247740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e46aca7f60 con 0x55e46ac846d0 2024-09-13T16:02:27.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.589+0000 7f1818247740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e46acc4b80 con 0x55e46acabb80 2024-09-13T16:02:27.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.589+0000 7f1818247740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e46acdb990 con 0x55e46acd0ca0 2024-09-13T16:02:27.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.589+0000 7f1818247740 10 client.0 _ll_register_callbacks cb 0x7f1800005f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:02:27.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.589+0000 7f180e800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46ad29560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.589+0000 7f180e800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46ad29560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37184/0 (socket says 172.21.15.70:37184) 2024-09-13T16:02:27.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.589+0000 7f180e800640 1 -- 172.21.15.70:0/613980738 learned_addr learned my addr 172.21.15.70:0/613980738 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:27.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.589+0000 7f1807e00640 1 --2- 172.21.15.70:0/613980738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acabb80 0x55e46ad36a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.589+0000 7f180f200640 1 --2- 172.21.15.70:0/613980738 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46acd0ca0 0x55e46acc9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.590+0000 7f180e800640 1 -- 172.21.15.70:0/613980738 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46acd0ca0 msgr2=0x55e46acc9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:27.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.590+0000 7f180e800640 1 --2- 172.21.15.70:0/613980738 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46acd0ca0 0x55e46acc9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.590+0000 7f180e800640 1 -- 172.21.15.70:0/613980738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acabb80 msgr2=0x55e46ad36a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:27.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.590+0000 7f180e800640 1 --2- 172.21.15.70:0/613980738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acabb80 0x55e46ad36a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.590+0000 7f180e800640 1 -- 172.21.15.70:0/613980738 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e46abe51b0 con 0x55e46ac846d0 2024-09-13T16:02:27.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.590+0000 7f1807e00640 1 --2- 172.21.15.70:0/613980738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acabb80 0x55e46ad36a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:27.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.590+0000 7f180e800640 1 --2- 172.21.15.70:0/613980738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46ad29560 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1800007400 tx=0x7f1800009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de74566b55dd723f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:27.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.590+0000 7f17f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-13T16:02:27.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.590+0000 7f17f3e00640 1 -- 172.21.15.70:0/613980738 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800021860 con 0x55e46ac846d0 2024-09-13T16:02:27.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.590+0000 7f17f3e00640 1 -- 172.21.15.70:0/613980738 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1800001d20 con 0x55e46ac846d0 2024-09-13T16:02:27.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.590+0000 7f1818247740 1 -- 172.21.15.70:0/613980738 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f18000159c0 con 0x55e46ac846d0 2024-09-13T16:02:27.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.590+0000 7f17f3e00640 1 -- 172.21.15.70:0/613980738 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18000219c0 con 0x55e46ac846d0 2024-09-13T16:02:27.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.590+0000 7f1818247740 10 client.5328 fetch_fsmap learned FSMap version 16 2024-09-13T16:02:27.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.590+0000 7f1818247740 1 -- 172.21.15.70:0/613980738 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55e46abac980 con 0x55e46ac846d0 2024-09-13T16:02:27.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.591+0000 7f17f3e00640 1 -- 172.21.15.70:0/613980738 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18000159c0 con 0x55e46ac846d0 2024-09-13T16:02:27.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.591+0000 7f17f3e00640 1 -- 172.21.15.70:0/613980738 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f1800043070 con 0x55e46ac846d0 2024-09-13T16:02:27.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.591+0000 7f1818247740 10 client.5328 fetch_fsmap finished waiting for FSMap version 16 2024-09-13T16:02:27.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.591+0000 7f1818247740 10 client.5328 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T16:02:27.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.591+0000 7f1818247740 20 client.5328 populate_metadata read hostname 'smithi070' 2024-09-13T16:02:27.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.591+0000 7f1818247740 1 --2- 172.21.15.70:0/613980738 >> [v2:172.21.15.70:6835/3554365995,v1:172.21.15.70:6837/3554365995] conn(0x55e46ad32c60 0x55e46ad33040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.591+0000 7f1818247740 4 client.5328 mds_command: new command op to 5127 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T16:02:27.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.591+0000 7f1818247740 1 -- 172.21.15.70:0/613980738 --> [v2:172.21.15.70:6835/3554365995,v1:172.21.15.70:6837/3554365995] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e46a8eb6c0 con 0x55e46ad32c60 2024-09-13T16:02:27.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.591+0000 7f1807e00640 1 --2- 172.21.15.70:0/613980738 >> [v2:172.21.15.70:6835/3554365995,v1:172.21.15.70:6837/3554365995] conn(0x55e46ad32c60 0x55e46ad33040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.592+0000 7f1807e00640 1 --2- 172.21.15.70:0/613980738 >> [v2:172.21.15.70:6835/3554365995,v1:172.21.15.70:6837/3554365995] conn(0x55e46ad32c60 0x55e46ad33040 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6212170e1b0880e3 server_cookie=1eeca16106fbec0f in_seq=0 out_seq=0 2024-09-13T16:02:27.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.592+0000 7f17f3e00640 10 client.5328 ms_handle_connect on v2:172.21.15.70:6835/3554365995 2024-09-13T16:02:27.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.592+0000 7f17f3e00640 1 -- 172.21.15.70:0/613980738 <== mds.0 v2:172.21.15.70:6835/3554365995 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55e46a8eb6c0 con 0x55e46ad32c60 2024-09-13T16:02:27.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.592+0000 7f17f3e00640 10 client.5328 handle_command_reply: tid=0 2024-09-13T16:02:27.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.592+0000 7f1818247740 1 client.5328 shutdown 2024-09-13T16:02:27.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.592+0000 7f1818247740 1 -- 172.21.15.70:0/613980738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 msgr2=0x55e46ad29560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:27.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.592+0000 7f1818247740 1 --2- 172.21.15.70:0/613980738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46ad29560 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1800007400 tx=0x7f1800009030 comp rx=0 tx=0).stop 2024-09-13T16:02:27.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.592+0000 7f1818247740 1 -- 172.21.15.70:0/613980738 shutdown_connections 2024-09-13T16:02:27.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.592+0000 7f1818247740 1 --2- 172.21.15.70:0/613980738 >> [v2:172.21.15.70:6835/3554365995,v1:172.21.15.70:6837/3554365995] conn(0x55e46ad32c60 0x55e46ad33040 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.592+0000 7f1818247740 1 --2- 172.21.15.70:0/613980738 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55e46acd0ca0 0x55e46acc9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.592+0000 7f1818247740 1 --2- 172.21.15.70:0/613980738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e46acabb80 0x55e46ad36a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.592+0000 7f1818247740 1 --2- 172.21.15.70:0/613980738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e46ac846d0 0x55e46ad29560 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.592+0000 7f17f3e00640 0 client.5328 ms_handle_reset on v2:172.21.15.70:6835/3554365995 2024-09-13T16:02:27.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.592+0000 7f1818247740 1 -- 172.21.15.70:0/613980738 >> 172.21.15.70:0/613980738 conn(0x55e46ac81e90 msgr2=0x55e46accae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:27.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.592+0000 7f1818247740 1 -- 172.21.15.70:0/613980738 shutdown_connections 2024-09-13T16:02:27.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.592+0000 7f1818247740 1 -- 172.21.15.70:0/613980738 wait complete. 2024-09-13T16:02:27.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.592+0000 7f1818247740 20 client.5328 trim_cache size 0 max 16384 2024-09-13T16:02:27.598 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-13T16:02:27.599 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "f906ab4b-6171-41ec-a825-cd0f700d3930", 2024-09-13T16:02:27.599 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-09-13T16:02:27.599 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 5127, 2024-09-13T16:02:27.599 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-13T16:02:27.599 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-13T16:02:27.599 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-13T16:02:27.599 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 10.601817051999999, 2024-09-13T16:02:27.599 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 16, 2024-09-13T16:02:27.599 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 34, 2024-09-13T16:02:27.599 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 34, 2024-09-13T16:02:27.599 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 18.032696364 2024-09-13T16:02:27.599 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-13T16:02:27.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.593+0000 7f1815400640 1 -- 172.21.15.70:0/115940050 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f17ec06ac00 msgr2=0x7f17ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:27.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.593+0000 7f1815400640 1 --2- 172.21.15.70:0/115940050 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f17ec06ac00 0x7f17ec06d0c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1800000f60 tx=0x7f1800007ca0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.593+0000 7f1815400640 1 -- 172.21.15.70:0/115940050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18100cd080 msgr2=0x7f18100acae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:27.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.593+0000 7f1815400640 1 --2- 172.21.15.70:0/115940050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18100cd080 0x7f18100acae0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f17f802a290 tx=0x7f17f80046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.593+0000 7f1815400640 1 -- 172.21.15.70:0/115940050 shutdown_connections 2024-09-13T16:02:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.593+0000 7f1815400640 1 --2- 172.21.15.70:0/115940050 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1810159610 0x7f181015bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.593+0000 7f1815400640 1 --2- 172.21.15.70:0/115940050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18100cd080 0x7f18100acae0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.593+0000 7f1815400640 1 --2- 172.21.15.70:0/115940050 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f17ec06ac00 0x7f17ec06d0c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.593+0000 7f1815400640 1 --2- 172.21.15.70:0/115940050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18100b3080 0x7f18101f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.593+0000 7f1815400640 1 -- 172.21.15.70:0/115940050 >> 172.21.15.70:0/115940050 conn(0x7f18100b0510 msgr2=0x7f18100b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.593+0000 7f1815400640 1 -- 172.21.15.70:0/115940050 shutdown_connections 2024-09-13T16:02:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.593+0000 7f1815400640 1 -- 172.21.15.70:0/115940050 wait complete. 2024-09-13T16:02:27.609 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T16:02:27.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.759+0000 7f768dc00640 1 Processor -- start 2024-09-13T16:02:27.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.759+0000 7f768dc00640 1 -- start start 2024-09-13T16:02:27.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.761+0000 7f768dc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76880b3990 0x7f7688159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.761+0000 7f768dc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f768806f660 0x7f768806faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.761+0000 7f768dc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7688159fc0 con 0x7f7688153b20 2024-09-13T16:02:27.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.761+0000 7f768dc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76880b3df0 con 0x7f768806f660 2024-09-13T16:02:27.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.761+0000 7f768dc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76880ce600 con 0x7f76880b3990 2024-09-13T16:02:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.761+0000 7f767fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76880b3990 0x7f7688159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.761+0000 7f7687400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f768806f660 0x7f768806faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.761+0000 7f767fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76880b3990 0x7f7688159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:39086/0 (socket says 172.21.15.70:39086) 2024-09-13T16:02:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.761+0000 7f767fe00640 1 -- 172.21.15.70:0/2407476388 learned_addr learned my addr 172.21.15.70:0/2407476388 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.762+0000 7f767fe00640 1 -- 172.21.15.70:0/2407476388 >> v2:172.21.15.107:3300/0 conn(0x7f768806f660 msgr2=0x7f768806faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.762+0000 7f767fe00640 1 --2- 172.21.15.70:0/2407476388 >> v2:172.21.15.107:3300/0 conn(0x7f768806f660 0x7f768806faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.762+0000 7f767fe00640 1 -- 172.21.15.70:0/2407476388 >> v1:172.21.15.107:6789/0 conn(0x7f7688153b20 legacy=0x7f76880b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.762+0000 7f767fe00640 1 -- 172.21.15.70:0/2407476388 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7688153f00 con 0x7f76880b3990 2024-09-13T16:02:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.763+0000 7f767fe00640 1 --2- 172.21.15.70:0/2407476388 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76880b3990 0x7f7688159a80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7670009870 tx=0x7f767002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3398e27fa6196f94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.763+0000 7f7686000640 1 -- 172.21.15.70:0/2407476388 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670032440 con 0x7f76880b3990 2024-09-13T16:02:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.763+0000 7f7686000640 1 -- 172.21.15.70:0/2407476388 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76700325a0 con 0x7f76880b3990 2024-09-13T16:02:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.763+0000 7f7686000640 1 -- 172.21.15.70:0/2407476388 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670032930 con 0x7f76880b3990 2024-09-13T16:02:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.763+0000 7f768dc00640 1 -- 172.21.15.70:0/2407476388 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76880b3990 msgr2=0x7f7688159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.763+0000 7f768dc00640 1 --2- 172.21.15.70:0/2407476388 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76880b3990 0x7f7688159a80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7670009870 tx=0x7f767002a250 comp rx=0 tx=0).stop 2024-09-13T16:02:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.764+0000 7f768dc00640 1 -- 172.21.15.70:0/2407476388 shutdown_connections 2024-09-13T16:02:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.764+0000 7f768dc00640 1 --2- 172.21.15.70:0/2407476388 >> v2:172.21.15.107:3300/0 conn(0x7f768806f660 0x7f768806faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.764+0000 7f768dc00640 1 --2- 172.21.15.70:0/2407476388 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76880b3990 0x7f7688159a80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.764+0000 7f768dc00640 1 -- 172.21.15.70:0/2407476388 >> 172.21.15.70:0/2407476388 conn(0x7f76880b0510 msgr2=0x7f76880b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.764+0000 7f768dc00640 1 -- 172.21.15.70:0/2407476388 shutdown_connections 2024-09-13T16:02:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.764+0000 7f768dc00640 1 -- 172.21.15.70:0/2407476388 wait complete. 2024-09-13T16:02:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.765+0000 7f768dc00640 1 Processor -- start 2024-09-13T16:02:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.765+0000 7f768dc00640 1 -- start start 2024-09-13T16:02:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.766+0000 7f768dc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f768806f660 0x7f76881581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.766+0000 7f768dc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76880b3990 0x7f768814e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.766+0000 7f768dc00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7688153b20 0x7f7688150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.766+0000 7f768dc00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768814eb60 con 0x7f7688153b20 2024-09-13T16:02:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.766+0000 7f768dc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7688150f40 con 0x7f768806f660 2024-09-13T16:02:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.766+0000 7f768dc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76881588a0 con 0x7f76880b3990 2024-09-13T16:02:27.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.767+0000 7f7687400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7688153b20 0x7f7688150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.767+0000 7f7687400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7688153b20 0x7f7688150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37190/0 (socket says 172.21.15.70:37190) 2024-09-13T16:02:27.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.767+0000 7f7687400640 1 -- 172.21.15.70:0/640042239 learned_addr learned my addr 172.21.15.70:0/640042239 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:27.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.767+0000 7f767fe00640 1 --2- 172.21.15.70:0/640042239 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76880b3990 0x7f768814e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.767+0000 7f7686a00640 1 --2- 172.21.15.70:0/640042239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f768806f660 0x7f76881581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.767+0000 7f7687400640 1 -- 172.21.15.70:0/640042239 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76880b3990 msgr2=0x7f768814e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:27.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.767+0000 7f7687400640 1 --2- 172.21.15.70:0/640042239 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76880b3990 0x7f768814e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.767+0000 7f7687400640 1 -- 172.21.15.70:0/640042239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f768806f660 msgr2=0x7f76881581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:27.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.767+0000 7f7687400640 1 --2- 172.21.15.70:0/640042239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f768806f660 0x7f76881581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.767+0000 7f7687400640 1 -- 172.21.15.70:0/640042239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76700094d0 con 0x7f7688153b20 2024-09-13T16:02:27.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.767+0000 7f7687400640 1 --2- 172.21.15.70:0/640042239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7688153b20 0x7f7688150a00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f768000efc0 tx=0x7f768000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:27.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.768+0000 7f767ea00640 1 -- 172.21.15.70:0/640042239 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680009ba0 con 0x7f7688153b20 2024-09-13T16:02:27.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.768+0000 7f767ea00640 1 -- 172.21.15.70:0/640042239 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768000f040 con 0x7f7688153b20 2024-09-13T16:02:27.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.768+0000 7f768dc00640 1 -- 172.21.15.70:0/640042239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7688158b80 con 0x7f7688153b20 2024-09-13T16:02:27.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.768+0000 7f767ea00640 1 -- 172.21.15.70:0/640042239 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76800146c0 con 0x7f7688153b20 2024-09-13T16:02:27.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.768+0000 7f768dc00640 1 -- 172.21.15.70:0/640042239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768815be20 con 0x7f7688153b20 2024-09-13T16:02:27.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.769+0000 7f768dc00640 1 -- 172.21.15.70:0/640042239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f768815c010 con 0x7f7688153b20 2024-09-13T16:02:27.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.770+0000 7f767ea00640 1 -- 172.21.15.70:0/640042239 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7680014820 con 0x7f7688153b20 2024-09-13T16:02:27.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.771+0000 7f767ea00640 1 --2- 172.21.15.70:0/640042239 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f766406ac00 0x7f766406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:27.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.771+0000 7f767ea00640 1 -- 172.21.15.70:0/640042239 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7680089ca0 con 0x7f7688153b20 2024-09-13T16:02:27.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.771+0000 7f7686a00640 1 --2- 172.21.15.70:0/640042239 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f766406ac00 0x7f766406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:27.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.771+0000 7f7686a00640 1 --2- 172.21.15.70:0/640042239 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f766406ac00 0x7f766406d0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f768806d8f0 tx=0x7f7678009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:27.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.775+0000 7f767ea00640 1 -- 172.21.15.70:0/640042239 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7680054fc0 con 0x7f7688153b20 2024-09-13T16:02:27.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.978+0000 7f768dc00640 1 -- 172.21.15.70:0/640042239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f768815a7b0 con 0x7f7688153b20 2024-09-13T16:02:27.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.978+0000 7f767ea00640 1 -- 172.21.15.70:0/640042239 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7680018070 con 0x7f7688153b20 2024-09-13T16:02:27.979 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T16:02:27.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.980+0000 7f768dc00640 1 -- 172.21.15.70:0/640042239 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f766406ac00 msgr2=0x7f766406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:27.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.980+0000 7f768dc00640 1 --2- 172.21.15.70:0/640042239 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f766406ac00 0x7f766406d0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f768806d8f0 tx=0x7f7678009040 comp rx=0 tx=0).stop 2024-09-13T16:02:27.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.980+0000 7f768dc00640 1 -- 172.21.15.70:0/640042239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7688153b20 msgr2=0x7f7688150a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:27.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.980+0000 7f768dc00640 1 --2- 172.21.15.70:0/640042239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7688153b20 0x7f7688150a00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f768000efc0 tx=0x7f768000c490 comp rx=0 tx=0).stop 2024-09-13T16:02:27.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.980+0000 7f768dc00640 1 -- 172.21.15.70:0/640042239 shutdown_connections 2024-09-13T16:02:27.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.980+0000 7f768dc00640 1 --2- 172.21.15.70:0/640042239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7688153b20 0x7f7688150a00 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.980+0000 7f768dc00640 1 --2- 172.21.15.70:0/640042239 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76880b3990 0x7f768814e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.980+0000 7f768dc00640 1 --2- 172.21.15.70:0/640042239 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f766406ac00 0x7f766406d0c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.980+0000 7f768dc00640 1 --2- 172.21.15.70:0/640042239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f768806f660 0x7f76881581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:27.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.980+0000 7f768dc00640 1 -- 172.21.15.70:0/640042239 >> 172.21.15.70:0/640042239 conn(0x7f76880b0510 msgr2=0x7f76881562a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:27.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.981+0000 7f768dc00640 1 -- 172.21.15.70:0/640042239 shutdown_connections 2024-09-13T16:02:27.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:27.981+0000 7f768dc00640 1 -- 172.21.15.70:0/640042239 wait complete. 2024-09-13T16:02:27.998 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T16:02:27.998 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T16:02:27.998 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2024-09-13T16:02:27.998 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T16:02:27.998 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T16:02:27.999 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T16:02:27.999 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T16:02:27.999 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T16:02:27.999 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T16:02:27.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:27.999 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2024-09-13T16:02:28.036 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T16:02:28.036 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T16:02:28.036 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T16:02:28.037 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:02:28.037 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2024-09-13T16:02:28.037 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:02:28.037 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:02:28.037 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:02:28.037 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f0 2024-09-13T16:02:28.037 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:02:28.037 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:02:28.037 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f1 2024-09-13T16:02:28.037 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:02:28.038 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:02:28.038 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T16:02:28.038 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:02:28.038 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T16:02:28.038 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 42667sec preferred_lft 42667sec 2024-09-13T16:02:28.038 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link noprefixroute 2024-09-13T16:02:28.038 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:02:28.038 INFO:teuthology.orchestra.run.smithi070.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T16:02:28.038 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 52:75:e4:2c:cd:62 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:02:28.038 INFO:teuthology.orchestra.run.smithi070.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T16:02:28.038 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:02:28.038 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::b4a8:e2ff:fec6:f583/64 scope link 2024-09-13T16:02:28.038 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:02:28.038 INFO:teuthology.orchestra.run.smithi070.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T16:02:28.039 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 96:61:28:cd:31:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T16:02:28.039 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::9461:28ff:fecd:31ba/64 scope link 2024-09-13T16:02:28.039 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:02:28.039 INFO:teuthology.orchestra.run.smithi070.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T16:02:28.039 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 52:75:e4:2c:cd:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T16:02:28.039 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::5075:e4ff:fe2c:cd62/64 scope link 2024-09-13T16:02:28.039 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:02:28.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:28.039 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T16:02:28.131 INFO:teuthology.orchestra.run.smithi070.stdout:1 2024-09-13T16:02:28.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:28.134 DEBUG:teuthology.orchestra.run.smithi070:> route 2024-09-13T16:02:28.170 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2024-09-13T16:02:28.170 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T16:02:28.171 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T16:02:28.171 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T16:02:28.171 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T16:02:28.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:28.171 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2024-09-13T16:02:28.172 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-13T16:02:28.172 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T16:02:28.172 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T16:02:28.172 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T16:02:28.172 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-13T16:02:28.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:28.317 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-13T16:02:28.351 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T16:02:28.351 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T16:02:28.352 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T16:02:28.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:28.353 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.0 up 2024-09-13T16:02:28.449 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T16:02:28.450 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T16:02:28.485 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T16:02:28.485 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T16:02:28.485 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T16:02:28.559 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T16:02:28.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:28.560 DEBUG:teuthology.orchestra.run.smithi070:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T16:02:28.688 INFO:teuthology.orchestra.run.smithi070.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T16:02:28.688 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T16:02:28.688 INFO:teuthology.orchestra.run.smithi070.stdout:invalid new device string format 2024-09-13T16:02:28.704 INFO:teuthology.orchestra.run.smithi070.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T16:02:28.704 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T16:02:28.704 INFO:teuthology.orchestra.run.smithi070.stdout:invalid new device string format 2024-09-13T16:02:28.704 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: resolved to: "172.21.15.70:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-13T16:02:28.704 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T16:02:28.726 INFO:teuthology.orchestra.run.smithi070.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T16:02:28.726 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T16:02:28.726 INFO:teuthology.orchestra.run.smithi070.stdout:invalid new device string format 2024-09-13T16:02:28.726 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: resolved to: "172.21.15.70:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-13T16:02:28.726 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T16:02:28.726 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: resolved to: "172.21.15.70:6789,172.21.15.107:6789,172.21.15.107:6790" 2024-09-13T16:02:28.726 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.70:6789,172.21.15.107:6789,172.21.15.107:6790:/ 2024-09-13T16:02:28.726 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f906ab4b-6171-41ec-a825-cd0f700d3930" will pass to kernel 2024-09-13T16:02:28.727 INFO:teuthology.orchestra.run.smithi070.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T16:02:28.727 INFO:teuthology.orchestra.run.smithi070.stdout: You just mounted a file system that supports labels which does not 2024-09-13T16:02:28.727 INFO:teuthology.orchestra.run.smithi070.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T16:02:28.728 INFO:teuthology.orchestra.run.smithi070.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T16:02:28.728 INFO:teuthology.orchestra.run.smithi070.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T16:02:28.730 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T16:02:28.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:28.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T16:02:28.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:28.787 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:02:28.829 INFO:teuthology.orchestra.run.smithi070.stdout:client5334 2024-09-13T16:02:28.830 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:02:28.830 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:02:28.906 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T16:02:28.906 DEBUG:teuthology.orchestra.run.smithi070:> import os 2024-09-13T16:02:28.906 DEBUG:teuthology.orchestra.run.smithi070:> os.mkdir("/home/ubuntu/cephtest/mnt.0/testdir") 2024-09-13T16:02:28.906 DEBUG:teuthology.orchestra.run.smithi070:> fd = os.open("/home/ubuntu/cephtest/mnt.0/testdir", os.O_RDONLY) 2024-09-13T16:02:28.906 DEBUG:teuthology.orchestra.run.smithi070:> os.fchmod(fd, 0o777) 2024-09-13T16:02:28.906 DEBUG:teuthology.orchestra.run.smithi070:> os.fsync(fd) 2024-09-13T16:02:28.906 DEBUG:teuthology.orchestra.run.smithi070:> ' 2024-09-13T16:02:29.232 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:02:29.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.424+0000 7f2b9f200640 1 Processor -- start 2024-09-13T16:02:29.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.425+0000 7f2b9f200640 1 -- start start 2024-09-13T16:02:29.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.426+0000 7f2b9f200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2ba0159480 0x7f2ba00ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:29.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.426+0000 7f2b9f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba006f4b0 0x7f2ba0070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:29.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.426+0000 7f2b9f200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba00717c0 con 0x7f2ba0071390 2024-09-13T16:02:29.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.426+0000 7f2b9f200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba00cd850 con 0x7f2ba0159480 2024-09-13T16:02:29.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.426+0000 7f2b9f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00cd570 con 0x7f2ba006f4b0 2024-09-13T16:02:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.426+0000 7f2b9de00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2ba0159480 0x7f2ba00ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.426+0000 7f2b95400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba006f4b0 0x7f2ba0070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.426+0000 7f2b9e800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f2ba0071390 0x7f2ba015ce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:42136/0 (socket says 172.21.15.70:42136) 2024-09-13T16:02:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.426+0000 7f2b9e800640 1 -- 172.21.15.70:0/4213614411 learned_addr learned my addr 172.21.15.70:0/4213614411 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.427+0000 7f2b9de00640 1 -- 172.21.15.70:0/4213614411 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba006f4b0 msgr2=0x7f2ba0070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.427+0000 7f2b9de00640 1 --2- 172.21.15.70:0/4213614411 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba006f4b0 0x7f2ba0070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.427+0000 7f2b9de00640 1 -- 172.21.15.70:0/4213614411 >> v1:172.21.15.107:6789/0 conn(0x7f2ba0071390 legacy=0x7f2ba015ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.427+0000 7f2b9de00640 1 -- 172.21.15.70:0/4213614411 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba00b1740 con 0x7f2ba0159480 2024-09-13T16:02:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.428+0000 7f2b9de00640 1 --2- 172.21.15.70:0/4213614411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba0159480 0x7f2ba00ccf90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2b900097a0 tx=0x7f2b9002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22a17abf247ddf08 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.428+0000 7f2b9d400640 1 -- 172.21.15.70:0/4213614411 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9002ae50 con 0x7f2ba0159480 2024-09-13T16:02:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.428+0000 7f2b9d400640 1 -- 172.21.15.70:0/4213614411 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b90032440 con 0x7f2ba0159480 2024-09-13T16:02:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.428+0000 7f2b9d400640 1 -- 172.21.15.70:0/4213614411 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b900327d0 con 0x7f2ba0159480 2024-09-13T16:02:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.429+0000 7f2b9f200640 1 -- 172.21.15.70:0/4213614411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba0159480 msgr2=0x7f2ba00ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.429+0000 7f2b9f200640 1 --2- 172.21.15.70:0/4213614411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba0159480 0x7f2ba00ccf90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2b900097a0 tx=0x7f2b9002a100 comp rx=0 tx=0).stop 2024-09-13T16:02:29.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.429+0000 7f2b9f200640 1 -- 172.21.15.70:0/4213614411 shutdown_connections 2024-09-13T16:02:29.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.429+0000 7f2b9f200640 1 --2- 172.21.15.70:0/4213614411 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba006f4b0 0x7f2ba0070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:29.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.429+0000 7f2b9f200640 1 --2- 172.21.15.70:0/4213614411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba0159480 0x7f2ba00ccf90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:29.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.429+0000 7f2b9f200640 1 -- 172.21.15.70:0/4213614411 >> 172.21.15.70:0/4213614411 conn(0x7f2ba00ae310 msgr2=0x7f2ba00ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:29.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.429+0000 7f2b9f200640 1 -- 172.21.15.70:0/4213614411 shutdown_connections 2024-09-13T16:02:29.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.429+0000 7f2b9f200640 1 -- 172.21.15.70:0/4213614411 wait complete. 2024-09-13T16:02:29.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.431+0000 7f2b9f200640 1 Processor -- start 2024-09-13T16:02:29.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.431+0000 7f2b9f200640 1 -- start start 2024-09-13T16:02:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.432+0000 7f2b9f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba006f4b0 0x7f2ba0148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.432+0000 7f2b9f200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ba0071390 0x7f2ba0156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.432+0000 7f2b9f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba0159480 0x7f2ba01f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.432+0000 7f2b9f200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0157990 con 0x7f2ba0071390 2024-09-13T16:02:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.432+0000 7f2b9f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba01573d0 con 0x7f2ba0159480 2024-09-13T16:02:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.432+0000 7f2b9f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba01576b0 con 0x7f2ba006f4b0 2024-09-13T16:02:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.432+0000 7f2b95400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ba0071390 0x7f2ba0156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.432+0000 7f2b95400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ba0071390 0x7f2ba0156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37196/0 (socket says 172.21.15.70:37196) 2024-09-13T16:02:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.432+0000 7f2b95400640 1 -- 172.21.15.70:0/3354425922 learned_addr learned my addr 172.21.15.70:0/3354425922 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:29.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.432+0000 7f2b9e800640 1 --2- 172.21.15.70:0/3354425922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba0159480 0x7f2ba01f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:29.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.432+0000 7f2b9de00640 1 --2- 172.21.15.70:0/3354425922 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba006f4b0 0x7f2ba0148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:29.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.432+0000 7f2b95400640 1 -- 172.21.15.70:0/3354425922 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba006f4b0 msgr2=0x7f2ba0148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:29.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.432+0000 7f2b95400640 1 --2- 172.21.15.70:0/3354425922 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba006f4b0 0x7f2ba0148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:29.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.432+0000 7f2b95400640 1 -- 172.21.15.70:0/3354425922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba0159480 msgr2=0x7f2ba01f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:29.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.432+0000 7f2b95400640 1 --2- 172.21.15.70:0/3354425922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba0159480 0x7f2ba01f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:29.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.432+0000 7f2b95400640 1 -- 172.21.15.70:0/3354425922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b90009400 con 0x7f2ba0071390 2024-09-13T16:02:29.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.433+0000 7f2b95400640 1 --2- 172.21.15.70:0/3354425922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ba0071390 0x7f2ba0156b80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800e9b0 tx=0x7f2b8800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:29.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.433+0000 7f2b96a00640 1 -- 172.21.15.70:0/3354425922 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88009670 con 0x7f2ba0071390 2024-09-13T16:02:29.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.433+0000 7f2b96a00640 1 -- 172.21.15.70:0/3354425922 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8800c9a0 con 0x7f2ba0071390 2024-09-13T16:02:29.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.433+0000 7f2b96a00640 1 -- 172.21.15.70:0/3354425922 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8800cd50 con 0x7f2ba0071390 2024-09-13T16:02:29.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.433+0000 7f2b9f200640 1 -- 172.21.15.70:0/3354425922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba01f57b0 con 0x7f2ba0071390 2024-09-13T16:02:29.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.433+0000 7f2b9f200640 1 -- 172.21.15.70:0/3354425922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba01570c0 con 0x7f2ba0071390 2024-09-13T16:02:29.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.434+0000 7f2b9f200640 1 -- 172.21.15.70:0/3354425922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba0067360 con 0x7f2ba0071390 2024-09-13T16:02:29.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.435+0000 7f2b96a00640 1 -- 172.21.15.70:0/3354425922 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2b88013470 con 0x7f2ba0071390 2024-09-13T16:02:29.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.436+0000 7f2b96a00640 1 --2- 172.21.15.70:0/3354425922 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2b7c06ac00 0x7f2b7c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:29.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.436+0000 7f2b96a00640 1 -- 172.21.15.70:0/3354425922 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b88089550 con 0x7f2ba0071390 2024-09-13T16:02:29.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.437+0000 7f2b9de00640 1 --2- 172.21.15.70:0/3354425922 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2b7c06ac00 0x7f2b7c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:29.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.437+0000 7f2b9de00640 1 --2- 172.21.15.70:0/3354425922 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2b7c06ac00 0x7f2b7c06d0c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2b90034000 tx=0x7f2b9002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:29.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.441+0000 7f2b96a00640 1 -- 172.21.15.70:0/3354425922 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2b880547d0 con 0x7f2ba0071390 2024-09-13T16:02:29.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.646+0000 7f2b9f200640 1 -- 172.21.15.70:0/3354425922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ba0070e50 con 0x7f2ba0071390 2024-09-13T16:02:29.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.647+0000 7f2b96a00640 1 -- 172.21.15.70:0/3354425922 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f2b88057df0 con 0x7f2ba0071390 2024-09-13T16:02:29.648 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:29.648 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/1247927631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1247927631},{"type":"v1","addr":"172.21.15.70:6836","nonce":1247927631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/1077617661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1077617661},{"type":"v1","addr":"172.21.15.107:6834","nonce":1077617661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2709979655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2709979655},{"type":"v1","addr":"172.21.15.107:6835","nonce":2709979655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:02:16.987283+0000","modified":"2024-09-13T16:02:20.008275+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6837/3554365995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":3554365995},{"type":"v1","addr":"172.21.15.70:6837","nonce":3554365995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T16:02:29.649 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 16 2024-09-13T16:02:29.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.649+0000 7f2b9f200640 1 -- 172.21.15.70:0/3354425922 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2b7c06ac00 msgr2=0x7f2b7c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:29.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.649+0000 7f2b9f200640 1 --2- 172.21.15.70:0/3354425922 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2b7c06ac00 0x7f2b7c06d0c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2b90034000 tx=0x7f2b9002e000 comp rx=0 tx=0).stop 2024-09-13T16:02:29.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.649+0000 7f2b9f200640 1 -- 172.21.15.70:0/3354425922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ba0071390 msgr2=0x7f2ba0156b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:29.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.649+0000 7f2b9f200640 1 --2- 172.21.15.70:0/3354425922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ba0071390 0x7f2ba0156b80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800e9b0 tx=0x7f2b8800ee70 comp rx=0 tx=0).stop 2024-09-13T16:02:29.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.649+0000 7f2b9f200640 1 -- 172.21.15.70:0/3354425922 shutdown_connections 2024-09-13T16:02:29.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.649+0000 7f2b9f200640 1 --2- 172.21.15.70:0/3354425922 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2b7c06ac00 0x7f2b7c06d0c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:29.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.649+0000 7f2b9f200640 1 --2- 172.21.15.70:0/3354425922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba0159480 0x7f2ba01f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:29.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.649+0000 7f2b9f200640 1 --2- 172.21.15.70:0/3354425922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ba0071390 0x7f2ba0156b80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:29.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.649+0000 7f2b9f200640 1 --2- 172.21.15.70:0/3354425922 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba006f4b0 0x7f2ba0148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:29.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.649+0000 7f2b9f200640 1 -- 172.21.15.70:0/3354425922 >> 172.21.15.70:0/3354425922 conn(0x7f2ba00ae310 msgr2=0x7f2ba00ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:29.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.649+0000 7f2b9f200640 1 -- 172.21.15.70:0/3354425922 shutdown_connections 2024-09-13T16:02:29.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.649+0000 7f2b9f200640 1 -- 172.21.15.70:0/3354425922 wait complete. 2024-09-13T16:02:29.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-13T16:02:29.842 INFO:teuthology.orchestra.run.smithi070.stdout:{"message":"","return_code":0} 2024-09-13T16:02:29.842 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-13T16:02:29.843 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:02:29.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.993+0000 7f14bcc00640 1 Processor -- start 2024-09-13T16:02:29.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.993+0000 7f14bcc00640 1 -- start start 2024-09-13T16:02:29.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.994+0000 7f14bcc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f14b8159210 0x7f14b80b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:29.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.994+0000 7f14bcc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14b80b3100 0x7f14b8070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:29.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.994+0000 7f14bcc00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b8159680 con 0x7f14b80b1e40 2024-09-13T16:02:29.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.994+0000 7f14bcc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b815a430 con 0x7f14b8159210 2024-09-13T16:02:29.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.994+0000 7f14bcc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b80b2930 con 0x7f14b80b3100 2024-09-13T16:02:29.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.994+0000 7f14b5e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f14b80b1e40 0x7f14b80b2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:55774/0 (socket says 172.21.15.70:55774) 2024-09-13T16:02:29.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.995+0000 7f14b5e00640 1 -- 172.21.15.70:0/1901393612 learned_addr learned my addr 172.21.15.70:0/1901393612 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:29.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.995+0000 7f14b6800640 1 --2- 172.21.15.70:0/1901393612 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14b80b3100 0x7f14b8070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:29.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.995+0000 7f14b5400640 1 --2- 172.21.15.70:0/1901393612 >> v2:172.21.15.107:3300/0 conn(0x7f14b8159210 0x7f14b80b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:29.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.995+0000 7f14b4a00640 1 -- 172.21.15.70:0/1901393612 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671831370 0 0) 0x7f14b8159680 con 0x7f14b80b1e40 2024-09-13T16:02:29.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.995+0000 7f14b4a00640 1 -- 172.21.15.70:0/1901393612 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f149c005730 con 0x7f14b80b1e40 2024-09-13T16:02:29.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.995+0000 7f14b4a00640 1 -- 172.21.15.70:0/1901393612 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1455790097 0 0) 0x7f149c005730 con 0x7f14b80b1e40 2024-09-13T16:02:29.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.995+0000 7f14b6800640 1 -- 172.21.15.70:0/1901393612 >> v2:172.21.15.107:3300/0 conn(0x7f14b8159210 msgr2=0x7f14b80b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:29.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.995+0000 7f14b6800640 1 --2- 172.21.15.70:0/1901393612 >> v2:172.21.15.107:3300/0 conn(0x7f14b8159210 0x7f14b80b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:29.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.995+0000 7f14b6800640 1 -- 172.21.15.70:0/1901393612 >> v1:172.21.15.70:6789/0 conn(0x7f14b80b1e40 legacy=0x7f14b80b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:29.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.995+0000 7f14b6800640 1 -- 172.21.15.70:0/1901393612 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b80b3520 con 0x7f14b80b3100 2024-09-13T16:02:29.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.995+0000 7f14b5400640 1 --2- 172.21.15.70:0/1901393612 >> v2:172.21.15.107:3300/0 conn(0x7f14b8159210 0x7f14b80b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:29.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.996+0000 7f14b6800640 1 --2- 172.21.15.70:0/1901393612 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14b80b3100 0x7f14b8070720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f14b0008330 tx=0x7f14b000a7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2074b34119b1304 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:29.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.997+0000 7f14b4a00640 1 -- 172.21.15.70:0/1901393612 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a8001670 con 0x7f14b80b3100 2024-09-13T16:02:29.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.997+0000 7f14b4a00640 1 -- 172.21.15.70:0/1901393612 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b002d050 con 0x7f14b80b3100 2024-09-13T16:02:29.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.997+0000 7f14b4a00640 1 -- 172.21.15.70:0/1901393612 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b0008640 con 0x7f14b80b3100 2024-09-13T16:02:29.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.997+0000 7f14bcc00640 1 -- 172.21.15.70:0/1901393612 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14b80b3100 msgr2=0x7f14b8070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:29.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.997+0000 7f14bcc00640 1 --2- 172.21.15.70:0/1901393612 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14b80b3100 0x7f14b8070720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f14b0008330 tx=0x7f14b000a7b0 comp rx=0 tx=0).stop 2024-09-13T16:02:30.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.997+0000 7f14bcc00640 1 -- 172.21.15.70:0/1901393612 shutdown_connections 2024-09-13T16:02:30.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.997+0000 7f14bcc00640 1 --2- 172.21.15.70:0/1901393612 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14b80b3100 0x7f14b8070720 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:30.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.997+0000 7f14bcc00640 1 --2- 172.21.15.70:0/1901393612 >> v2:172.21.15.107:3300/0 conn(0x7f14b8159210 0x7f14b80b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:30.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.997+0000 7f14bcc00640 1 -- 172.21.15.70:0/1901393612 >> 172.21.15.70:0/1901393612 conn(0x7f14b80b0510 msgr2=0x7f14b80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:30.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.997+0000 7f14bcc00640 1 -- 172.21.15.70:0/1901393612 shutdown_connections 2024-09-13T16:02:30.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.997+0000 7f14bcc00640 1 -- 172.21.15.70:0/1901393612 wait complete. 2024-09-13T16:02:30.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.999+0000 7f14bcc00640 1 Processor -- start 2024-09-13T16:02:30.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:29.999+0000 7f14bcc00640 1 -- start start 2024-09-13T16:02:30.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.000+0000 7f14bcc00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14b80b1e40 0x7f14b815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:30.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.000+0000 7f14bcc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14b80b3100 0x7f14b81587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:30.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.000+0000 7f14bcc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14b8159210 0x7f14b815b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:30.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.000+0000 7f14bcc00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b815cf10 con 0x7f14b80b1e40 2024-09-13T16:02:30.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.000+0000 7f14bcc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b815c300 con 0x7f14b8159210 2024-09-13T16:02:30.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.000+0000 7f14bcc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b815c5e0 con 0x7f14b80b3100 2024-09-13T16:02:30.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.000+0000 7f14b5e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14b80b1e40 0x7f14b815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:30.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.000+0000 7f14b5e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14b80b1e40 0x7f14b815d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49988/0 (socket says 172.21.15.70:49988) 2024-09-13T16:02:30.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.000+0000 7f14b5e00640 1 -- 172.21.15.70:0/3654550192 learned_addr learned my addr 172.21.15.70:0/3654550192 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:30.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.000+0000 7f14b5e00640 1 -- 172.21.15.70:0/3654550192 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14b80b3100 msgr2=0x7f14b81587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:30.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.000+0000 7f14b5e00640 1 --2- 172.21.15.70:0/3654550192 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14b80b3100 0x7f14b81587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:30.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.000+0000 7f14b5e00640 1 -- 172.21.15.70:0/3654550192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14b8159210 msgr2=0x7f14b815b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:30.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.000+0000 7f14b5e00640 1 --2- 172.21.15.70:0/3654550192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14b8159210 0x7f14b815b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:30.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.000+0000 7f14b5e00640 1 -- 172.21.15.70:0/3654550192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a4009400 con 0x7f14b80b1e40 2024-09-13T16:02:30.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.001+0000 7f14b5e00640 1 --2- 172.21.15.70:0/3654550192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14b80b1e40 0x7f14b815d3a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f14a800c580 tx=0x7f14a800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:30.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.001+0000 7f14ae000640 1 -- 172.21.15.70:0/3654550192 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a8005ce0 con 0x7f14b80b1e40 2024-09-13T16:02:30.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.001+0000 7f14ae000640 1 -- 172.21.15.70:0/3654550192 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a8005e40 con 0x7f14b80b1e40 2024-09-13T16:02:30.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.001+0000 7f14bcc00640 1 -- 172.21.15.70:0/3654550192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b000aa90 con 0x7f14b80b1e40 2024-09-13T16:02:30.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.001+0000 7f14ae000640 1 -- 172.21.15.70:0/3654550192 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a8007330 con 0x7f14b80b1e40 2024-09-13T16:02:30.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.001+0000 7f14bcc00640 1 -- 172.21.15.70:0/3654550192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b815cba0 con 0x7f14b80b1e40 2024-09-13T16:02:30.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.002+0000 7f14bcc00640 1 -- 172.21.15.70:0/3654550192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b80b2470 con 0x7f14b80b1e40 2024-09-13T16:02:30.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.003+0000 7f14ae000640 1 -- 172.21.15.70:0/3654550192 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f14a8007550 con 0x7f14b80b1e40 2024-09-13T16:02:30.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.004+0000 7f14ae000640 1 --2- 172.21.15.70:0/3654550192 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f149806ac00 0x7f149806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:30.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.004+0000 7f14ae000640 1 -- 172.21.15.70:0/3654550192 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14a8088ad0 con 0x7f14b80b1e40 2024-09-13T16:02:30.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.004+0000 7f14b5400640 1 --2- 172.21.15.70:0/3654550192 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f149806ac00 0x7f149806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:30.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.005+0000 7f14b5400640 1 --2- 172.21.15.70:0/3654550192 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f149806ac00 0x7f149806d0c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f14a4006e80 tx=0x7f14a4006dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:30.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.008+0000 7f14ae000640 1 -- 172.21.15.70:0/3654550192 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f14a8053ca0 con 0x7f14b80b1e40 2024-09-13T16:02:30.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.211+0000 7f14bcc00640 1 -- 172.21.15.70:0/3654550192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14b80ad900 con 0x7f14b80b1e40 2024-09-13T16:02:30.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.211+0000 7f14ae000640 1 -- 172.21.15.70:0/3654550192 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f14a8017020 con 0x7f14b80b1e40 2024-09-13T16:02:30.213 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:30.213 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/1247927631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1247927631},{"type":"v1","addr":"172.21.15.70:6836","nonce":1247927631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/1077617661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1077617661},{"type":"v1","addr":"172.21.15.107:6834","nonce":1077617661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2709979655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2709979655},{"type":"v1","addr":"172.21.15.107:6835","nonce":2709979655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:02:16.987283+0000","modified":"2024-09-13T16:02:20.008275+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6837/3554365995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":3554365995},{"type":"v1","addr":"172.21.15.70:6837","nonce":3554365995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T16:02:30.213 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 16 2024-09-13T16:02:30.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.213+0000 7f14bcc00640 1 -- 172.21.15.70:0/3654550192 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f149806ac00 msgr2=0x7f149806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:30.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.213+0000 7f14bcc00640 1 --2- 172.21.15.70:0/3654550192 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f149806ac00 0x7f149806d0c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f14a4006e80 tx=0x7f14a4006dd0 comp rx=0 tx=0).stop 2024-09-13T16:02:30.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.213+0000 7f14bcc00640 1 -- 172.21.15.70:0/3654550192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14b80b1e40 msgr2=0x7f14b815d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:30.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.213+0000 7f14bcc00640 1 --2- 172.21.15.70:0/3654550192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14b80b1e40 0x7f14b815d3a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f14a800c580 tx=0x7f14a800ca40 comp rx=0 tx=0).stop 2024-09-13T16:02:30.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.213+0000 7f14bcc00640 1 -- 172.21.15.70:0/3654550192 shutdown_connections 2024-09-13T16:02:30.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.213+0000 7f14bcc00640 1 --2- 172.21.15.70:0/3654550192 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f149806ac00 0x7f149806d0c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:30.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.213+0000 7f14bcc00640 1 --2- 172.21.15.70:0/3654550192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14b8159210 0x7f14b815b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:30.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.213+0000 7f14bcc00640 1 --2- 172.21.15.70:0/3654550192 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14b80b3100 0x7f14b81587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:30.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.213+0000 7f14bcc00640 1 --2- 172.21.15.70:0/3654550192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14b80b1e40 0x7f14b815d3a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:30.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.214+0000 7f14bcc00640 1 -- 172.21.15.70:0/3654550192 >> 172.21.15.70:0/3654550192 conn(0x7f14b80b0510 msgr2=0x7f14b806c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:30.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.214+0000 7f14bcc00640 1 -- 172.21.15.70:0/3654550192 shutdown_connections 2024-09-13T16:02:30.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:30.214+0000 7f14bcc00640 1 -- 172.21.15.70:0/3654550192 wait complete. 2024-09-13T16:02:30.231 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_log_pause 1 2024-09-13T16:02:30.398 INFO:teuthology.orchestra.run.smithi070.stdout:{"success":"mds_log_pause = '' "} 2024-09-13T16:02:30.398 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_log_pause = '' " } 2024-09-13T16:02:30.399 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T16:02:30.399 DEBUG:teuthology.orchestra.run.smithi070:> import os 2024-09-13T16:02:30.399 DEBUG:teuthology.orchestra.run.smithi070:> os.chdir("/home/ubuntu/cephtest/mnt.0/testdir") 2024-09-13T16:02:30.399 DEBUG:teuthology.orchestra.run.smithi070:> os.setgid(65534) 2024-09-13T16:02:30.399 DEBUG:teuthology.orchestra.run.smithi070:> os.setuid(65534) 2024-09-13T16:02:30.399 DEBUG:teuthology.orchestra.run.smithi070:> fd = os.open("testfile", os.O_CREAT | os.O_RDWR, 0o644) 2024-09-13T16:02:30.399 DEBUG:teuthology.orchestra.run.smithi070:> os.fchmod(fd, 0o640) 2024-09-13T16:02:30.399 DEBUG:teuthology.orchestra.run.smithi070:> ' 2024-09-13T16:02:30.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:30.703 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod 600 /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2024-09-13T16:02:40.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 2:0 2024-09-13T16:02:40.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.911+0000 7feb6b000640 1 Processor -- start 2024-09-13T16:02:40.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.911+0000 7feb6b000640 1 -- start start 2024-09-13T16:02:40.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.912+0000 7feb6b000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7feb640ad360 0x7feb6406cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:40.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.912+0000 7feb6b000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7feb640711e0 0x7feb640b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:40.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.912+0000 7feb6b000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6406d400 con 0x7feb640ac870 2024-09-13T16:02:40.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.912+0000 7feb6b000640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb640add40 con 0x7feb640711e0 2024-09-13T16:02:40.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.912+0000 7feb6b000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb6406d630 con 0x7feb640ad360 2024-09-13T16:02:40.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.913+0000 7feb6a600640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7feb640711e0 0x7feb640b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:40.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.913+0000 7feb6a600640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7feb640711e0 0x7feb640b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36796/0 (socket says 172.21.15.70:36796) 2024-09-13T16:02:40.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.913+0000 7feb6a600640 1 -- 172.21.15.70:0/4557975 learned_addr learned my addr 172.21.15.70:0/4557975 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:40.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.913+0000 7feb69200640 1 --2- 172.21.15.70:0/4557975 >> v2:172.21.15.107:3300/0 conn(0x7feb640ad360 0x7feb6406cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:40.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.913+0000 7feb6a600640 1 -- 172.21.15.70:0/4557975 >> v2:172.21.15.107:3300/0 conn(0x7feb640ad360 msgr2=0x7feb6406cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:40.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.913+0000 7feb6a600640 1 --2- 172.21.15.70:0/4557975 >> v2:172.21.15.107:3300/0 conn(0x7feb640ad360 0x7feb6406cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:40.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.913+0000 7feb6a600640 1 -- 172.21.15.70:0/4557975 >> v1:172.21.15.107:6789/0 conn(0x7feb640ac870 legacy=0x7feb640acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:40.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.913+0000 7feb6a600640 1 -- 172.21.15.70:0/4557975 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb64070420 con 0x7feb640711e0 2024-09-13T16:02:40.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.914+0000 7feb6a600640 1 --2- 172.21.15.70:0/4557975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb640711e0 0x7feb640b1630 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7feb6415dfa0 tx=0x7feb5c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d05f08a0dced75f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:40.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.914+0000 7feb63e00640 1 -- 172.21.15.70:0/4557975 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c031600 con 0x7feb640711e0 2024-09-13T16:02:40.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.914+0000 7feb63e00640 1 -- 172.21.15.70:0/4557975 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5c02d050 con 0x7feb640711e0 2024-09-13T16:02:40.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.914+0000 7feb63e00640 1 -- 172.21.15.70:0/4557975 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c031980 con 0x7feb640711e0 2024-09-13T16:02:40.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.915+0000 7feb6b000640 1 -- 172.21.15.70:0/4557975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb640711e0 msgr2=0x7feb640b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:40.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.915+0000 7feb6b000640 1 --2- 172.21.15.70:0/4557975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb640711e0 0x7feb640b1630 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7feb6415dfa0 tx=0x7feb5c02a6f0 comp rx=0 tx=0).stop 2024-09-13T16:02:40.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.915+0000 7feb6b000640 1 -- 172.21.15.70:0/4557975 shutdown_connections 2024-09-13T16:02:40.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.915+0000 7feb6b000640 1 --2- 172.21.15.70:0/4557975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb640711e0 0x7feb640b1630 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:40.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.915+0000 7feb6b000640 1 --2- 172.21.15.70:0/4557975 >> v2:172.21.15.107:3300/0 conn(0x7feb640ad360 0x7feb6406cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:40.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.915+0000 7feb6b000640 1 -- 172.21.15.70:0/4557975 >> 172.21.15.70:0/4557975 conn(0x7feb640b0330 msgr2=0x7feb640b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:40.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.915+0000 7feb6b000640 1 -- 172.21.15.70:0/4557975 shutdown_connections 2024-09-13T16:02:40.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.915+0000 7feb6b000640 1 -- 172.21.15.70:0/4557975 wait complete. 2024-09-13T16:02:40.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.917+0000 7feb6b000640 1 Processor -- start 2024-09-13T16:02:40.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.917+0000 7feb6b000640 1 -- start start 2024-09-13T16:02:40.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.918+0000 7feb6b000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb640711e0 0x7feb6413dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:40.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.918+0000 7feb6b000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb640ac870 0x7feb641508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:40.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.918+0000 7feb6b000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb640ad360 0x7feb64139e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:40.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.918+0000 7feb6b000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6413efd0 con 0x7feb640711e0 2024-09-13T16:02:40.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.918+0000 7feb6b000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb64150e00 con 0x7feb640ad360 2024-09-13T16:02:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.918+0000 7feb6b000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6413e3c0 con 0x7feb640ac870 2024-09-13T16:02:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.918+0000 7feb69c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb640711e0 0x7feb6413dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.918+0000 7feb69c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb640711e0 0x7feb6413dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36806/0 (socket says 172.21.15.70:36806) 2024-09-13T16:02:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.918+0000 7feb69c00640 1 -- 172.21.15.70:0/3558855574 learned_addr learned my addr 172.21.15.70:0/3558855574 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.918+0000 7feb6a600640 1 --2- 172.21.15.70:0/3558855574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb640ad360 0x7feb64139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.918+0000 7feb69200640 1 --2- 172.21.15.70:0/3558855574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb640ac870 0x7feb641508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.918+0000 7feb69c00640 1 -- 172.21.15.70:0/3558855574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb640ac870 msgr2=0x7feb641508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.918+0000 7feb69c00640 1 --2- 172.21.15.70:0/3558855574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb640ac870 0x7feb641508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.918+0000 7feb69c00640 1 -- 172.21.15.70:0/3558855574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb640ad360 msgr2=0x7feb64139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.918+0000 7feb69c00640 1 --2- 172.21.15.70:0/3558855574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb640ad360 0x7feb64139e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.918+0000 7feb69c00640 1 -- 172.21.15.70:0/3558855574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5c009b30 con 0x7feb640711e0 2024-09-13T16:02:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.918+0000 7feb69200640 1 --2- 172.21.15.70:0/3558855574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb640ac870 0x7feb641508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.919+0000 7feb69c00640 1 --2- 172.21.15.70:0/3558855574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb640711e0 0x7feb6413dde0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7feb5800c430 tx=0x7feb5800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:40.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.919+0000 7feb61600640 1 -- 172.21.15.70:0/3558855574 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58011790 con 0x7feb640711e0 2024-09-13T16:02:40.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.919+0000 7feb61600640 1 -- 172.21.15.70:0/3558855574 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb580118f0 con 0x7feb640711e0 2024-09-13T16:02:40.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.919+0000 7feb6b000640 1 -- 172.21.15.70:0/3558855574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb6413e6a0 con 0x7feb640711e0 2024-09-13T16:02:40.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.919+0000 7feb61600640 1 -- 172.21.15.70:0/3558855574 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58011ce0 con 0x7feb640711e0 2024-09-13T16:02:40.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.919+0000 7feb6b000640 1 -- 172.21.15.70:0/3558855574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb6413ec60 con 0x7feb640711e0 2024-09-13T16:02:40.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.920+0000 7feb6b000640 1 -- 172.21.15.70:0/3558855574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb640b1fd0 con 0x7feb640711e0 2024-09-13T16:02:40.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.921+0000 7feb61600640 1 -- 172.21.15.70:0/3558855574 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feb5801c460 con 0x7feb640711e0 2024-09-13T16:02:40.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.922+0000 7feb61600640 1 --2- 172.21.15.70:0/3558855574 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7feb4406ac30 0x7feb4406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:40.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.922+0000 7feb61600640 1 -- 172.21.15.70:0/3558855574 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb58089160 con 0x7feb640711e0 2024-09-13T16:02:40.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.922+0000 7feb69200640 1 --2- 172.21.15.70:0/3558855574 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7feb4406ac30 0x7feb4406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:40.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.923+0000 7feb69200640 1 --2- 172.21.15.70:0/3558855574 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7feb4406ac30 0x7feb4406d0f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feb50006fd0 tx=0x7feb50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:40.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:40.927+0000 7feb61600640 1 -- 172.21.15.70:0/3558855574 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feb580543d0 con 0x7feb640711e0 2024-09-13T16:02:41.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.166+0000 7feb6b000640 1 -- 172.21.15.70:0/3558855574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "2:0"} v 0) v1 -- 0x7feb641462e0 con 0x7feb640711e0 2024-09-13T16:02:41.168 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-13T16:02:41.168+0000 7fe88e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T16:02:41.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.175+0000 7feb61600640 1 -- 172.21.15.70:0/3558855574 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "2:0"}]=0 failed mds gid 5127 v17) v1 ==== 97+0+0 (secure 0 0 0) 0x7feb580579f0 con 0x7feb640711e0 2024-09-13T16:02:41.177 INFO:teuthology.orchestra.run.smithi070.stderr:failed mds gid 5127 2024-09-13T16:02:41.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.178+0000 7feb6b000640 1 -- 172.21.15.70:0/3558855574 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7feb4406ac30 msgr2=0x7feb4406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:41.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.178+0000 7feb6b000640 1 --2- 172.21.15.70:0/3558855574 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7feb4406ac30 0x7feb4406d0f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feb50006fd0 tx=0x7feb50008040 comp rx=0 tx=0).stop 2024-09-13T16:02:41.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.179+0000 7feb6b000640 1 -- 172.21.15.70:0/3558855574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb640711e0 msgr2=0x7feb6413dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:41.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.179+0000 7feb6b000640 1 --2- 172.21.15.70:0/3558855574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb640711e0 0x7feb6413dde0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7feb5800c430 tx=0x7feb5800c8f0 comp rx=0 tx=0).stop 2024-09-13T16:02:41.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.179+0000 7feb6b000640 1 -- 172.21.15.70:0/3558855574 shutdown_connections 2024-09-13T16:02:41.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.179+0000 7feb6b000640 1 --2- 172.21.15.70:0/3558855574 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7feb4406ac30 0x7feb4406d0f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:41.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.179+0000 7feb6b000640 1 --2- 172.21.15.70:0/3558855574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb640ad360 0x7feb64139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:41.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.179+0000 7feb6b000640 1 --2- 172.21.15.70:0/3558855574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb640ac870 0x7feb641508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:41.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.179+0000 7feb6b000640 1 --2- 172.21.15.70:0/3558855574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb640711e0 0x7feb6413dde0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:41.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.179+0000 7feb6b000640 1 -- 172.21.15.70:0/3558855574 >> 172.21.15.70:0/3558855574 conn(0x7feb640b0330 msgr2=0x7feb640ae260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:41.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.179+0000 7feb6b000640 1 -- 172.21.15.70:0/3558855574 shutdown_connections 2024-09-13T16:02:41.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.179+0000 7feb6b000640 1 -- 172.21.15.70:0/3558855574 wait complete. 2024-09-13T16:02:41.185 INFO:tasks.ceph.mds.c.smithi070.stderr: -2853> 2024-09-13T16:02:20.349+0000 7f5777600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T16:02:41.203 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:02:41.239 INFO:tasks.ceph.mds.c.smithi070.stdout:starting mds.c at 2024-09-13T16:02:41.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.354+0000 7f35f8200640 1 Processor -- start 2024-09-13T16:02:41.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.355+0000 7f35f8200640 1 -- start start 2024-09-13T16:02:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.356+0000 7f35f8200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f35f015a520 0x7f35f006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.356+0000 7f35f8200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f35f00ce020 0x7f35f015a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.356+0000 7f35f8200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f006bc00 con 0x7f35f00b1b00 2024-09-13T16:02:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.356+0000 7f35f8200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f006bea0 con 0x7f35f00ce020 2024-09-13T16:02:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.356+0000 7f35f8200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f006c180 con 0x7f35f015a520 2024-09-13T16:02:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.356+0000 7f35f6200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f35f00ce020 0x7f35f015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.356+0000 7f35f6200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f35f00ce020 0x7f35f015a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36830/0 (socket says 172.21.15.70:36830) 2024-09-13T16:02:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.356+0000 7f35f6200640 1 -- 172.21.15.70:0/4149988317 learned_addr learned my addr 172.21.15.70:0/4149988317 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.356+0000 7f35f5800640 1 --2- 172.21.15.70:0/4149988317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f35f015a520 0x7f35f006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.357+0000 7f35f6200640 1 -- 172.21.15.70:0/4149988317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f35f015a520 msgr2=0x7f35f006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.357+0000 7f35f6200640 1 --2- 172.21.15.70:0/4149988317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f35f015a520 0x7f35f006b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.357+0000 7f35efe00640 1 -- 172.21.15.70:0/4149988317 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499833771 0 0) 0x7f35f006bc00 con 0x7f35f00b1b00 2024-09-13T16:02:41.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.357+0000 7f35f6200640 1 -- 172.21.15.70:0/4149988317 >> v1:172.21.15.107:6789/0 conn(0x7f35f00b1b00 legacy=0x7f35f00cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:41.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.357+0000 7f35f6200640 1 -- 172.21.15.70:0/4149988317 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f006c460 con 0x7f35f00ce020 2024-09-13T16:02:41.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.357+0000 7f35f5800640 1 --2- 172.21.15.70:0/4149988317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f35f015a520 0x7f35f006b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:41.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.358+0000 7f35f6200640 1 --2- 172.21.15.70:0/4149988317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f00ce020 0x7f35f015a900 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009e50 tx=0x7f35e802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb536503130069e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:41.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.358+0000 7f35efe00640 1 -- 172.21.15.70:0/4149988317 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8031600 con 0x7f35f00ce020 2024-09-13T16:02:41.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.358+0000 7f35efe00640 1 -- 172.21.15.70:0/4149988317 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e802d050 con 0x7f35f00ce020 2024-09-13T16:02:41.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.358+0000 7f35efe00640 1 -- 172.21.15.70:0/4149988317 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8031980 con 0x7f35f00ce020 2024-09-13T16:02:41.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.359+0000 7f35f8200640 1 -- 172.21.15.70:0/4149988317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f00ce020 msgr2=0x7f35f015a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:41.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.359+0000 7f35f8200640 1 --2- 172.21.15.70:0/4149988317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f00ce020 0x7f35f015a900 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009e50 tx=0x7f35e802a730 comp rx=0 tx=0).stop 2024-09-13T16:02:41.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.359+0000 7f35f8200640 1 -- 172.21.15.70:0/4149988317 shutdown_connections 2024-09-13T16:02:41.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.359+0000 7f35f8200640 1 --2- 172.21.15.70:0/4149988317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f00ce020 0x7f35f015a900 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:41.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.359+0000 7f35f8200640 1 --2- 172.21.15.70:0/4149988317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f35f015a520 0x7f35f006b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:41.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.359+0000 7f35f8200640 1 -- 172.21.15.70:0/4149988317 >> 172.21.15.70:0/4149988317 conn(0x7f35f00b0510 msgr2=0x7f35f00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:41.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.359+0000 7f35f8200640 1 -- 172.21.15.70:0/4149988317 shutdown_connections 2024-09-13T16:02:41.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.359+0000 7f35f8200640 1 -- 172.21.15.70:0/4149988317 wait complete. 2024-09-13T16:02:41.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.361+0000 7f35f8200640 1 Processor -- start 2024-09-13T16:02:41.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.361+0000 7f35f8200640 1 -- start start 2024-09-13T16:02:41.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.362+0000 7f35f8200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f35f00b1b00 0x7f35f01e44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:41.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.362+0000 7f35f8200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35f00ce020 0x7f35f0145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:41.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.362+0000 7f35f8200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f015a520 0x7f35f01426f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:41.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.362+0000 7f35f8200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f01e5750 con 0x7f35f015a520 2024-09-13T16:02:41.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.362+0000 7f35f8200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f0145fd0 con 0x7f35f00ce020 2024-09-13T16:02:41.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.362+0000 7f35f8200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f01e4b40 con 0x7f35f00b1b00 2024-09-13T16:02:41.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.362+0000 7f35f6200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f015a520 0x7f35f01426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:41.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.362+0000 7f35f4e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35f00ce020 0x7f35f0145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:41.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.362+0000 7f35f6200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f015a520 0x7f35f01426f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36832/0 (socket says 172.21.15.70:36832) 2024-09-13T16:02:41.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.362+0000 7f35f6200640 1 -- 172.21.15.70:0/178609306 learned_addr learned my addr 172.21.15.70:0/178609306 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:41.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.362+0000 7f35f5800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f35f00b1b00 0x7f35f01e44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:41.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.363+0000 7f35f6200640 1 -- 172.21.15.70:0/178609306 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f35f00b1b00 msgr2=0x7f35f01e44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:41.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.363+0000 7f35f6200640 1 --2- 172.21.15.70:0/178609306 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f35f00b1b00 0x7f35f01e44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:41.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.363+0000 7f35f6200640 1 -- 172.21.15.70:0/178609306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35f00ce020 msgr2=0x7f35f0145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:41.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.363+0000 7f35f6200640 1 --2- 172.21.15.70:0/178609306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35f00ce020 0x7f35f0145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:41.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.363+0000 7f35f6200640 1 -- 172.21.15.70:0/178609306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e4009400 con 0x7f35f015a520 2024-09-13T16:02:41.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.363+0000 7f35f6200640 1 --2- 172.21.15.70:0/178609306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f015a520 0x7f35f01426f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009e50 tx=0x7f35e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:41.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.363+0000 7f35ed600640 1 -- 172.21.15.70:0/178609306 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e803d860 con 0x7f35f015a520 2024-09-13T16:02:41.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.363+0000 7f35ed600640 1 -- 172.21.15.70:0/178609306 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e803d9c0 con 0x7f35f015a520 2024-09-13T16:02:41.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.363+0000 7f35ed600640 1 -- 172.21.15.70:0/178609306 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e803dd70 con 0x7f35f015a520 2024-09-13T16:02:41.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.363+0000 7f35f8200640 1 -- 172.21.15.70:0/178609306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e8009b30 con 0x7f35f015a520 2024-09-13T16:02:41.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.363+0000 7f35f8200640 1 -- 172.21.15.70:0/178609306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f01e5100 con 0x7f35f015a520 2024-09-13T16:02:41.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.365+0000 7f35f8200640 1 -- 172.21.15.70:0/178609306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f0143090 con 0x7f35f015a520 2024-09-13T16:02:41.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.365+0000 7f35ed600640 1 -- 172.21.15.70:0/178609306 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f35e803b400 con 0x7f35f015a520 2024-09-13T16:02:41.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.366+0000 7f35ed600640 1 --2- 172.21.15.70:0/178609306 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f35d006ac00 0x7f35d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:41.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.366+0000 7f35ed600640 1 -- 172.21.15.70:0/178609306 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f35e80a9fb0 con 0x7f35f015a520 2024-09-13T16:02:41.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.366+0000 7f35f5800640 1 --2- 172.21.15.70:0/178609306 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f35d006ac00 0x7f35d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:41.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.367+0000 7f35f5800640 1 --2- 172.21.15.70:0/178609306 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f35d006ac00 0x7f35d006d0c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009c30 tx=0x7f35e4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:41.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.370+0000 7f35ed600640 1 -- 172.21.15.70:0/178609306 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f35e80dd9c0 con 0x7f35f015a520 2024-09-13T16:02:41.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.573+0000 7f35f8200640 1 -- 172.21.15.70:0/178609306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35f015a900 con 0x7f35f015a520 2024-09-13T16:02:41.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.574+0000 7f35ed600640 1 -- 172.21.15.70:0/178609306 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3984 (secure 0 0 0) 0x7f35e8075270 con 0x7f35f015a520 2024-09-13T16:02:41.575 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:41.575 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/1247927631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1247927631},{"type":"v1","addr":"172.21.15.70:6836","nonce":1247927631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/1077617661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1077617661},{"type":"v1","addr":"172.21.15.107:6834","nonce":1077617661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:02:16.987283+0000","modified":"2024-09-13T16:02:41.176196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5124":{"gid":5124,"name":"b","rank":0,"incarnation":18,"state":"up:replay","state_seq":1,"addr":"172.21.15.107:6835/2709979655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2709979655},{"type":"v1","addr":"172.21.15.107:6835","nonce":2709979655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T16:02:41.576 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 18 2024-09-13T16:02:41.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.576+0000 7f35f8200640 1 -- 172.21.15.70:0/178609306 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f35d006ac00 msgr2=0x7f35d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:41.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.576+0000 7f35f8200640 1 --2- 172.21.15.70:0/178609306 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f35d006ac00 0x7f35d006d0c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009c30 tx=0x7f35e4009190 comp rx=0 tx=0).stop 2024-09-13T16:02:41.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.576+0000 7f35f8200640 1 -- 172.21.15.70:0/178609306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f015a520 msgr2=0x7f35f01426f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:41.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.576+0000 7f35f8200640 1 --2- 172.21.15.70:0/178609306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f015a520 0x7f35f01426f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009e50 tx=0x7f35e8004a40 comp rx=0 tx=0).stop 2024-09-13T16:02:41.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.576+0000 7f35f8200640 1 -- 172.21.15.70:0/178609306 shutdown_connections 2024-09-13T16:02:41.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.576+0000 7f35f8200640 1 --2- 172.21.15.70:0/178609306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f015a520 0x7f35f01426f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:41.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.576+0000 7f35f8200640 1 --2- 172.21.15.70:0/178609306 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f35d006ac00 0x7f35d006d0c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:41.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.576+0000 7f35f8200640 1 --2- 172.21.15.70:0/178609306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35f00ce020 0x7f35f0145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:41.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.576+0000 7f35f8200640 1 --2- 172.21.15.70:0/178609306 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f35f00b1b00 0x7f35f01e44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:41.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.576+0000 7f35f8200640 1 -- 172.21.15.70:0/178609306 >> 172.21.15.70:0/178609306 conn(0x7f35f00b0510 msgr2=0x7f35f0158190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:41.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.576+0000 7f35f8200640 1 -- 172.21.15.70:0/178609306 shutdown_connections 2024-09-13T16:02:41.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:41.576+0000 7f35f8200640 1 -- 172.21.15.70:0/178609306 wait complete. 2024-09-13T16:02:41.996 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T16:02:16.987283+0000', 'modified': '2024-09-13T16:02:41.176196+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 35, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5124}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5124': {'gid': 5124, 'name': 'b', 'rank': 0, 'incarnation': 18, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.107:6835/2709979655', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6833', 'nonce': 2709979655}, {'type': 'v1', 'addr': '172.21.15.107:6835', 'nonce': 2709979655}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T16:02:41.996 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5124:up:replay 2024-09-13T16:02:42.997 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:02:43.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.155+0000 7fe032800640 1 Processor -- start 2024-09-13T16:02:43.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.155+0000 7fe032800640 1 -- start start 2024-09-13T16:02:43.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.157+0000 7fe032800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe02c153b20 0x7fe02c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:43.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.157+0000 7fe032800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe02c159a80 0x7fe02c0b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:43.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.157+0000 7fe032800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02c153f00 con 0x7fe02c0b2410 2024-09-13T16:02:43.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.157+0000 7fe032800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe02c0ce600 con 0x7fe02c153b20 2024-09-13T16:02:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.157+0000 7fe032800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c070f90 con 0x7fe02c159a80 2024-09-13T16:02:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.157+0000 7fe02b400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe02c153b20 0x7fe02c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.157+0000 7fe02b400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe02c153b20 0x7fe02c0b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36842/0 (socket says 172.21.15.70:36842) 2024-09-13T16:02:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.157+0000 7fe02b400640 1 -- 172.21.15.70:0/3458619715 learned_addr learned my addr 172.21.15.70:0/3458619715 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.157+0000 7fe02aa00640 1 --2- 172.21.15.70:0/3458619715 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe02c159a80 0x7fe02c0b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.157+0000 7fe02b400640 1 -- 172.21.15.70:0/3458619715 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe02c159a80 msgr2=0x7fe02c0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.157+0000 7fe02b400640 1 --2- 172.21.15.70:0/3458619715 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe02c159a80 0x7fe02c0b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.157+0000 7fe02b400640 1 -- 172.21.15.70:0/3458619715 >> v1:172.21.15.107:6789/0 conn(0x7fe02c0b2410 legacy=0x7fe02c06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.157+0000 7fe02b400640 1 -- 172.21.15.70:0/3458619715 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c0b1a40 con 0x7fe02c153b20 2024-09-13T16:02:43.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.158+0000 7fe02b400640 1 --2- 172.21.15.70:0/3458619715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02c153b20 0x7fe02c0b3990 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009e80 tx=0x7fe01c02a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5220e200915e05c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:43.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.159+0000 7fe02a000640 1 -- 172.21.15.70:0/3458619715 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c031600 con 0x7fe02c153b20 2024-09-13T16:02:43.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.159+0000 7fe02a000640 1 -- 172.21.15.70:0/3458619715 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01c02d050 con 0x7fe02c153b20 2024-09-13T16:02:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.159+0000 7fe02a000640 1 -- 172.21.15.70:0/3458619715 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c031980 con 0x7fe02c153b20 2024-09-13T16:02:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.159+0000 7fe032800640 1 -- 172.21.15.70:0/3458619715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02c153b20 msgr2=0x7fe02c0b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.159+0000 7fe032800640 1 --2- 172.21.15.70:0/3458619715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02c153b20 0x7fe02c0b3990 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009e80 tx=0x7fe01c02a750 comp rx=0 tx=0).stop 2024-09-13T16:02:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.159+0000 7fe032800640 1 -- 172.21.15.70:0/3458619715 shutdown_connections 2024-09-13T16:02:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.159+0000 7fe032800640 1 --2- 172.21.15.70:0/3458619715 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe02c159a80 0x7fe02c0b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.159+0000 7fe032800640 1 --2- 172.21.15.70:0/3458619715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02c153b20 0x7fe02c0b3990 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.159+0000 7fe032800640 1 -- 172.21.15.70:0/3458619715 >> 172.21.15.70:0/3458619715 conn(0x7fe02c0b0510 msgr2=0x7fe02c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.159+0000 7fe032800640 1 -- 172.21.15.70:0/3458619715 shutdown_connections 2024-09-13T16:02:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.159+0000 7fe032800640 1 -- 172.21.15.70:0/3458619715 wait complete. 2024-09-13T16:02:43.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.161+0000 7fe032800640 1 Processor -- start 2024-09-13T16:02:43.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.161+0000 7fe032800640 1 -- start start 2024-09-13T16:02:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.162+0000 7fe032800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe02c0b2410 0x7fe02c14b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.162+0000 7fe032800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe02c153b20 0x7fe02c15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.162+0000 7fe032800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02c159a80 0x7fe02c14f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.162+0000 7fe032800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c15caa0 con 0x7fe02c159a80 2024-09-13T16:02:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.162+0000 7fe032800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c15be90 con 0x7fe02c153b20 2024-09-13T16:02:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.162+0000 7fe032800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c15c170 con 0x7fe02c0b2410 2024-09-13T16:02:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.162+0000 7fe02be00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02c159a80 0x7fe02c14f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.162+0000 7fe02b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe02c0b2410 0x7fe02c14b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.162+0000 7fe02aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe02c153b20 0x7fe02c15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.162+0000 7fe02b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe02c0b2410 0x7fe02c14b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:38490/0 (socket says 172.21.15.70:38490) 2024-09-13T16:02:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.162+0000 7fe02b400640 1 -- 172.21.15.70:0/2223515592 learned_addr learned my addr 172.21.15.70:0/2223515592 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.163+0000 7fe02b400640 1 -- 172.21.15.70:0/2223515592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe02c153b20 msgr2=0x7fe02c15b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:43.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.163+0000 7fe02b400640 1 --2- 172.21.15.70:0/2223515592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe02c153b20 0x7fe02c15b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:43.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.163+0000 7fe02b400640 1 -- 172.21.15.70:0/2223515592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02c159a80 msgr2=0x7fe02c14f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:43.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.163+0000 7fe02b400640 1 --2- 172.21.15.70:0/2223515592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02c159a80 0x7fe02c14f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:43.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.163+0000 7fe02b400640 1 -- 172.21.15.70:0/2223515592 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c009b30 con 0x7fe02c0b2410 2024-09-13T16:02:43.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.163+0000 7fe02be00640 1 --2- 172.21.15.70:0/2223515592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02c159a80 0x7fe02c14f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:43.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.163+0000 7fe02b400640 1 --2- 172.21.15.70:0/2223515592 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe02c0b2410 0x7fe02c14b1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe01c000f80 tx=0x7fe01c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:43.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.163+0000 7fe023400640 1 -- 172.21.15.70:0/2223515592 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c03d860 con 0x7fe02c0b2410 2024-09-13T16:02:43.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.163+0000 7fe023400640 1 -- 172.21.15.70:0/2223515592 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01c03da00 con 0x7fe02c0b2410 2024-09-13T16:02:43.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.163+0000 7fe023400640 1 -- 172.21.15.70:0/2223515592 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c03ddb0 con 0x7fe02c0b2410 2024-09-13T16:02:43.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.163+0000 7fe032800640 1 -- 172.21.15.70:0/2223515592 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe02c15c450 con 0x7fe02c0b2410 2024-09-13T16:02:43.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.164+0000 7fe032800640 1 -- 172.21.15.70:0/2223515592 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe02c14b6e0 con 0x7fe02c0b2410 2024-09-13T16:02:43.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.165+0000 7fe032800640 1 -- 172.21.15.70:0/2223515592 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02c1536d0 con 0x7fe02c0b2410 2024-09-13T16:02:43.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.166+0000 7fe023400640 1 -- 172.21.15.70:0/2223515592 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe01c046400 con 0x7fe02c0b2410 2024-09-13T16:02:43.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.167+0000 7fe023400640 1 --2- 172.21.15.70:0/2223515592 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe00c06ac00 0x7fe00c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:43.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.167+0000 7fe023400640 1 -- 172.21.15.70:0/2223515592 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe01c0aa2e0 con 0x7fe02c0b2410 2024-09-13T16:02:43.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.167+0000 7fe02aa00640 1 --2- 172.21.15.70:0/2223515592 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe00c06ac00 0x7fe00c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:43.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.167+0000 7fe02aa00640 1 --2- 172.21.15.70:0/2223515592 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe00c06ac00 0x7fe00c06d0c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe02c1592d0 tx=0x7fe018009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:43.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.171+0000 7fe023400640 1 -- 172.21.15.70:0/2223515592 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe01c075580 con 0x7fe02c0b2410 2024-09-13T16:02:43.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.376+0000 7fe032800640 1 -- 172.21.15.70:0/2223515592 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe02c15c2b0 con 0x7fe02c0b2410 2024-09-13T16:02:43.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.377+0000 7fe023400640 1 -- 172.21.15.70:0/2223515592 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4742 (secure 0 0 0) 0x7fe02c15c2b0 con 0x7fe02c0b2410 2024-09-13T16:02:43.378 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:43.379 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2990833970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":2990833970},{"type":"v1","addr":"172.21.15.70:6837","nonce":2990833970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/1247927631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1247927631},{"type":"v1","addr":"172.21.15.70:6836","nonce":1247927631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/1077617661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1077617661},{"type":"v1","addr":"172.21.15.107:6834","nonce":1077617661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:02:16.987283+0000","modified":"2024-09-13T16:02:43.182943+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5124":{"gid":5124,"name":"b","rank":0,"incarnation":18,"state":"up:rejoin","state_seq":10,"addr":"172.21.15.107:6835/2709979655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2709979655},{"type":"v1","addr":"172.21.15.107:6835","nonce":2709979655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T16:02:43.379 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 20 2024-09-13T16:02:43.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.379+0000 7fe032800640 1 -- 172.21.15.70:0/2223515592 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe00c06ac00 msgr2=0x7fe00c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:43.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.379+0000 7fe032800640 1 --2- 172.21.15.70:0/2223515592 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe00c06ac00 0x7fe00c06d0c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe02c1592d0 tx=0x7fe018009190 comp rx=0 tx=0).stop 2024-09-13T16:02:43.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.379+0000 7fe032800640 1 -- 172.21.15.70:0/2223515592 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe02c0b2410 msgr2=0x7fe02c14b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:43.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.379+0000 7fe032800640 1 --2- 172.21.15.70:0/2223515592 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe02c0b2410 0x7fe02c14b1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe01c000f80 tx=0x7fe01c004a40 comp rx=0 tx=0).stop 2024-09-13T16:02:43.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.379+0000 7fe032800640 1 -- 172.21.15.70:0/2223515592 shutdown_connections 2024-09-13T16:02:43.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.379+0000 7fe032800640 1 --2- 172.21.15.70:0/2223515592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02c159a80 0x7fe02c14f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:43.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.379+0000 7fe032800640 1 --2- 172.21.15.70:0/2223515592 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fe00c06ac00 0x7fe00c06d0c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:43.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.379+0000 7fe032800640 1 --2- 172.21.15.70:0/2223515592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe02c153b20 0x7fe02c15b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:43.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.379+0000 7fe032800640 1 --2- 172.21.15.70:0/2223515592 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe02c0b2410 0x7fe02c14b1a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:43.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.379+0000 7fe032800640 1 -- 172.21.15.70:0/2223515592 >> 172.21.15.70:0/2223515592 conn(0x7fe02c0b0510 msgr2=0x7fe02c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:43.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.380+0000 7fe032800640 1 -- 172.21.15.70:0/2223515592 shutdown_connections 2024-09-13T16:02:43.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:43.380+0000 7fe032800640 1 -- 172.21.15.70:0/2223515592 wait complete. 2024-09-13T16:02:43.799 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T16:02:16.987283+0000', 'modified': '2024-09-13T16:02:43.182943+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 35, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5124}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5124': {'gid': 5124, 'name': 'b', 'rank': 0, 'incarnation': 18, 'state': 'up:rejoin', 'state_seq': 10, 'addr': '172.21.15.107:6835/2709979655', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6833', 'nonce': 2709979655}, {'type': 'v1', 'addr': '172.21.15.107:6835', 'nonce': 2709979655}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T16:02:43.799 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5124:up:rejoin 2024-09-13T16:02:44.800 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:02:44.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.960+0000 7fbca4800640 1 Processor -- start 2024-09-13T16:02:44.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.960+0000 7fbca4800640 1 -- start start 2024-09-13T16:02:44.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.961+0000 7fbca4800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbc9c153b20 0x7fbc9c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:44.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.961+0000 7fbca4800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbc9c159a80 0x7fbc9c0b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:44.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.961+0000 7fbca4800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc9c0b2410 0x7fbc9c06f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:44.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.961+0000 7fbca4800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9c0ce600 con 0x7fbc9c153b20 2024-09-13T16:02:44.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.961+0000 7fbca4800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9c070f90 con 0x7fbc9c159a80 2024-09-13T16:02:44.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.961+0000 7fbca4800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c153f00 con 0x7fbc9c0b2410 2024-09-13T16:02:44.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.961+0000 7fbca1e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbc9c153b20 0x7fbc9c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.962+0000 7fbca1e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbc9c153b20 0x7fbc9c0b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36862/0 (socket says 172.21.15.70:36862) 2024-09-13T16:02:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.962+0000 7fbca1e00640 1 -- 172.21.15.70:0/3552564304 learned_addr learned my addr 172.21.15.70:0/3552564304 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.962+0000 7fbca1e00640 1 -- 172.21.15.70:0/3552564304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc9c0b2410 msgr2=0x7fbc9c06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.962+0000 7fbca1400640 1 --2- 172.21.15.70:0/3552564304 >> v2:172.21.15.107:3300/0 conn(0x7fbc9c159a80 0x7fbc9c0b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.962+0000 7fbca2800640 1 --2- 172.21.15.70:0/3552564304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc9c0b2410 0x7fbc9c06f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.962+0000 7fbca1e00640 1 --2- 172.21.15.70:0/3552564304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc9c0b2410 0x7fbc9c06f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.962+0000 7fbca1e00640 1 -- 172.21.15.70:0/3552564304 >> v2:172.21.15.107:3300/0 conn(0x7fbc9c159a80 msgr2=0x7fbc9c0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.962+0000 7fbca1e00640 1 --2- 172.21.15.70:0/3552564304 >> v2:172.21.15.107:3300/0 conn(0x7fbc9c159a80 0x7fbc9c0b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.962+0000 7fbca1e00640 1 -- 172.21.15.70:0/3552564304 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c0b1a40 con 0x7fbc9c153b20 2024-09-13T16:02:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.962+0000 7fbca1400640 1 --2- 172.21.15.70:0/3552564304 >> v2:172.21.15.107:3300/0 conn(0x7fbc9c159a80 0x7fbc9c0b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.962+0000 7fbca2800640 1 --2- 172.21.15.70:0/3552564304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc9c0b2410 0x7fbc9c06f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:44.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.963+0000 7fbca1e00640 1 --2- 172.21.15.70:0/3552564304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc9c153b20 0x7fbc9c0b3990 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0707d0 tx=0x7fbc9002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d56ab4134b119b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:44.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.963+0000 7fbca0a00640 1 -- 172.21.15.70:0/3552564304 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90032440 con 0x7fbc9c153b20 2024-09-13T16:02:44.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.963+0000 7fbca0a00640 1 -- 172.21.15.70:0/3552564304 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc900325a0 con 0x7fbc9c153b20 2024-09-13T16:02:44.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.963+0000 7fbca0a00640 1 -- 172.21.15.70:0/3552564304 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90032930 con 0x7fbc9c153b20 2024-09-13T16:02:44.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.964+0000 7fbca4800640 1 -- 172.21.15.70:0/3552564304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc9c153b20 msgr2=0x7fbc9c0b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:44.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.964+0000 7fbca4800640 1 --2- 172.21.15.70:0/3552564304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc9c153b20 0x7fbc9c0b3990 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0707d0 tx=0x7fbc9002a210 comp rx=0 tx=0).stop 2024-09-13T16:02:44.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.964+0000 7fbca4800640 1 -- 172.21.15.70:0/3552564304 shutdown_connections 2024-09-13T16:02:44.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.964+0000 7fbca4800640 1 --2- 172.21.15.70:0/3552564304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc9c0b2410 0x7fbc9c06f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:44.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.964+0000 7fbca4800640 1 --2- 172.21.15.70:0/3552564304 >> v2:172.21.15.107:3300/0 conn(0x7fbc9c159a80 0x7fbc9c0b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:44.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.964+0000 7fbca4800640 1 --2- 172.21.15.70:0/3552564304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc9c153b20 0x7fbc9c0b3990 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:44.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.964+0000 7fbca4800640 1 -- 172.21.15.70:0/3552564304 >> 172.21.15.70:0/3552564304 conn(0x7fbc9c0b0510 msgr2=0x7fbc9c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:44.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.964+0000 7fbca4800640 1 -- 172.21.15.70:0/3552564304 shutdown_connections 2024-09-13T16:02:44.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.964+0000 7fbca4800640 1 -- 172.21.15.70:0/3552564304 wait complete. 2024-09-13T16:02:44.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.965+0000 7fbca4800640 1 Processor -- start 2024-09-13T16:02:44.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.966+0000 7fbca4800640 1 -- start start 2024-09-13T16:02:44.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.966+0000 7fbca4800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc9c0b2410 0x7fbc9c157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:44.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.966+0000 7fbca4800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc9c153b20 0x7fbc9c146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:44.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.966+0000 7fbca4800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc9c159a80 0x7fbc9c0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:44.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.966+0000 7fbca4800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c157b50 con 0x7fbc9c0b2410 2024-09-13T16:02:44.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.966+0000 7fbca4800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c14ea60 con 0x7fbc9c159a80 2024-09-13T16:02:44.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.966+0000 7fbca4800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c1474e0 con 0x7fbc9c153b20 2024-09-13T16:02:44.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.967+0000 7fbca1e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc9c0b2410 0x7fbc9c157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:44.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.967+0000 7fbca1e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc9c0b2410 0x7fbc9c157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36864/0 (socket says 172.21.15.70:36864) 2024-09-13T16:02:44.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.967+0000 7fbca1e00640 1 -- 172.21.15.70:0/447565955 learned_addr learned my addr 172.21.15.70:0/447565955 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:44.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.967+0000 7fbca2800640 1 --2- 172.21.15.70:0/447565955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc9c159a80 0x7fbc9c0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:44.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.967+0000 7fbca1400640 1 --2- 172.21.15.70:0/447565955 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc9c153b20 0x7fbc9c146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:44.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.967+0000 7fbca1e00640 1 -- 172.21.15.70:0/447565955 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc9c153b20 msgr2=0x7fbc9c146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:44.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.967+0000 7fbca1e00640 1 --2- 172.21.15.70:0/447565955 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc9c153b20 0x7fbc9c146fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:44.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.967+0000 7fbca1e00640 1 -- 172.21.15.70:0/447565955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc9c159a80 msgr2=0x7fbc9c0ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:44.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.967+0000 7fbca1e00640 1 --2- 172.21.15.70:0/447565955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc9c159a80 0x7fbc9c0ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:44.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.967+0000 7fbca1e00640 1 -- 172.21.15.70:0/447565955 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc900094d0 con 0x7fbc9c0b2410 2024-09-13T16:02:44.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.967+0000 7fbca2800640 1 --2- 172.21.15.70:0/447565955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc9c159a80 0x7fbc9c0ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:44.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.967+0000 7fbca1e00640 1 --2- 172.21.15.70:0/447565955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc9c0b2410 0x7fbc9c157610 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbc9002a250 tx=0x7fbc900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:44.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.968+0000 7fbc96000640 1 -- 172.21.15.70:0/447565955 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90030b80 con 0x7fbc9c0b2410 2024-09-13T16:02:44.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.968+0000 7fbc96000640 1 -- 172.21.15.70:0/447565955 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc90030ce0 con 0x7fbc9c0b2410 2024-09-13T16:02:44.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.968+0000 7fbc96000640 1 -- 172.21.15.70:0/447565955 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9003d680 con 0x7fbc9c0b2410 2024-09-13T16:02:44.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.968+0000 7fbca4800640 1 -- 172.21.15.70:0/447565955 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9c155260 con 0x7fbc9c0b2410 2024-09-13T16:02:44.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.968+0000 7fbca4800640 1 -- 172.21.15.70:0/447565955 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9c155820 con 0x7fbc9c0b2410 2024-09-13T16:02:44.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.969+0000 7fbca4800640 1 -- 172.21.15.70:0/447565955 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9c0b3990 con 0x7fbc9c0b2410 2024-09-13T16:02:44.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.970+0000 7fbc96000640 1 -- 172.21.15.70:0/447565955 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbc90039040 con 0x7fbc9c0b2410 2024-09-13T16:02:44.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.970+0000 7fbc96000640 1 --2- 172.21.15.70:0/447565955 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fbc8006ac00 0x7fbc8006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:44.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.971+0000 7fbc96000640 1 -- 172.21.15.70:0/447565955 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fbc900aa1e0 con 0x7fbc9c0b2410 2024-09-13T16:02:44.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.971+0000 7fbca1400640 1 --2- 172.21.15.70:0/447565955 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fbc8006ac00 0x7fbc8006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:44.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.971+0000 7fbca1400640 1 --2- 172.21.15.70:0/447565955 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fbc8006ac00 0x7fbc8006d0c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0ad460 tx=0x7fbc8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:44.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:44.975+0000 7fbc96000640 1 -- 172.21.15.70:0/447565955 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbc900752c0 con 0x7fbc9c0b2410 2024-09-13T16:02:45.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:45.176+0000 7fbca4800640 1 -- 172.21.15.70:0/447565955 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc9c15d1a0 con 0x7fbc9c0b2410 2024-09-13T16:02:45.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:45.177+0000 7fbc96000640 1 -- 172.21.15.70:0/447565955 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4748 (secure 0 0 0) 0x7fbc900788e0 con 0x7fbc9c0b2410 2024-09-13T16:02:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:45.179 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2990833970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":2990833970},{"type":"v1","addr":"172.21.15.70:6837","nonce":2990833970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/1247927631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1247927631},{"type":"v1","addr":"172.21.15.70:6836","nonce":1247927631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/1077617661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1077617661},{"type":"v1","addr":"172.21.15.107:6834","nonce":1077617661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:02:16.987283+0000","modified":"2024-09-13T16:02:44.188279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5124":{"gid":5124,"name":"b","rank":0,"incarnation":18,"state":"up:clientreplay","state_seq":11,"addr":"172.21.15.107:6835/2709979655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2709979655},{"type":"v1","addr":"172.21.15.107:6835","nonce":2709979655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T16:02:45.179 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 21 2024-09-13T16:02:45.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:45.179+0000 7fbca4800640 1 -- 172.21.15.70:0/447565955 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fbc8006ac00 msgr2=0x7fbc8006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:45.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:45.179+0000 7fbca4800640 1 --2- 172.21.15.70:0/447565955 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fbc8006ac00 0x7fbc8006d0c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0ad460 tx=0x7fbc8c008040 comp rx=0 tx=0).stop 2024-09-13T16:02:45.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:45.179+0000 7fbca4800640 1 -- 172.21.15.70:0/447565955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc9c0b2410 msgr2=0x7fbc9c157610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:45.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:45.179+0000 7fbca4800640 1 --2- 172.21.15.70:0/447565955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc9c0b2410 0x7fbc9c157610 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbc9002a250 tx=0x7fbc900046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:45.179+0000 7fbca4800640 1 -- 172.21.15.70:0/447565955 shutdown_connections 2024-09-13T16:02:45.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:45.179+0000 7fbca4800640 1 --2- 172.21.15.70:0/447565955 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fbc8006ac00 0x7fbc8006d0c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:45.179+0000 7fbca4800640 1 --2- 172.21.15.70:0/447565955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc9c159a80 0x7fbc9c0ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:45.179+0000 7fbca4800640 1 --2- 172.21.15.70:0/447565955 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc9c153b20 0x7fbc9c146fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:45.179+0000 7fbca4800640 1 --2- 172.21.15.70:0/447565955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc9c0b2410 0x7fbc9c157610 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:45.179+0000 7fbca4800640 1 -- 172.21.15.70:0/447565955 >> 172.21.15.70:0/447565955 conn(0x7fbc9c0b0510 msgr2=0x7fbc9c156cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:45.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:45.179+0000 7fbca4800640 1 -- 172.21.15.70:0/447565955 shutdown_connections 2024-09-13T16:02:45.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:45.179+0000 7fbca4800640 1 -- 172.21.15.70:0/447565955 wait complete. 2024-09-13T16:02:45.353 INFO:tasks.ceph.mds.b.smithi107.stderr:2024-09-13T16:02:45.352+0000 7f6ac4a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T16:02:45.600 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T16:02:16.987283+0000', 'modified': '2024-09-13T16:02:44.188279+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 35, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5124}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5124': {'gid': 5124, 'name': 'b', 'rank': 0, 'incarnation': 18, 'state': 'up:clientreplay', 'state_seq': 11, 'addr': '172.21.15.107:6835/2709979655', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6833', 'nonce': 2709979655}, {'type': 'v1', 'addr': '172.21.15.107:6835', 'nonce': 2709979655}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T16:02:45.600 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5124:up:clientreplay 2024-09-13T16:02:46.314 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T16:02:46.320 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T16:02:46.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:02:46.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.753+0000 7f7f13e00640 1 Processor -- start 2024-09-13T16:02:46.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.753+0000 7f7f13e00640 1 -- start start 2024-09-13T16:02:46.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.754+0000 7f7f13e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f14071560 0x7f7f140ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:46.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.754+0000 7f7f13e00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f140cd850 con 0x7f7f14159480 2024-09-13T16:02:46.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.754+0000 7f7f13e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f140cd570 con 0x7f7f1406f4b0 2024-09-13T16:02:46.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.754+0000 7f7f13e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f140b1740 con 0x7f7f14071560 2024-09-13T16:02:46.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.754+0000 7f7f12a00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f7f14159480 0x7f7f14070e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:57298/0 (socket says 172.21.15.70:57298) 2024-09-13T16:02:46.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.754+0000 7f7f12a00640 1 -- 172.21.15.70:0/3212099923 learned_addr learned my addr 172.21.15.70:0/3212099923 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:46.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f12000640 1 --2- 172.21.15.70:0/3212099923 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f14071560 0x7f7f140ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:46.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f11600640 1 -- 172.21.15.70:0/3212099923 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478920005 0 0) 0x7f7f140cd850 con 0x7f7f14159480 2024-09-13T16:02:46.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f11600640 1 -- 172.21.15.70:0/3212099923 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ef8005730 con 0x7f7f14159480 2024-09-13T16:02:46.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f11600640 1 -- 172.21.15.70:0/3212099923 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640288985 0 0) 0x7f7f140cd570 con 0x7f7f1406f4b0 2024-09-13T16:02:46.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f11600640 1 -- 172.21.15.70:0/3212099923 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f140cd850 con 0x7f7f1406f4b0 2024-09-13T16:02:46.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f11600640 1 -- 172.21.15.70:0/3212099923 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3599788247 0 0) 0x7f7ef8005730 con 0x7f7f14159480 2024-09-13T16:02:46.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f11600640 1 -- 172.21.15.70:0/3212099923 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f14071560 msgr2=0x7f7f140ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:46.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f11600640 1 --2- 172.21.15.70:0/3212099923 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f14071560 0x7f7f140ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:46.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f11600640 1 -- 172.21.15.70:0/3212099923 >> v1:172.21.15.107:6789/0 conn(0x7f7f1406f4b0 legacy=0x7f7f140b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:46.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f11600640 1 -- 172.21.15.70:0/3212099923 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f140b1a20 con 0x7f7f14159480 2024-09-13T16:02:46.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f11600640 1 -- 172.21.15.70:0/3212099923 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f7f04001670 con 0x7f7f14159480 2024-09-13T16:02:46.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f11600640 1 -- 172.21.15.70:0/3212099923 >> v1:172.21.15.70:6789/0 conn(0x7f7f14159480 legacy=0x7f7f14070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:46.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f11600640 1 --2- 172.21.15.70:0/3212099923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ef8005d40 0x7f7ef8006140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:46.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f11600640 1 --2- 172.21.15.70:0/3212099923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ef80069d0 0x7f7ef8006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:46.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f11600640 1 --2- 172.21.15.70:0/3212099923 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ef8007390 0x7f7ef800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:46.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f11600640 1 -- 172.21.15.70:0/3212099923 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f140b1740 con 0x7f7ef8005d40 2024-09-13T16:02:46.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f11600640 1 -- 172.21.15.70:0/3212099923 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef800e200 con 0x7f7ef80069d0 2024-09-13T16:02:46.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f11600640 1 -- 172.21.15.70:0/3212099923 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef800e3c0 con 0x7f7ef8007390 2024-09-13T16:02:46.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f12000640 1 --2- 172.21.15.70:0/3212099923 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f14071560 0x7f7f140ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:46.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.755+0000 7f7f12a00640 1 --2- 172.21.15.70:0/3212099923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ef8005d40 0x7f7ef8006140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:46.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.756+0000 7f7f13400640 1 --2- 172.21.15.70:0/3212099923 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ef8007390 0x7f7ef800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:46.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.756+0000 7f7f12000640 1 --2- 172.21.15.70:0/3212099923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ef80069d0 0x7f7ef8006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:46.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.756+0000 7f7f12a00640 1 -- 172.21.15.70:0/3212099923 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ef8007390 msgr2=0x7f7ef800db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:46.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.756+0000 7f7f12a00640 1 --2- 172.21.15.70:0/3212099923 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ef8007390 0x7f7ef800db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:46.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.756+0000 7f7f12a00640 1 -- 172.21.15.70:0/3212099923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ef80069d0 msgr2=0x7f7ef8006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:46.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.756+0000 7f7f12a00640 1 --2- 172.21.15.70:0/3212099923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ef80069d0 0x7f7ef8006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:46.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.756+0000 7f7f12a00640 1 -- 172.21.15.70:0/3212099923 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef8005730 con 0x7f7ef8005d40 2024-09-13T16:02:46.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.756+0000 7f7f13400640 1 --2- 172.21.15.70:0/3212099923 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ef8007390 0x7f7ef800db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:46.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.757+0000 7f7f12a00640 1 --2- 172.21.15.70:0/3212099923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ef8005d40 0x7f7ef8006140 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400c160 tx=0x7f7ef8007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6430ac64de4af190 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:46.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.757+0000 7f7f11600640 1 -- 172.21.15.70:0/3212099923 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04005ad0 con 0x7f7ef8005d40 2024-09-13T16:02:46.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.757+0000 7f7f11600640 1 -- 172.21.15.70:0/3212099923 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0402d070 con 0x7f7ef8005d40 2024-09-13T16:02:46.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.757+0000 7f7f11600640 1 -- 172.21.15.70:0/3212099923 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04005e90 con 0x7f7ef8005d40 2024-09-13T16:02:46.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.758+0000 7f7f13e00640 1 -- 172.21.15.70:0/3212099923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ef8005d40 msgr2=0x7f7ef8006140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:46.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.758+0000 7f7f13e00640 1 --2- 172.21.15.70:0/3212099923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ef8005d40 0x7f7ef8006140 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400c160 tx=0x7f7ef8007a00 comp rx=0 tx=0).stop 2024-09-13T16:02:46.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.758+0000 7f7f13400640 1 -- 172.21.15.70:0/3212099923 reap_dead start 2024-09-13T16:02:46.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.758+0000 7f7f13e00640 1 -- 172.21.15.70:0/3212099923 shutdown_connections 2024-09-13T16:02:46.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.758+0000 7f7f13e00640 1 -- 172.21.15.70:0/3212099923 >> 172.21.15.70:0/3212099923 conn(0x7f7f140ae310 msgr2=0x7f7f140ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:46.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.758+0000 7f7f13e00640 1 -- 172.21.15.70:0/3212099923 shutdown_connections 2024-09-13T16:02:46.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.758+0000 7f7f13e00640 1 -- 172.21.15.70:0/3212099923 wait complete. 2024-09-13T16:02:46.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.759+0000 7f7f13e00640 1 Processor -- start 2024-09-13T16:02:46.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.760+0000 7f7f13e00640 1 -- start start 2024-09-13T16:02:46.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.760+0000 7f7f13e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ef8005d40 0x7f7f141ec380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:46.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.760+0000 7f7f13e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f1414e1f0 0x7f7f1414e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:46.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.760+0000 7f7f13e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f14154600 0x7f7f14154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:46.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.760+0000 7f7f13e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f141f23b0 con 0x7f7f1414e1f0 2024-09-13T16:02:46.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.760+0000 7f7f13e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f14154fc0 con 0x7f7ef8005d40 2024-09-13T16:02:46.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.760+0000 7f7f13e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f141f3380 con 0x7f7f14154600 2024-09-13T16:02:46.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.761+0000 7f7f12000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f1414e1f0 0x7f7f1414e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:46.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.761+0000 7f7f12000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f1414e1f0 0x7f7f1414e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36882/0 (socket says 172.21.15.70:36882) 2024-09-13T16:02:46.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.761+0000 7f7f12000640 1 -- 172.21.15.70:0/421366032 learned_addr learned my addr 172.21.15.70:0/421366032 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:46.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.761+0000 7f7f12a00640 1 --2- 172.21.15.70:0/421366032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ef8005d40 0x7f7f141ec380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:46.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.761+0000 7f7f13400640 1 --2- 172.21.15.70:0/421366032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f14154600 0x7f7f14154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:46.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.761+0000 7f7f12000640 1 -- 172.21.15.70:0/421366032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f14154600 msgr2=0x7f7f14154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:46.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.761+0000 7f7f12000640 1 --2- 172.21.15.70:0/421366032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f14154600 0x7f7f14154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:46.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.761+0000 7f7f12000640 1 -- 172.21.15.70:0/421366032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ef8005d40 msgr2=0x7f7f141ec380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:46.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.761+0000 7f7f12000640 1 --2- 172.21.15.70:0/421366032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ef8005d40 0x7f7f141ec380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:46.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.761+0000 7f7f12000640 1 -- 172.21.15.70:0/421366032 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f141ec8c0 con 0x7f7f1414e1f0 2024-09-13T16:02:46.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.761+0000 7f7f12a00640 1 --2- 172.21.15.70:0/421366032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ef8005d40 0x7f7f141ec380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:46.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.762+0000 7f7f12000640 1 --2- 172.21.15.70:0/421366032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f1414e1f0 0x7f7f1414e670 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7efc011800 tx=0x7f7efc011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:46.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.762+0000 7f7f0aa00640 1 -- 172.21.15.70:0/421366032 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00f960 con 0x7f7f1414e1f0 2024-09-13T16:02:46.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.762+0000 7f7f0aa00640 1 -- 172.21.15.70:0/421366032 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc00fac0 con 0x7f7f1414e1f0 2024-09-13T16:02:46.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.762+0000 7f7f13e00640 1 -- 172.21.15.70:0/421366032 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1414ecb0 con 0x7f7f1414e1f0 2024-09-13T16:02:46.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.762+0000 7f7f0aa00640 1 -- 172.21.15.70:0/421366032 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00fe70 con 0x7f7f1414e1f0 2024-09-13T16:02:46.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.762+0000 7f7f13e00640 1 -- 172.21.15.70:0/421366032 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f141f28a0 con 0x7f7f1414e1f0 2024-09-13T16:02:46.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.763+0000 7f7f13e00640 1 -- 172.21.15.70:0/421366032 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f14067360 con 0x7f7f1414e1f0 2024-09-13T16:02:46.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.764+0000 7f7f0aa00640 1 -- 172.21.15.70:0/421366032 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7efc015460 con 0x7f7f1414e1f0 2024-09-13T16:02:46.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.765+0000 7f7f0aa00640 1 --2- 172.21.15.70:0/421366032 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7ef006ac00 0x7f7ef006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:46.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.765+0000 7f7f0aa00640 1 -- 172.21.15.70:0/421366032 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7efc089e20 con 0x7f7f1414e1f0 2024-09-13T16:02:46.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.765+0000 7f7f12a00640 1 --2- 172.21.15.70:0/421366032 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7ef006ac00 0x7f7ef006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:46.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.766+0000 7f7f12a00640 1 --2- 172.21.15.70:0/421366032 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7ef006ac00 0x7f7ef006d0c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7f04032000 tx=0x7f7f04009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:46.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.769+0000 7f7f0aa00640 1 -- 172.21.15.70:0/421366032 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7efc054f00 con 0x7f7f1414e1f0 2024-09-13T16:02:46.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.973+0000 7f7f13e00640 1 -- 172.21.15.70:0/421366032 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f1415ce80 con 0x7f7f1414e1f0 2024-09-13T16:02:46.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.974+0000 7f7f0aa00640 1 -- 172.21.15.70:0/421366032 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f7efc058520 con 0x7f7f1414e1f0 2024-09-13T16:02:46.977 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:46.977 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2990833970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":2990833970},{"type":"v1","addr":"172.21.15.70:6837","nonce":2990833970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/1247927631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1247927631},{"type":"v1","addr":"172.21.15.70:6836","nonce":1247927631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/1077617661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1077617661},{"type":"v1","addr":"172.21.15.107:6834","nonce":1077617661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:02:16.987283+0000","modified":"2024-09-13T16:02:45.193131+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5124":{"gid":5124,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6835/2709979655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2709979655},{"type":"v1","addr":"172.21.15.107:6835","nonce":2709979655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T16:02:46.977 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 22 2024-09-13T16:02:46.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.976+0000 7f7f13e00640 1 -- 172.21.15.70:0/421366032 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7ef006ac00 msgr2=0x7f7ef006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:46.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.976+0000 7f7f13e00640 1 --2- 172.21.15.70:0/421366032 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7ef006ac00 0x7f7ef006d0c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7f04032000 tx=0x7f7f04009030 comp rx=0 tx=0).stop 2024-09-13T16:02:46.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.976+0000 7f7f13e00640 1 -- 172.21.15.70:0/421366032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f1414e1f0 msgr2=0x7f7f1414e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:46.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.976+0000 7f7f13e00640 1 --2- 172.21.15.70:0/421366032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f1414e1f0 0x7f7f1414e670 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7efc011800 tx=0x7f7efc011cc0 comp rx=0 tx=0).stop 2024-09-13T16:02:46.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.976+0000 7f7f13e00640 1 -- 172.21.15.70:0/421366032 shutdown_connections 2024-09-13T16:02:46.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.976+0000 7f7f13e00640 1 --2- 172.21.15.70:0/421366032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f14154600 0x7f7f14154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:46.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.976+0000 7f7f13e00640 1 --2- 172.21.15.70:0/421366032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f1414e1f0 0x7f7f1414e670 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:46.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.976+0000 7f7f13e00640 1 --2- 172.21.15.70:0/421366032 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7ef006ac00 0x7f7ef006d0c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:46.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.976+0000 7f7f13e00640 1 --2- 172.21.15.70:0/421366032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ef8005d40 0x7f7f141ec380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:46.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.976+0000 7f7f13e00640 1 -- 172.21.15.70:0/421366032 >> 172.21.15.70:0/421366032 conn(0x7f7f140ae310 msgr2=0x7f7f140af5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:46.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.976+0000 7f7f13e00640 1 -- 172.21.15.70:0/421366032 shutdown_connections 2024-09-13T16:02:46.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:46.976+0000 7f7f13e00640 1 -- 172.21.15.70:0/421366032 wait complete. 2024-09-13T16:02:47.397 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T16:02:16.987283+0000', 'modified': '2024-09-13T16:02:45.193131+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 35, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5124}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5124': {'gid': 5124, 'name': 'b', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.107:6835/2709979655', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6833', 'nonce': 2709979655}, {'type': 'v1', 'addr': '172.21.15.107:6835', 'nonce': 2709979655}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T16:02:47.397 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T16:02:47.397 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T16:02:47.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.548+0000 7f8253800640 1 Processor -- start 2024-09-13T16:02:47.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.548+0000 7f8253800640 1 -- start start 2024-09-13T16:02:47.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.549+0000 7f8253800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f824c159610 0x7f824c070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.550+0000 7f8253800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f824c070540 0x7f824c0b3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.550+0000 7f8253800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f824c0709e0 con 0x7f824c0b35c0 2024-09-13T16:02:47.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.550+0000 7f8253800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f824c0b3a50 con 0x7f824c070540 2024-09-13T16:02:47.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.550+0000 7f8253800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824c1599f0 con 0x7f824c159610 2024-09-13T16:02:47.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.550+0000 7f8243e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f824c070540 0x7f824c0b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:47.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.550+0000 7f8243e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f824c070540 0x7f824c0b3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36898/0 (socket says 172.21.15.70:36898) 2024-09-13T16:02:47.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.550+0000 7f8243e00640 1 -- 172.21.15.70:0/1193295062 learned_addr learned my addr 172.21.15.70:0/1193295062 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:47.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.550+0000 7f8250e00640 1 --2- 172.21.15.70:0/1193295062 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f824c159610 0x7f824c070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:47.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.550+0000 7f8243e00640 1 -- 172.21.15.70:0/1193295062 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f824c159610 msgr2=0x7f824c070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:47.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.550+0000 7f8243e00640 1 --2- 172.21.15.70:0/1193295062 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f824c159610 0x7f824c070000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.550+0000 7f8243e00640 1 -- 172.21.15.70:0/1193295062 >> v1:172.21.15.107:6789/0 conn(0x7f824c0b35c0 legacy=0x7f824c0b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:47.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.550+0000 7f8243e00640 1 -- 172.21.15.70:0/1193295062 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c070cc0 con 0x7f824c070540 2024-09-13T16:02:47.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.551+0000 7f8243e00640 1 --2- 172.21.15.70:0/1193295062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f824c070540 0x7f824c0b3080 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8234009870 tx=0x7f823402c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1394c9dacc814b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:47.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.551+0000 7f824be00640 1 -- 172.21.15.70:0/1193295062 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8234031710 con 0x7f824c070540 2024-09-13T16:02:47.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.552+0000 7f824be00640 1 -- 172.21.15.70:0/1193295062 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823402f050 con 0x7f824c070540 2024-09-13T16:02:47.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.552+0000 7f824be00640 1 -- 172.21.15.70:0/1193295062 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8234031a90 con 0x7f824c070540 2024-09-13T16:02:47.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.552+0000 7f8253800640 1 -- 172.21.15.70:0/1193295062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f824c070540 msgr2=0x7f824c0b3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:47.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.552+0000 7f8253800640 1 --2- 172.21.15.70:0/1193295062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f824c070540 0x7f824c0b3080 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8234009870 tx=0x7f823402c460 comp rx=0 tx=0).stop 2024-09-13T16:02:47.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.552+0000 7f8253800640 1 -- 172.21.15.70:0/1193295062 shutdown_connections 2024-09-13T16:02:47.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.552+0000 7f8253800640 1 --2- 172.21.15.70:0/1193295062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f824c070540 0x7f824c0b3080 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.552+0000 7f8253800640 1 --2- 172.21.15.70:0/1193295062 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f824c159610 0x7f824c070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.552+0000 7f8253800640 1 -- 172.21.15.70:0/1193295062 >> 172.21.15.70:0/1193295062 conn(0x7f824c0b0510 msgr2=0x7f824c0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:47.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.552+0000 7f8253800640 1 -- 172.21.15.70:0/1193295062 shutdown_connections 2024-09-13T16:02:47.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.552+0000 7f8253800640 1 -- 172.21.15.70:0/1193295062 wait complete. 2024-09-13T16:02:47.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.554+0000 7f8253800640 1 Processor -- start 2024-09-13T16:02:47.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.554+0000 7f8253800640 1 -- start start 2024-09-13T16:02:47.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.555+0000 7f8253800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f824c070540 0x7f824c14fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.555+0000 7f8253800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f824c0b35c0 0x7f824c1e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.555+0000 7f8253800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f824c159610 0x7f824c0b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.555+0000 7f8253800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c150020 con 0x7f824c070540 2024-09-13T16:02:47.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.555+0000 7f8253800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c15b050 con 0x7f824c159610 2024-09-13T16:02:47.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.555+0000 7f8253800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824c159fb0 con 0x7f824c0b35c0 2024-09-13T16:02:47.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.555+0000 7f8250e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f824c070540 0x7f824c14fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:47.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.555+0000 7f8250e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f824c070540 0x7f824c14fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36906/0 (socket says 172.21.15.70:36906) 2024-09-13T16:02:47.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.555+0000 7f8250e00640 1 -- 172.21.15.70:0/3236289854 learned_addr learned my addr 172.21.15.70:0/3236289854 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:47.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.555+0000 7f8243e00640 1 --2- 172.21.15.70:0/3236289854 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f824c0b35c0 0x7f824c1e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:47.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.555+0000 7f8251800640 1 --2- 172.21.15.70:0/3236289854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f824c159610 0x7f824c0b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:47.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.556+0000 7f8250e00640 1 -- 172.21.15.70:0/3236289854 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f824c0b35c0 msgr2=0x7f824c1e34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:47.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.556+0000 7f8250e00640 1 --2- 172.21.15.70:0/3236289854 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f824c0b35c0 0x7f824c1e34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.556+0000 7f8250e00640 1 -- 172.21.15.70:0/3236289854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f824c159610 msgr2=0x7f824c0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:47.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.556+0000 7f8250e00640 1 --2- 172.21.15.70:0/3236289854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f824c159610 0x7f824c0b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.556+0000 7f8250e00640 1 -- 172.21.15.70:0/3236289854 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82340094d0 con 0x7f824c070540 2024-09-13T16:02:47.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.556+0000 7f8251800640 1 --2- 172.21.15.70:0/3236289854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f824c159610 0x7f824c0b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:47.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.556+0000 7f8250e00640 1 --2- 172.21.15.70:0/3236289854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f824c070540 0x7f824c14fae0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f823c00d5f0 tx=0x7f823c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:47.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.556+0000 7f8249600640 1 -- 172.21.15.70:0/3236289854 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c0125f0 con 0x7f824c070540 2024-09-13T16:02:47.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.556+0000 7f8249600640 1 -- 172.21.15.70:0/3236289854 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823c012750 con 0x7f824c070540 2024-09-13T16:02:47.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.556+0000 7f8249600640 1 -- 172.21.15.70:0/3236289854 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c012b00 con 0x7f824c070540 2024-09-13T16:02:47.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.556+0000 7f8253800640 1 -- 172.21.15.70:0/3236289854 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824c15a290 con 0x7f824c070540 2024-09-13T16:02:47.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.557+0000 7f8253800640 1 -- 172.21.15.70:0/3236289854 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824c15a850 con 0x7f824c070540 2024-09-13T16:02:47.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.559+0000 7f8249600640 1 -- 172.21.15.70:0/3236289854 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f823c012c60 con 0x7f824c070540 2024-09-13T16:02:47.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.560+0000 7f8249600640 1 --2- 172.21.15.70:0/3236289854 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f822806ac00 0x7f822806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.560+0000 7f8249600640 1 -- 172.21.15.70:0/3236289854 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f823c089890 con 0x7f824c070540 2024-09-13T16:02:47.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.560+0000 7f82567d7740 1 Processor -- start 2024-09-13T16:02:47.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.560+0000 7f82567d7740 1 -- start start 2024-09-13T16:02:47.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.560+0000 7f8243e00640 1 --2- 172.21.15.70:0/3236289854 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f822806ac00 0x7f822806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:47.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.561+0000 7f8243e00640 1 --2- 172.21.15.70:0/3236289854 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f822806ac00 0x7f822806d0c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8234035000 tx=0x7f8234008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:47.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.561+0000 7f82567d7740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106b16d0 0x562a106b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.561+0000 7f82567d7740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106aee90 0x562a106feba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.561+0000 7f82567d7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106d8b80 0x562a106ff0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.561+0000 7f82567d7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a1061aab0 con 0x562a106d8b80 2024-09-13T16:02:47.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.561+0000 7f82567d7740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a10618240 con 0x562a106aee90 2024-09-13T16:02:47.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.561+0000 7f82567d7740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a10613b30 con 0x562a106b16d0 2024-09-13T16:02:47.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.561+0000 7f8251800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106d8b80 0x562a106ff0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:47.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.561+0000 7f8251800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106d8b80 0x562a106ff0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36912/0 (socket says 172.21.15.70:36912) 2024-09-13T16:02:47.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.561+0000 7f8251800640 1 -- 172.21.15.70:0/973236809 learned_addr learned my addr 172.21.15.70:0/973236809 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:47.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.562+0000 7f8250e00640 1 --2- 172.21.15.70:0/973236809 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106b16d0 0x562a106b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:47.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.562+0000 7f8251800640 1 -- 172.21.15.70:0/973236809 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106b16d0 msgr2=0x562a106b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:47.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.562+0000 7f8251800640 1 --2- 172.21.15.70:0/973236809 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106b16d0 0x562a106b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.562+0000 7f8251800640 1 -- 172.21.15.70:0/973236809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106aee90 msgr2=0x562a106feba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:47.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.562+0000 7f8251800640 1 --2- 172.21.15.70:0/973236809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106aee90 0x562a106feba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.562+0000 7f8251800640 1 -- 172.21.15.70:0/973236809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a105debd0 con 0x562a106d8b80 2024-09-13T16:02:47.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.562+0000 7f8251800640 1 --2- 172.21.15.70:0/973236809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106d8b80 0x562a106ff0e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8244001d10 tx=0x7f82440021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b46673ea93b5f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:47.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.562+0000 7f8241600640 1 -- 172.21.15.70:0/973236809 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8244003b80 con 0x562a106d8b80 2024-09-13T16:02:47.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.562+0000 7f8241600640 1 -- 172.21.15.70:0/973236809 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8244003ce0 con 0x562a106d8b80 2024-09-13T16:02:47.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.562+0000 7f8241600640 1 -- 172.21.15.70:0/973236809 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824400eb20 con 0x562a106d8b80 2024-09-13T16:02:47.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.563+0000 7f82567d7740 1 -- 172.21.15.70:0/973236809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106d8b80 msgr2=0x562a106ff0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:47.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.563+0000 7f82567d7740 1 --2- 172.21.15.70:0/973236809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106d8b80 0x562a106ff0e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8244001d10 tx=0x7f82440021d0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.563+0000 7f82567d7740 1 -- 172.21.15.70:0/973236809 shutdown_connections 2024-09-13T16:02:47.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.563+0000 7f82567d7740 1 --2- 172.21.15.70:0/973236809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106d8b80 0x562a106ff0e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.563+0000 7f82567d7740 1 --2- 172.21.15.70:0/973236809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106aee90 0x562a106feba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.563+0000 7f82567d7740 1 --2- 172.21.15.70:0/973236809 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106b16d0 0x562a106b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.563+0000 7f82567d7740 1 -- 172.21.15.70:0/973236809 >> 172.21.15.70:0/973236809 conn(0x562a106ade00 msgr2=0x562a106f62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:47.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.563+0000 7f82567d7740 1 -- 172.21.15.70:0/973236809 shutdown_connections 2024-09-13T16:02:47.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.563+0000 7f82567d7740 1 -- 172.21.15.70:0/973236809 wait complete. 2024-09-13T16:02:47.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.564+0000 7f82567d7740 1 -- start start 2024-09-13T16:02:47.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.564+0000 7f82567d7740 1 Processor -- start 2024-09-13T16:02:47.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.565+0000 7f82567d7740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106b16d0 0x562a106d8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.565+0000 7f82567d7740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106d8b80 0x562a106f3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.565+0000 7f82567d7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106c3530 0x562a106da690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.565+0000 7f82567d7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a105b5260 con 0x562a106c3530 2024-09-13T16:02:47.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.565+0000 7f82567d7740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a105b4f00 con 0x562a106b16d0 2024-09-13T16:02:47.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.565+0000 7f82567d7740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a1037af20 con 0x562a106d8b80 2024-09-13T16:02:47.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.565+0000 7f82567d7740 10 client.0 _ll_register_callbacks cb 0x562a1060d1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:02:47.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.565+0000 7f8251800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106c3530 0x562a106da690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:47.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.565+0000 7f8251800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106c3530 0x562a106da690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36916/0 (socket says 172.21.15.70:36916) 2024-09-13T16:02:47.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.565+0000 7f8251800640 1 -- 172.21.15.70:0/2320265443 learned_addr learned my addr 172.21.15.70:0/2320265443 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:47.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.565+0000 7f8243e00640 1 --2- 172.21.15.70:0/2320265443 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106d8b80 0x562a106f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:47.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.565+0000 7f8250e00640 1 --2- 172.21.15.70:0/2320265443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106b16d0 0x562a106d8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:47.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.566+0000 7f8251800640 1 -- 172.21.15.70:0/2320265443 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106d8b80 msgr2=0x562a106f3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:47.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.566+0000 7f8251800640 1 --2- 172.21.15.70:0/2320265443 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106d8b80 0x562a106f3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.566+0000 7f8251800640 1 -- 172.21.15.70:0/2320265443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106b16d0 msgr2=0x562a106d8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:47.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.566+0000 7f8251800640 1 --2- 172.21.15.70:0/2320265443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106b16d0 0x562a106d8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.566+0000 7f8251800640 1 -- 172.21.15.70:0/2320265443 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824400f040 con 0x562a106c3530 2024-09-13T16:02:47.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.566+0000 7f8251800640 1 --2- 172.21.15.70:0/2320265443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106c3530 0x562a106da690 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f82440012e0 tx=0x7f8244001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63201f799765f38b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:47.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.566+0000 7f823a000640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-13T16:02:47.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.566+0000 7f823a000640 1 -- 172.21.15.70:0/2320265443 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824400eee0 con 0x562a106c3530 2024-09-13T16:02:47.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.566+0000 7f823a000640 1 -- 172.21.15.70:0/2320265443 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f82440050d0 con 0x562a106c3530 2024-09-13T16:02:47.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.566+0000 7f82567d7740 1 -- 172.21.15.70:0/2320265443 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a1063dcd0 con 0x562a106c3530 2024-09-13T16:02:47.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.566+0000 7f823a000640 1 -- 172.21.15.70:0/2320265443 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8244005290 con 0x562a106c3530 2024-09-13T16:02:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.566+0000 7f82567d7740 10 client.5388 fetch_fsmap learned FSMap version 22 2024-09-13T16:02:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.567+0000 7f82567d7740 1 -- 172.21.15.70:0/2320265443 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x562a106121b0 con 0x562a106c3530 2024-09-13T16:02:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.567+0000 7f823a000640 1 -- 172.21.15.70:0/2320265443 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a1063dcd0 con 0x562a106c3530 2024-09-13T16:02:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.567+0000 7f823a000640 1 -- 172.21.15.70:0/2320265443 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 22) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f82440053f0 con 0x562a106c3530 2024-09-13T16:02:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.567+0000 7f82567d7740 10 client.5388 fetch_fsmap finished waiting for FSMap version 22 2024-09-13T16:02:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.567+0000 7f82567d7740 10 client.5388 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T16:02:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.567+0000 7f82567d7740 20 client.5388 populate_metadata read hostname 'smithi070' 2024-09-13T16:02:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.567+0000 7f82567d7740 1 --2- 172.21.15.70:0/2320265443 >> [v2:172.21.15.107:6833/2709979655,v1:172.21.15.107:6835/2709979655] conn(0x562a106c56f0 0x562a106c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.567+0000 7f82567d7740 4 client.5388 mds_command: new command op to 5124 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:02:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.567+0000 7f82567d7740 1 -- 172.21.15.70:0/2320265443 --> [v2:172.21.15.107:6833/2709979655,v1:172.21.15.107:6835/2709979655] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a103073c0 con 0x562a106c56f0 2024-09-13T16:02:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.568+0000 7f8250e00640 1 --2- 172.21.15.70:0/2320265443 >> [v2:172.21.15.107:6833/2709979655,v1:172.21.15.107:6835/2709979655] conn(0x562a106c56f0 0x562a106c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.568+0000 7f8250e00640 1 --2- 172.21.15.70:0/2320265443 >> [v2:172.21.15.107:6833/2709979655,v1:172.21.15.107:6835/2709979655] conn(0x562a106c56f0 0x562a106c6280 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ee514e607ec1a9a server_cookie=e16a6f281fa952eb in_seq=0 out_seq=0 2024-09-13T16:02:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.568+0000 7f823a000640 10 client.5388 ms_handle_connect on v2:172.21.15.107:6833/2709979655 2024-09-13T16:02:47.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.569+0000 7f823a000640 1 -- 172.21.15.70:0/2320265443 <== mds.0 v2:172.21.15.107:6833/2709979655 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562a103073c0 con 0x562a106c56f0 2024-09-13T16:02:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.569+0000 7f823a000640 10 client.5388 handle_command_reply: tid=0 2024-09-13T16:02:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.569+0000 7f82567d7740 1 client.5388 shutdown 2024-09-13T16:02:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.569+0000 7f82567d7740 1 -- 172.21.15.70:0/2320265443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106c3530 msgr2=0x562a106da690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.569+0000 7f82567d7740 1 --2- 172.21.15.70:0/2320265443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106c3530 0x562a106da690 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f82440012e0 tx=0x7f8244001250 comp rx=0 tx=0).stop 2024-09-13T16:02:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.570+0000 7f82567d7740 1 -- 172.21.15.70:0/2320265443 shutdown_connections 2024-09-13T16:02:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.570+0000 7f82567d7740 1 --2- 172.21.15.70:0/2320265443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106c3530 0x562a106da690 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.570+0000 7f82567d7740 1 --2- 172.21.15.70:0/2320265443 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106d8b80 0x562a106f3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.570+0000 7f82567d7740 1 --2- 172.21.15.70:0/2320265443 >> [v2:172.21.15.107:6833/2709979655,v1:172.21.15.107:6835/2709979655] conn(0x562a106c56f0 0x562a106c6280 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.570+0000 7f82567d7740 1 --2- 172.21.15.70:0/2320265443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106b16d0 0x562a106d8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.570+0000 7f82567d7740 1 -- 172.21.15.70:0/2320265443 >> 172.21.15.70:0/2320265443 conn(0x562a106aee90 msgr2=0x562a106f45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.570+0000 7f823a000640 0 client.5388 ms_handle_reset on v2:172.21.15.107:6833/2709979655 2024-09-13T16:02:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.570+0000 7f82567d7740 1 -- 172.21.15.70:0/2320265443 shutdown_connections 2024-09-13T16:02:47.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.570+0000 7f82567d7740 1 -- 172.21.15.70:0/2320265443 wait complete. 2024-09-13T16:02:47.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.570+0000 7f82567d7740 20 client.5388 trim_cache size 0 max 16384 2024-09-13T16:02:47.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.585+0000 7f82567d7740 1 Processor -- start 2024-09-13T16:02:47.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.585+0000 7f82567d7740 1 -- start start 2024-09-13T16:02:47.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.586+0000 7f82567d7740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106b16d0 0x562a106d6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.586+0000 7f82567d7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106c3530 0x562a106d7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.586+0000 7f82567d7740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106d8b80 0x562a106b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.586+0000 7f82567d7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a106f3710 con 0x562a106c3530 2024-09-13T16:02:47.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.586+0000 7f82567d7740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a107084a0 con 0x562a106d8b80 2024-09-13T16:02:47.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.586+0000 7f82567d7740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a10718bd0 con 0x562a106b16d0 2024-09-13T16:02:47.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.586+0000 7f8243e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106c3530 0x562a106d7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:47.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.586+0000 7f8243e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106c3530 0x562a106d7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36920/0 (socket says 172.21.15.70:36920) 2024-09-13T16:02:47.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.586+0000 7f8243e00640 1 -- 172.21.15.70:0/3465169343 learned_addr learned my addr 172.21.15.70:0/3465169343 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:47.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.587+0000 7f8250e00640 1 --2- 172.21.15.70:0/3465169343 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106b16d0 0x562a106d6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:47.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.587+0000 7f8251800640 1 --2- 172.21.15.70:0/3465169343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106d8b80 0x562a106b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:47.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.587+0000 7f8243e00640 1 -- 172.21.15.70:0/3465169343 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106b16d0 msgr2=0x562a106d6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:47.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.587+0000 7f8243e00640 1 --2- 172.21.15.70:0/3465169343 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106b16d0 0x562a106d6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.587+0000 7f8243e00640 1 -- 172.21.15.70:0/3465169343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106d8b80 msgr2=0x562a106b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:47.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.587+0000 7f8243e00640 1 --2- 172.21.15.70:0/3465169343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106d8b80 0x562a106b03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.587+0000 7f8243e00640 1 -- 172.21.15.70:0/3465169343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a10647170 con 0x562a106c3530 2024-09-13T16:02:47.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.587+0000 7f8251800640 1 --2- 172.21.15.70:0/3465169343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106d8b80 0x562a106b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:47.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.587+0000 7f8243e00640 1 --2- 172.21.15.70:0/3465169343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106c3530 0x562a106d7160 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f82340090b0 tx=0x7f8234030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2624cd3edbaaf9fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:47.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.587+0000 7f8242000640 1 -- 172.21.15.70:0/3465169343 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823403d840 con 0x562a106c3530 2024-09-13T16:02:47.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.587+0000 7f8242000640 1 -- 172.21.15.70:0/3465169343 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8234041070 con 0x562a106c3530 2024-09-13T16:02:47.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.587+0000 7f8242000640 1 -- 172.21.15.70:0/3465169343 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823403dba0 con 0x562a106c3530 2024-09-13T16:02:47.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.588+0000 7f82567d7740 1 -- 172.21.15.70:0/3465169343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106c3530 msgr2=0x562a106d7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:47.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.588+0000 7f82567d7740 1 --2- 172.21.15.70:0/3465169343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106c3530 0x562a106d7160 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f82340090b0 tx=0x7f8234030000 comp rx=0 tx=0).stop 2024-09-13T16:02:47.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.588+0000 7f82567d7740 1 -- 172.21.15.70:0/3465169343 shutdown_connections 2024-09-13T16:02:47.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.588+0000 7f82567d7740 1 --2- 172.21.15.70:0/3465169343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106d8b80 0x562a106b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.588+0000 7f82567d7740 1 --2- 172.21.15.70:0/3465169343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106c3530 0x562a106d7160 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.588+0000 7f82567d7740 1 --2- 172.21.15.70:0/3465169343 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106b16d0 0x562a106d6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.588+0000 7f82567d7740 1 -- 172.21.15.70:0/3465169343 >> 172.21.15.70:0/3465169343 conn(0x562a106aee90 msgr2=0x562a106f9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:47.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.588+0000 7f82567d7740 1 -- 172.21.15.70:0/3465169343 shutdown_connections 2024-09-13T16:02:47.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.588+0000 7f82567d7740 1 -- 172.21.15.70:0/3465169343 wait complete. 2024-09-13T16:02:47.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.589+0000 7f82567d7740 1 -- start start 2024-09-13T16:02:47.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.589+0000 7f82567d7740 1 Processor -- start 2024-09-13T16:02:47.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.590+0000 7f82567d7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106b16d0 0x562a107494b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.590+0000 7f82567d7740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106c3530 0x562a1070f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.590+0000 7f82567d7740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106d8b80 0x562a106d9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.590+0000 7f82567d7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a107614e0 con 0x562a106b16d0 2024-09-13T16:02:47.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.590+0000 7f82567d7740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a106c1420 con 0x562a106c3530 2024-09-13T16:02:47.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.590+0000 7f82567d7740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a106c2710 con 0x562a106d8b80 2024-09-13T16:02:47.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.590+0000 7f82567d7740 10 client.0 _ll_register_callbacks cb 0x7f8244017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:02:47.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.590+0000 7f8250e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106b16d0 0x562a107494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:47.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.590+0000 7f8250e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106b16d0 0x562a107494b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36936/0 (socket says 172.21.15.70:36936) 2024-09-13T16:02:47.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.590+0000 7f8250e00640 1 -- 172.21.15.70:0/3411555553 learned_addr learned my addr 172.21.15.70:0/3411555553 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:47.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.590+0000 7f8250e00640 1 -- 172.21.15.70:0/3411555553 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106d8b80 msgr2=0x562a106d9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:47.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.590+0000 7f8250e00640 1 --2- 172.21.15.70:0/3411555553 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106d8b80 0x562a106d9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.590+0000 7f8250e00640 1 -- 172.21.15.70:0/3411555553 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106c3530 msgr2=0x562a1070f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:47.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.590+0000 7f8250e00640 1 --2- 172.21.15.70:0/3411555553 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106c3530 0x562a1070f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.590+0000 7f8250e00640 1 -- 172.21.15.70:0/3411555553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824c070cc0 con 0x562a106b16d0 2024-09-13T16:02:47.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.591+0000 7f8250e00640 1 --2- 172.21.15.70:0/3411555553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106b16d0 0x562a107494b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f823c00dfb0 tx=0x7f823c00b1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0813d4d87bd12bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:47.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.591+0000 7f823a000640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-13T16:02:47.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.591+0000 7f823a000640 1 -- 172.21.15.70:0/3411555553 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c054d40 con 0x562a106b16d0 2024-09-13T16:02:47.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.591+0000 7f823a000640 1 -- 172.21.15.70:0/3411555553 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f823c054ea0 con 0x562a106b16d0 2024-09-13T16:02:47.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.591+0000 7f82567d7740 1 -- 172.21.15.70:0/3411555553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8244003ce0 con 0x562a106b16d0 2024-09-13T16:02:47.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.591+0000 7f823a000640 1 -- 172.21.15.70:0/3411555553 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f823c05c0c0 con 0x562a106b16d0 2024-09-13T16:02:47.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.591+0000 7f82567d7740 10 client.5394 fetch_fsmap learned FSMap version 22 2024-09-13T16:02:47.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.591+0000 7f82567d7740 1 -- 172.21.15.70:0/3411555553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x562a105b4470 con 0x562a106b16d0 2024-09-13T16:02:47.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.591+0000 7f823a000640 1 -- 172.21.15.70:0/3411555553 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8244003ce0 con 0x562a106b16d0 2024-09-13T16:02:47.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.591+0000 7f823a000640 1 -- 172.21.15.70:0/3411555553 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 22) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f823c060590 con 0x562a106b16d0 2024-09-13T16:02:47.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.591+0000 7f82567d7740 10 client.5394 fetch_fsmap finished waiting for FSMap version 22 2024-09-13T16:02:47.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.591+0000 7f82567d7740 10 client.5394 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T16:02:47.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.591+0000 7f82567d7740 20 client.5394 populate_metadata read hostname 'smithi070' 2024-09-13T16:02:47.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.591+0000 7f82567d7740 1 --2- 172.21.15.70:0/3411555553 >> [v2:172.21.15.107:6833/2709979655,v1:172.21.15.107:6835/2709979655] conn(0x562a10760560 0x562a10760960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:47.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.591+0000 7f82567d7740 4 client.5394 mds_command: new command op to 5124 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T16:02:47.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.591+0000 7f82567d7740 1 -- 172.21.15.70:0/3411555553 --> [v2:172.21.15.107:6833/2709979655,v1:172.21.15.107:6835/2709979655] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562a103186c0 con 0x562a10760560 2024-09-13T16:02:47.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.592+0000 7f8243e00640 1 --2- 172.21.15.70:0/3411555553 >> [v2:172.21.15.107:6833/2709979655,v1:172.21.15.107:6835/2709979655] conn(0x562a10760560 0x562a10760960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:47.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.592+0000 7f823a000640 10 client.5394 ms_handle_connect on v2:172.21.15.107:6833/2709979655 2024-09-13T16:02:47.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.592+0000 7f8243e00640 1 --2- 172.21.15.70:0/3411555553 >> [v2:172.21.15.107:6833/2709979655,v1:172.21.15.107:6835/2709979655] conn(0x562a10760560 0x562a10760960 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=744f7adf4adba2a8 server_cookie=235394947b3197f6 in_seq=0 out_seq=0 2024-09-13T16:02:47.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.593+0000 7f823a000640 1 -- 172.21.15.70:0/3411555553 <== mds.0 v2:172.21.15.107:6833/2709979655 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x562a103186c0 con 0x562a10760560 2024-09-13T16:02:47.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.593+0000 7f823a000640 10 client.5394 handle_command_reply: tid=0 2024-09-13T16:02:47.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.593+0000 7f82567d7740 1 client.5394 shutdown 2024-09-13T16:02:47.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.593+0000 7f82567d7740 1 -- 172.21.15.70:0/3411555553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106b16d0 msgr2=0x562a107494b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:47.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.593+0000 7f82567d7740 1 --2- 172.21.15.70:0/3411555553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106b16d0 0x562a107494b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f823c00dfb0 tx=0x7f823c00b1e0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.593+0000 7f82567d7740 1 -- 172.21.15.70:0/3411555553 shutdown_connections 2024-09-13T16:02:47.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.593+0000 7f82567d7740 1 --2- 172.21.15.70:0/3411555553 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x562a106d8b80 0x562a106d9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.593+0000 7f82567d7740 1 --2- 172.21.15.70:0/3411555553 >> [v2:172.21.15.107:6833/2709979655,v1:172.21.15.107:6835/2709979655] conn(0x562a10760560 0x562a10760960 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.593+0000 7f82567d7740 1 --2- 172.21.15.70:0/3411555553 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a106c3530 0x562a1070f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.593+0000 7f82567d7740 1 --2- 172.21.15.70:0/3411555553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a106b16d0 0x562a107494b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.593+0000 7f823a000640 0 client.5394 ms_handle_reset on v2:172.21.15.107:6833/2709979655 2024-09-13T16:02:47.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.593+0000 7f82567d7740 1 -- 172.21.15.70:0/3411555553 >> 172.21.15.70:0/3411555553 conn(0x562a106aee90 msgr2=0x562a106d6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:47.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.593+0000 7f82567d7740 1 -- 172.21.15.70:0/3411555553 shutdown_connections 2024-09-13T16:02:47.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.593+0000 7f82567d7740 1 -- 172.21.15.70:0/3411555553 wait complete. 2024-09-13T16:02:47.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.593+0000 7f82567d7740 20 client.5394 trim_cache size 0 max 16384 2024-09-13T16:02:47.599 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-13T16:02:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "f906ab4b-6171-41ec-a825-cd0f700d3930", 2024-09-13T16:02:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-09-13T16:02:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 5124, 2024-09-13T16:02:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-13T16:02:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-13T16:02:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-13T16:02:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 6.4159508880000002, 2024-09-13T16:02:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 22, 2024-09-13T16:02:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 35, 2024-09-13T16:02:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 35, 2024-09-13T16:02:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 38.036253721000001 2024-09-13T16:02:47.600 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-13T16:02:47.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.594+0000 7f8253800640 1 -- 172.21.15.70:0/3236289854 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f822806ac00 msgr2=0x7f822806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:47.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.594+0000 7f8253800640 1 --2- 172.21.15.70:0/3236289854 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f822806ac00 0x7f822806d0c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8234035000 tx=0x7f8234008030 comp rx=0 tx=0).stop 2024-09-13T16:02:47.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.594+0000 7f8253800640 1 -- 172.21.15.70:0/3236289854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f824c070540 msgr2=0x7f824c14fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:47.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.594+0000 7f8253800640 1 --2- 172.21.15.70:0/3236289854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f824c070540 0x7f824c14fae0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f823c00d5f0 tx=0x7f823c00dab0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.594+0000 7f8253800640 1 -- 172.21.15.70:0/3236289854 shutdown_connections 2024-09-13T16:02:47.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.594+0000 7f8253800640 1 --2- 172.21.15.70:0/3236289854 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f822806ac00 0x7f822806d0c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.594+0000 7f8253800640 1 --2- 172.21.15.70:0/3236289854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f824c159610 0x7f824c0b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.594+0000 7f8253800640 1 --2- 172.21.15.70:0/3236289854 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f824c0b35c0 0x7f824c1e34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.594+0000 7f8253800640 1 --2- 172.21.15.70:0/3236289854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f824c070540 0x7f824c14fae0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:47.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.594+0000 7f8253800640 1 -- 172.21.15.70:0/3236289854 >> 172.21.15.70:0/3236289854 conn(0x7f824c0b0510 msgr2=0x7f824c157190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:47.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.594+0000 7f8253800640 1 -- 172.21.15.70:0/3236289854 shutdown_connections 2024-09-13T16:02:47.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:47.594+0000 7f8253800640 1 -- 172.21.15.70:0/3236289854 wait complete. 2024-09-13T16:02:47.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:47.611 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%a /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2024-09-13T16:02:47.647 INFO:teuthology.orchestra.run.smithi070.stdout:600 2024-09-13T16:02:47.648 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T16:02:47.648 DEBUG:teuthology.orchestra.run.smithi070:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T16:02:47.771 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T16:02:47.876 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T16:02:47.877 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:02:47.877 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:02:47.912 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:02:47.912 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:02:47.988 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:02:48.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.178+0000 7f6a05a00640 1 Processor -- start 2024-09-13T16:02:48.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.178+0000 7f6a05a00640 1 -- start start 2024-09-13T16:02:48.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.179+0000 7f6a05a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a000b1e40 0x7f6a00159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:48.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.179+0000 7f6a05a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6a000b32d0 0x7f6a00070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:48.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.179+0000 7f6a05a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a0015a430 con 0x7f6a000b2220 2024-09-13T16:02:48.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.179+0000 7f6a05a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a001598b0 con 0x7f6a000b32d0 2024-09-13T16:02:48.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.179+0000 7f6a05a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a00159b90 con 0x7f6a000b1e40 2024-09-13T16:02:48.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.180+0000 7f69fea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a000b1e40 0x7f6a00159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:48.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.180+0000 7f69fea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a000b1e40 0x7f6a00159210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:38610/0 (socket says 172.21.15.70:38610) 2024-09-13T16:02:48.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.180+0000 7f69fea00640 1 -- 172.21.15.70:0/1509421125 learned_addr learned my addr 172.21.15.70:0/1509421125 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:48.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.180+0000 7f69ff400640 1 --2- 172.21.15.70:0/1509421125 >> v2:172.21.15.107:3300/0 conn(0x7f6a000b32d0 0x7f6a00070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:48.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.180+0000 7f69fea00640 1 -- 172.21.15.70:0/1509421125 >> v2:172.21.15.107:3300/0 conn(0x7f6a000b32d0 msgr2=0x7f6a00070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:48.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.180+0000 7f69fea00640 1 --2- 172.21.15.70:0/1509421125 >> v2:172.21.15.107:3300/0 conn(0x7f6a000b32d0 0x7f6a00070720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.180+0000 7f69fea00640 1 -- 172.21.15.70:0/1509421125 >> v1:172.21.15.107:6789/0 conn(0x7f6a000b2220 legacy=0x7f6a000b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:48.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.180+0000 7f69fea00640 1 -- 172.21.15.70:0/1509421125 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a00159e70 con 0x7f6a000b1e40 2024-09-13T16:02:48.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.180+0000 7f69fd600640 1 -- 172.21.15.70:0/1509421125 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132344718 0 0) 0x7f6a0015a430 con 0x7f6a000b2220 2024-09-13T16:02:48.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.181+0000 7f69fea00640 1 --2- 172.21.15.70:0/1509421125 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a000b1e40 0x7f6a00159210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f69f0009870 tx=0x7f69f002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7ad86a7241410a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:48.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.182+0000 7f69fd600640 1 -- 172.21.15.70:0/1509421125 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f0032440 con 0x7f6a000b1e40 2024-09-13T16:02:48.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.182+0000 7f69fd600640 1 -- 172.21.15.70:0/1509421125 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f00325a0 con 0x7f6a000b1e40 2024-09-13T16:02:48.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.182+0000 7f69fd600640 1 -- 172.21.15.70:0/1509421125 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f0032930 con 0x7f6a000b1e40 2024-09-13T16:02:48.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.182+0000 7f6a05a00640 1 -- 172.21.15.70:0/1509421125 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a000b1e40 msgr2=0x7f6a00159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:48.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.182+0000 7f6a05a00640 1 --2- 172.21.15.70:0/1509421125 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a000b1e40 0x7f6a00159210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f69f0009870 tx=0x7f69f002a1c0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.182+0000 7f6a05a00640 1 -- 172.21.15.70:0/1509421125 shutdown_connections 2024-09-13T16:02:48.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.182+0000 7f6a05a00640 1 --2- 172.21.15.70:0/1509421125 >> v2:172.21.15.107:3300/0 conn(0x7f6a000b32d0 0x7f6a00070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.182+0000 7f6a05a00640 1 --2- 172.21.15.70:0/1509421125 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a000b1e40 0x7f6a00159210 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.182+0000 7f6a05a00640 1 -- 172.21.15.70:0/1509421125 >> 172.21.15.70:0/1509421125 conn(0x7f6a000b0510 msgr2=0x7f6a000b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:48.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.182+0000 7f6a05a00640 1 -- 172.21.15.70:0/1509421125 shutdown_connections 2024-09-13T16:02:48.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.182+0000 7f6a05a00640 1 -- 172.21.15.70:0/1509421125 wait complete. 2024-09-13T16:02:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.184+0000 7f6a05a00640 1 Processor -- start 2024-09-13T16:02:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.184+0000 7f6a05a00640 1 -- start start 2024-09-13T16:02:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.185+0000 7f6a05a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a000b1e40 0x7f6a001f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.185+0000 7f6a05a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a000b2220 0x7f6a001f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.185+0000 7f6a05a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a000b32d0 0x7f6a00136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.185+0000 7f6a05a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a001f6900 con 0x7f6a000b32d0 2024-09-13T16:02:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.185+0000 7f6a05a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a001f6340 con 0x7f6a000b1e40 2024-09-13T16:02:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.185+0000 7f6a05a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a001f6620 con 0x7f6a000b2220 2024-09-13T16:02:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.185+0000 7f69ff400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a000b32d0 0x7f6a00136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.185+0000 7f69ff400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a000b32d0 0x7f6a00136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36944/0 (socket says 172.21.15.70:36944) 2024-09-13T16:02:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.185+0000 7f69ff400640 1 -- 172.21.15.70:0/2516756314 learned_addr learned my addr 172.21.15.70:0/2516756314 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.186+0000 7f69fea00640 1 --2- 172.21.15.70:0/2516756314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a000b1e40 0x7f6a001f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.186+0000 7f69fe000640 1 --2- 172.21.15.70:0/2516756314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a000b2220 0x7f6a001f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.186+0000 7f69ff400640 1 -- 172.21.15.70:0/2516756314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a000b2220 msgr2=0x7f6a001f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.186+0000 7f69ff400640 1 --2- 172.21.15.70:0/2516756314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a000b2220 0x7f6a001f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.186+0000 7f69ff400640 1 -- 172.21.15.70:0/2516756314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a000b1e40 msgr2=0x7f6a001f1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.186+0000 7f69ff400640 1 --2- 172.21.15.70:0/2516756314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a000b1e40 0x7f6a001f1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.186+0000 7f69ff400640 1 -- 172.21.15.70:0/2516756314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f00094d0 con 0x7f6a000b32d0 2024-09-13T16:02:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.186+0000 7f69fea00640 1 --2- 172.21.15.70:0/2516756314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a000b1e40 0x7f6a001f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.186+0000 7f69ff400640 1 --2- 172.21.15.70:0/2516756314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a000b32d0 0x7f6a00136aa0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f69f800efc0 tx=0x7f69f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.186+0000 7f69f6a00640 1 -- 172.21.15.70:0/2516756314 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f8009ba0 con 0x7f6a000b32d0 2024-09-13T16:02:48.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.186+0000 7f69f6a00640 1 -- 172.21.15.70:0/2516756314 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f800f040 con 0x7f6a000b32d0 2024-09-13T16:02:48.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.186+0000 7f69f6a00640 1 -- 172.21.15.70:0/2516756314 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f80146c0 con 0x7f6a000b32d0 2024-09-13T16:02:48.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.187+0000 7f6a05a00640 1 -- 172.21.15.70:0/2516756314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a000b2960 con 0x7f6a000b32d0 2024-09-13T16:02:48.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.187+0000 7f6a05a00640 1 -- 172.21.15.70:0/2516756314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a001365a0 con 0x7f6a000b32d0 2024-09-13T16:02:48.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.188+0000 7f6a05a00640 1 -- 172.21.15.70:0/2516756314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a000adc90 con 0x7f6a000b32d0 2024-09-13T16:02:48.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.189+0000 7f69f6a00640 1 -- 172.21.15.70:0/2516756314 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f69f8014820 con 0x7f6a000b32d0 2024-09-13T16:02:48.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.189+0000 7f69f6a00640 1 --2- 172.21.15.70:0/2516756314 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f69e006ac00 0x7f69e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:48.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.190+0000 7f69f6a00640 1 -- 172.21.15.70:0/2516756314 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f69f808a1f0 con 0x7f6a000b32d0 2024-09-13T16:02:48.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.190+0000 7f69fea00640 1 --2- 172.21.15.70:0/2516756314 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f69e006ac00 0x7f69e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:48.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.190+0000 7f69fea00640 1 --2- 172.21.15.70:0/2516756314 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f69e006ac00 0x7f69e006d0c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f69f0034000 tx=0x7f69f002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:48.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.194+0000 7f69f6a00640 1 -- 172.21.15.70:0/2516756314 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f69f8055360 con 0x7f6a000b32d0 2024-09-13T16:02:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.363+0000 7f6a05a00640 1 -- 172.21.15.70:0/2516756314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a00159210 con 0x7f6a000b32d0 2024-09-13T16:02:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.364+0000 7f69f6a00640 1 -- 172.21.15.70:0/2516756314 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16662 (secure 0 0 0) 0x7f69f8058980 con 0x7f6a000b32d0 2024-09-13T16:02:48.367 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:48.367 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":35,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:02:41.168027+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:02:15.044503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T16:02:15.981176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6837/3554365995":"2024-09-14T16:02:41.167987+0000","172.21.15.70:6835/3554365995":"2024-09-14T16:02:41.167987+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:02:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.366+0000 7f6a05a00640 1 -- 172.21.15.70:0/2516756314 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f69e006ac00 msgr2=0x7f69e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.366+0000 7f6a05a00640 1 --2- 172.21.15.70:0/2516756314 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f69e006ac00 0x7f69e006d0c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f69f0034000 tx=0x7f69f002e000 comp rx=0 tx=0).stop 2024-09-13T16:02:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.366+0000 7f6a05a00640 1 -- 172.21.15.70:0/2516756314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a000b32d0 msgr2=0x7f6a00136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.366+0000 7f6a05a00640 1 --2- 172.21.15.70:0/2516756314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a000b32d0 0x7f6a00136aa0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f69f800efc0 tx=0x7f69f800c490 comp rx=0 tx=0).stop 2024-09-13T16:02:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.366+0000 7f6a05a00640 1 -- 172.21.15.70:0/2516756314 shutdown_connections 2024-09-13T16:02:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.366+0000 7f6a05a00640 1 --2- 172.21.15.70:0/2516756314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a000b32d0 0x7f6a00136aa0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.367+0000 7f6a05a00640 1 --2- 172.21.15.70:0/2516756314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a000b2220 0x7f6a001f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.367+0000 7f6a05a00640 1 --2- 172.21.15.70:0/2516756314 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f69e006ac00 0x7f69e006d0c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.367+0000 7f6a05a00640 1 --2- 172.21.15.70:0/2516756314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a000b1e40 0x7f6a001f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.367+0000 7f6a05a00640 1 -- 172.21.15.70:0/2516756314 >> 172.21.15.70:0/2516756314 conn(0x7f6a000b0510 msgr2=0x7f6a000ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.367+0000 7f6a05a00640 1 -- 172.21.15.70:0/2516756314 shutdown_connections 2024-09-13T16:02:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.367+0000 7f6a05a00640 1 -- 172.21.15.70:0/2516756314 wait complete. 2024-09-13T16:02:48.385 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:01:06.070694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:02:15.044503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:02:15.981176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:02:48.385 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:02:48.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.538+0000 7fedc0600640 1 Processor -- start 2024-09-13T16:02:48.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.538+0000 7fedc0600640 1 -- start start 2024-09-13T16:02:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.539+0000 7fedc0600640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fedb80cafa0 0x7fedb815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.539+0000 7fedc0600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb806f5f0 con 0x7fedb8071690 2024-09-13T16:02:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.539+0000 7fedc0600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb8070450 con 0x7fedb8156f60 2024-09-13T16:02:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.539+0000 7fedc0600640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb815aa30 con 0x7fedb80cafa0 2024-09-13T16:02:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.539+0000 7fedbe600640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fedb80cafa0 0x7fedb815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.539+0000 7fedbd200640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fedb8071690 0x7fedb80cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:57302/0 (socket says 172.21.15.70:57302) 2024-09-13T16:02:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.539+0000 7fedbd200640 1 -- 172.21.15.70:0/1100363203 learned_addr learned my addr 172.21.15.70:0/1100363203 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.540+0000 7fedbe600640 1 -- 172.21.15.70:0/1100363203 >> v1:172.21.15.107:6789/0 conn(0x7fedb8156f60 legacy=0x7fedb8070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.540+0000 7fedbe600640 1 -- 172.21.15.70:0/1100363203 >> v1:172.21.15.70:6789/0 conn(0x7fedb8071690 legacy=0x7fedb80cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.540+0000 7fedbe600640 1 -- 172.21.15.70:0/1100363203 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb806f840 con 0x7fedb80cafa0 2024-09-13T16:02:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.540+0000 7fedb7e00640 1 -- 172.21.15.70:0/1100363203 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277957092 0 0) 0x7fedb806f5f0 con 0x7fedb8071690 2024-09-13T16:02:48.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.541+0000 7fedbe600640 1 --2- 172.21.15.70:0/1100363203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedb80cafa0 0x7fedb815a4f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009d90 tx=0x7fedb002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db11620d3836b19a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:48.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.541+0000 7fedb7e00640 1 -- 172.21.15.70:0/1100363203 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0007740 con 0x7fedb80cafa0 2024-09-13T16:02:48.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.541+0000 7fedb7e00640 1 -- 172.21.15.70:0/1100363203 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb002d050 con 0x7fedb80cafa0 2024-09-13T16:02:48.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.541+0000 7fedb7e00640 1 -- 172.21.15.70:0/1100363203 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0007ac0 con 0x7fedb80cafa0 2024-09-13T16:02:48.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.542+0000 7fedc0600640 1 -- 172.21.15.70:0/1100363203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedb80cafa0 msgr2=0x7fedb815a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:48.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.542+0000 7fedc0600640 1 --2- 172.21.15.70:0/1100363203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedb80cafa0 0x7fedb815a4f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009d90 tx=0x7fedb002a6f0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.542+0000 7fedc0600640 1 -- 172.21.15.70:0/1100363203 shutdown_connections 2024-09-13T16:02:48.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.542+0000 7fedc0600640 1 --2- 172.21.15.70:0/1100363203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedb80cafa0 0x7fedb815a4f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.542+0000 7fedc0600640 1 -- 172.21.15.70:0/1100363203 >> 172.21.15.70:0/1100363203 conn(0x7fedb80b0580 msgr2=0x7fedb80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:48.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.542+0000 7fedc0600640 1 -- 172.21.15.70:0/1100363203 shutdown_connections 2024-09-13T16:02:48.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.542+0000 7fedc0600640 1 -- 172.21.15.70:0/1100363203 wait complete. 2024-09-13T16:02:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.543+0000 7fedc0600640 1 Processor -- start 2024-09-13T16:02:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.543+0000 7fedc0600640 1 -- start start 2024-09-13T16:02:48.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.544+0000 7fedc0600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedb8071690 0x7fedb81400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:48.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.544+0000 7fedc0600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedb80cafa0 0x7fedb8150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:48.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.544+0000 7fedc0600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedb8156f60 0x7fedb80b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:48.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.544+0000 7fedc0600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb815c4d0 con 0x7fedb8071690 2024-09-13T16:02:48.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.544+0000 7fedc0600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb81405f0 con 0x7fedb80cafa0 2024-09-13T16:02:48.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.544+0000 7fedc0600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb814df40 con 0x7fedb8156f60 2024-09-13T16:02:48.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.545+0000 7fedbdc00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedb8071690 0x7fedb81400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:48.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.545+0000 7fedbdc00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedb8071690 0x7fedb81400b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36966/0 (socket says 172.21.15.70:36966) 2024-09-13T16:02:48.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.545+0000 7fedbdc00640 1 -- 172.21.15.70:0/3675428078 learned_addr learned my addr 172.21.15.70:0/3675428078 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:48.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.545+0000 7fedbd200640 1 --2- 172.21.15.70:0/3675428078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedb80cafa0 0x7fedb8150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:48.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.545+0000 7fedbe600640 1 --2- 172.21.15.70:0/3675428078 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedb8156f60 0x7fedb80b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:48.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.545+0000 7fedbdc00640 1 -- 172.21.15.70:0/3675428078 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedb8156f60 msgr2=0x7fedb80b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:48.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.545+0000 7fedbdc00640 1 --2- 172.21.15.70:0/3675428078 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedb8156f60 0x7fedb80b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.545+0000 7fedbdc00640 1 -- 172.21.15.70:0/3675428078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedb80cafa0 msgr2=0x7fedb8150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:48.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.545+0000 7fedbdc00640 1 --2- 172.21.15.70:0/3675428078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedb80cafa0 0x7fedb8150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.545+0000 7fedbdc00640 1 -- 172.21.15.70:0/3675428078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb0009a70 con 0x7fedb8071690 2024-09-13T16:02:48.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.545+0000 7fedbdc00640 1 --2- 172.21.15.70:0/3675428078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedb8071690 0x7fedb81400b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fedac00c400 tx=0x7fedac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:48.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.545+0000 7fedb5600640 1 -- 172.21.15.70:0/3675428078 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac0052d0 con 0x7fedb8071690 2024-09-13T16:02:48.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.545+0000 7fedb5600640 1 -- 172.21.15.70:0/3675428078 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac005430 con 0x7fedb8071690 2024-09-13T16:02:48.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.545+0000 7fedb5600640 1 -- 172.21.15.70:0/3675428078 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac003830 con 0x7fedb8071690 2024-09-13T16:02:48.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.545+0000 7fedc0600640 1 -- 172.21.15.70:0/3675428078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb814e220 con 0x7fedb8071690 2024-09-13T16:02:48.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.546+0000 7fedc0600640 1 -- 172.21.15.70:0/3675428078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb815ca70 con 0x7fedb8071690 2024-09-13T16:02:48.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.547+0000 7fedc0600640 1 -- 172.21.15.70:0/3675428078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb8157340 con 0x7fedb8071690 2024-09-13T16:02:48.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.547+0000 7fedb5600640 1 -- 172.21.15.70:0/3675428078 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fedac003990 con 0x7fedb8071690 2024-09-13T16:02:48.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.549+0000 7fedb5600640 1 --2- 172.21.15.70:0/3675428078 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fed9806ac00 0x7fed9806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:48.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.549+0000 7fedb5600640 1 -- 172.21.15.70:0/3675428078 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fedac088a00 con 0x7fedb8071690 2024-09-13T16:02:48.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.549+0000 7fedbd200640 1 --2- 172.21.15.70:0/3675428078 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fed9806ac00 0x7fed9806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:48.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.549+0000 7fedbd200640 1 --2- 172.21.15.70:0/3675428078 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fed9806ac00 0x7fed9806d0c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fedb80cddf0 tx=0x7feda4007b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:48.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.553+0000 7fedb5600640 1 -- 172.21.15.70:0/3675428078 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fedac053ae0 con 0x7fedb8071690 2024-09-13T16:02:48.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.722+0000 7fedc0600640 1 -- 172.21.15.70:0/3675428078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fedb80afe70 con 0x7fedb8071690 2024-09-13T16:02:48.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.723+0000 7fedb5600640 1 -- 172.21.15.70:0/3675428078 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedac0170a0 con 0x7fedb8071690 2024-09-13T16:02:48.725 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-13T16:02:48.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.725+0000 7fedc0600640 1 -- 172.21.15.70:0/3675428078 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fed9806ac00 msgr2=0x7fed9806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:48.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.725+0000 7fedc0600640 1 --2- 172.21.15.70:0/3675428078 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fed9806ac00 0x7fed9806d0c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fedb80cddf0 tx=0x7feda4007b90 comp rx=0 tx=0).stop 2024-09-13T16:02:48.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.725+0000 7fedc0600640 1 -- 172.21.15.70:0/3675428078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedb8071690 msgr2=0x7fedb81400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:48.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.725+0000 7fedc0600640 1 --2- 172.21.15.70:0/3675428078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedb8071690 0x7fedb81400b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fedac00c400 tx=0x7fedac00c8c0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.725+0000 7fedc0600640 1 -- 172.21.15.70:0/3675428078 shutdown_connections 2024-09-13T16:02:48.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.725+0000 7fedc0600640 1 --2- 172.21.15.70:0/3675428078 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedb8156f60 0x7fedb80b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.725+0000 7fedc0600640 1 --2- 172.21.15.70:0/3675428078 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fed9806ac00 0x7fed9806d0c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.725+0000 7fedc0600640 1 --2- 172.21.15.70:0/3675428078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedb80cafa0 0x7fedb8150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.725+0000 7fedc0600640 1 --2- 172.21.15.70:0/3675428078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedb8071690 0x7fedb81400b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.725+0000 7fedc0600640 1 -- 172.21.15.70:0/3675428078 >> 172.21.15.70:0/3675428078 conn(0x7fedb80b0580 msgr2=0x7fedb815a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:48.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.725+0000 7fedc0600640 1 -- 172.21.15.70:0/3675428078 shutdown_connections 2024-09-13T16:02:48.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.725+0000 7fedc0600640 1 -- 172.21.15.70:0/3675428078 wait complete. 2024-09-13T16:02:48.743 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:02:48.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.895+0000 7f10c1a00640 1 Processor -- start 2024-09-13T16:02:48.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.895+0000 7f10c1a00640 1 -- start start 2024-09-13T16:02:48.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.896+0000 7f10c1a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f10bc0b1ed0 0x7f10bc0cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:48.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.896+0000 7f10c1a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f10bc0cdae0 0x7f10bc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:48.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.896+0000 7f10c1a00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10bc0b30e0 con 0x7f10bc15a420 2024-09-13T16:02:48.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.896+0000 7f10c1a00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10bc15a800 con 0x7f10bc0b1ed0 2024-09-13T16:02:48.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.896+0000 7f10c1a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10bc0b24d0 con 0x7f10bc0cdae0 2024-09-13T16:02:48.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.896+0000 7f10b3400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f10bc0b1ed0 0x7f10bc0cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:48.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.896+0000 7f10bbe00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f10bc15a420 0x7f10bc0cbb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:57316/0 (socket says 172.21.15.70:57316) 2024-09-13T16:02:48.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.896+0000 7f10bbe00640 1 -- 172.21.15.70:0/931999717 learned_addr learned my addr 172.21.15.70:0/931999717 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:48.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.896+0000 7f10c1000640 1 --2- 172.21.15.70:0/931999717 >> v2:172.21.15.107:3300/0 conn(0x7f10bc0cdae0 0x7f10bc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:48.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.897+0000 7f10bb400640 1 -- 172.21.15.70:0/931999717 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312027221 0 0) 0x7f10bc0b30e0 con 0x7f10bc15a420 2024-09-13T16:02:48.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.897+0000 7f10bb400640 1 -- 172.21.15.70:0/931999717 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10a0003520 con 0x7f10bc15a420 2024-09-13T16:02:48.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.897+0000 7f10b3400640 1 -- 172.21.15.70:0/931999717 >> v2:172.21.15.107:3300/0 conn(0x7f10bc0cdae0 msgr2=0x7f10bc06b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:48.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.897+0000 7f10b3400640 1 --2- 172.21.15.70:0/931999717 >> v2:172.21.15.107:3300/0 conn(0x7f10bc0cdae0 0x7f10bc06b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.897+0000 7f10b3400640 1 -- 172.21.15.70:0/931999717 >> v1:172.21.15.70:6789/0 conn(0x7f10bc15a420 legacy=0x7f10bc0cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:48.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.897+0000 7f10b3400640 1 -- 172.21.15.70:0/931999717 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc0b27b0 con 0x7f10bc0b1ed0 2024-09-13T16:02:48.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.898+0000 7f10b3400640 1 --2- 172.21.15.70:0/931999717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10bc0b1ed0 0x7f10bc0cd5a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f10bc06aba0 tx=0x7f10a402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95765e68c6bd78e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:48.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.898+0000 7f10bb400640 1 -- 172.21.15.70:0/931999717 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a4032440 con 0x7f10bc0b1ed0 2024-09-13T16:02:48.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.898+0000 7f10bb400640 1 -- 172.21.15.70:0/931999717 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a40325a0 con 0x7f10bc0b1ed0 2024-09-13T16:02:48.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.898+0000 7f10bb400640 1 -- 172.21.15.70:0/931999717 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a4032910 con 0x7f10bc0b1ed0 2024-09-13T16:02:48.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.899+0000 7f10c1a00640 1 -- 172.21.15.70:0/931999717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10bc0b1ed0 msgr2=0x7f10bc0cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:48.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.899+0000 7f10c1a00640 1 --2- 172.21.15.70:0/931999717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10bc0b1ed0 0x7f10bc0cd5a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f10bc06aba0 tx=0x7f10a402a1a0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.899+0000 7f10c1a00640 1 -- 172.21.15.70:0/931999717 shutdown_connections 2024-09-13T16:02:48.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.899+0000 7f10c1a00640 1 --2- 172.21.15.70:0/931999717 >> v2:172.21.15.107:3300/0 conn(0x7f10bc0cdae0 0x7f10bc06b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.899+0000 7f10c1a00640 1 --2- 172.21.15.70:0/931999717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10bc0b1ed0 0x7f10bc0cd5a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.899+0000 7f10c1a00640 1 -- 172.21.15.70:0/931999717 >> 172.21.15.70:0/931999717 conn(0x7f10bc069ed0 msgr2=0x7f10bc06a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:48.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.899+0000 7f10c1a00640 1 -- 172.21.15.70:0/931999717 shutdown_connections 2024-09-13T16:02:48.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.899+0000 7f10c1a00640 1 -- 172.21.15.70:0/931999717 wait complete. 2024-09-13T16:02:48.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.900+0000 7f10c1a00640 1 Processor -- start 2024-09-13T16:02:48.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.900+0000 7f10c1a00640 1 -- start start 2024-09-13T16:02:48.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.901+0000 7f10c1a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f10bc0b1ed0 0x7f10bc14e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:48.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.901+0000 7f10c1a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10bc0cdae0 0x7f10bc1ef200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:48.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.901+0000 7f10c1a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10bc15a420 0x7f10bc1ef740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:48.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.901+0000 7f10c1a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc14bf30 con 0x7f10bc0cdae0 2024-09-13T16:02:48.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.901+0000 7f10c1a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc14c210 con 0x7f10bc15a420 2024-09-13T16:02:48.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.901+0000 7f10c1a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc150350 con 0x7f10bc0b1ed0 2024-09-13T16:02:48.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.902+0000 7f10b3400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10bc0cdae0 0x7f10bc1ef200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:48.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.902+0000 7f10b3400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10bc0cdae0 0x7f10bc1ef200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36990/0 (socket says 172.21.15.70:36990) 2024-09-13T16:02:48.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.902+0000 7f10b3400640 1 -- 172.21.15.70:0/3510220762 learned_addr learned my addr 172.21.15.70:0/3510220762 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:48.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.902+0000 7f10c1000640 1 --2- 172.21.15.70:0/3510220762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10bc15a420 0x7f10bc1ef740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:48.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.902+0000 7f10bbe00640 1 --2- 172.21.15.70:0/3510220762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f10bc0b1ed0 0x7f10bc14e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:48.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.902+0000 7f10b3400640 1 -- 172.21.15.70:0/3510220762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f10bc0b1ed0 msgr2=0x7f10bc14e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:48.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.902+0000 7f10b3400640 1 --2- 172.21.15.70:0/3510220762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f10bc0b1ed0 0x7f10bc14e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.902+0000 7f10b3400640 1 -- 172.21.15.70:0/3510220762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10bc15a420 msgr2=0x7f10bc1ef740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:48.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.902+0000 7f10b3400640 1 --2- 172.21.15.70:0/3510220762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10bc15a420 0x7f10bc1ef740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:48.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.902+0000 7f10b3400640 1 -- 172.21.15.70:0/3510220762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a4009400 con 0x7f10bc0cdae0 2024-09-13T16:02:48.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.902+0000 7f10b3400640 1 --2- 172.21.15.70:0/3510220762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10bc0cdae0 0x7f10bc1ef200 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f10a402a1e0 tx=0x7f10a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:48.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.902+0000 7f10b8c00640 1 -- 172.21.15.70:0/3510220762 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a403c820 con 0x7f10bc0cdae0 2024-09-13T16:02:48.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.903+0000 7f10b8c00640 1 -- 172.21.15.70:0/3510220762 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a403c980 con 0x7f10bc0cdae0 2024-09-13T16:02:48.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.903+0000 7f10b8c00640 1 -- 172.21.15.70:0/3510220762 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a403cd10 con 0x7f10bc0cdae0 2024-09-13T16:02:48.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.903+0000 7f10c1a00640 1 -- 172.21.15.70:0/3510220762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc150630 con 0x7f10bc0cdae0 2024-09-13T16:02:48.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.903+0000 7f10c1a00640 1 -- 172.21.15.70:0/3510220762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10bc14ee10 con 0x7f10bc0cdae0 2024-09-13T16:02:48.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.904+0000 7f10c1a00640 1 -- 172.21.15.70:0/3510220762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10bc150b50 con 0x7f10bc0cdae0 2024-09-13T16:02:48.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.904+0000 7f10b8c00640 1 -- 172.21.15.70:0/3510220762 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f10a4039050 con 0x7f10bc0cdae0 2024-09-13T16:02:48.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.905+0000 7f10b8c00640 1 --2- 172.21.15.70:0/3510220762 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f109806ac00 0x7f109806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:48.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.905+0000 7f10b8c00640 1 -- 172.21.15.70:0/3510220762 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f10a40a9f00 con 0x7f10bc0cdae0 2024-09-13T16:02:48.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.906+0000 7f10bbe00640 1 --2- 172.21.15.70:0/3510220762 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f109806ac00 0x7f109806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:48.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.906+0000 7f10bbe00640 1 --2- 172.21.15.70:0/3510220762 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f109806ac00 0x7f109806d0c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f10ac005880 tx=0x7f10ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:48.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:48.909+0000 7f10b8c00640 1 -- 172.21.15.70:0/3510220762 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f10bc150b50 con 0x7f10bc0cdae0 2024-09-13T16:02:49.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.082+0000 7f10c1a00640 1 -- 172.21.15.70:0/3510220762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10bc14c350 con 0x7f10bc0cdae0 2024-09-13T16:02:49.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.083+0000 7f10b8c00640 1 -- 172.21.15.70:0/3510220762 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10a4037020 con 0x7f10bc0cdae0 2024-09-13T16:02:49.086 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-13T16:02:49.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.085+0000 7f10c1a00640 1 -- 172.21.15.70:0/3510220762 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f109806ac00 msgr2=0x7f109806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:49.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.085+0000 7f10c1a00640 1 --2- 172.21.15.70:0/3510220762 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f109806ac00 0x7f109806d0c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f10ac005880 tx=0x7f10ac009040 comp rx=0 tx=0).stop 2024-09-13T16:02:49.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.085+0000 7f10c1a00640 1 -- 172.21.15.70:0/3510220762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10bc0cdae0 msgr2=0x7f10bc1ef200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:49.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.085+0000 7f10c1a00640 1 --2- 172.21.15.70:0/3510220762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10bc0cdae0 0x7f10bc1ef200 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f10a402a1e0 tx=0x7f10a40046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.085+0000 7f10c1a00640 1 -- 172.21.15.70:0/3510220762 shutdown_connections 2024-09-13T16:02:49.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.085+0000 7f10c1a00640 1 --2- 172.21.15.70:0/3510220762 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f109806ac00 0x7f109806d0c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.085+0000 7f10c1a00640 1 --2- 172.21.15.70:0/3510220762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10bc15a420 0x7f10bc1ef740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.085+0000 7f10c1a00640 1 --2- 172.21.15.70:0/3510220762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10bc0cdae0 0x7f10bc1ef200 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.085+0000 7f10c1a00640 1 --2- 172.21.15.70:0/3510220762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f10bc0b1ed0 0x7f10bc14e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.085+0000 7f10c1a00640 1 -- 172.21.15.70:0/3510220762 >> 172.21.15.70:0/3510220762 conn(0x7f10bc069ed0 msgr2=0x7f10bc0b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:49.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.085+0000 7f10c1a00640 1 -- 172.21.15.70:0/3510220762 shutdown_connections 2024-09-13T16:02:49.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.085+0000 7f10c1a00640 1 -- 172.21.15.70:0/3510220762 wait complete. 2024-09-13T16:02:49.103 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:02:49.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.258+0000 7f7f04000640 1 Processor -- start 2024-09-13T16:02:49.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.258+0000 7f7f04000640 1 -- start start 2024-09-13T16:02:49.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.259+0000 7f7f04000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7efc1461c0 0x7f7efc0b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:49.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.259+0000 7f7f04000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7efc0b2fe0 0x7f7efc06bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:49.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.259+0000 7f7f04000640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7efc0b2890 con 0x7f7efc06c3e0 2024-09-13T16:02:49.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.259+0000 7f7f04000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7efc0b1880 con 0x7f7efc1461c0 2024-09-13T16:02:49.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.259+0000 7f7f04000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0b3420 con 0x7f7efc0b2fe0 2024-09-13T16:02:49.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.259+0000 7f7f02000640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f7efc06c3e0 0x7f7efc160470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:57332/0 (socket says 172.21.15.70:57332) 2024-09-13T16:02:49.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.259+0000 7f7f02000640 1 -- 172.21.15.70:0/3232692693 learned_addr learned my addr 172.21.15.70:0/3232692693 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:49.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.260+0000 7f7f00c00640 1 --2- 172.21.15.70:0/3232692693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7efc0b2fe0 0x7f7efc06bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:49.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.260+0000 7f7f01600640 1 --2- 172.21.15.70:0/3232692693 >> v2:172.21.15.107:3300/0 conn(0x7f7efc1461c0 0x7f7efc0b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:49.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.260+0000 7f7efbe00640 1 -- 172.21.15.70:0/3232692693 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283847602 0 0) 0x7f7efc0b2890 con 0x7f7efc06c3e0 2024-09-13T16:02:49.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.260+0000 7f7efbe00640 1 -- 172.21.15.70:0/3232692693 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ee4003520 con 0x7f7efc06c3e0 2024-09-13T16:02:49.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.260+0000 7f7efbe00640 1 -- 172.21.15.70:0/3232692693 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1059050206 0 0) 0x7f7ee4003520 con 0x7f7efc06c3e0 2024-09-13T16:02:49.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.260+0000 7f7efbe00640 1 -- 172.21.15.70:0/3232692693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7efc0b2fe0 msgr2=0x7f7efc06bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:49.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.260+0000 7f7efbe00640 1 --2- 172.21.15.70:0/3232692693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7efc0b2fe0 0x7f7efc06bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.260+0000 7f7efbe00640 1 -- 172.21.15.70:0/3232692693 >> v2:172.21.15.107:3300/0 conn(0x7f7efc1461c0 msgr2=0x7f7efc0b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:49.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.260+0000 7f7efbe00640 1 --2- 172.21.15.70:0/3232692693 >> v2:172.21.15.107:3300/0 conn(0x7f7efc1461c0 0x7f7efc0b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.260+0000 7f7efbe00640 1 -- 172.21.15.70:0/3232692693 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc0b1ad0 con 0x7f7efc06c3e0 2024-09-13T16:02:49.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.260+0000 7f7efbe00640 1 -- 172.21.15.70:0/3232692693 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f7ef4001670 con 0x7f7efc06c3e0 2024-09-13T16:02:49.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.260+0000 7f7efbe00640 1 -- 172.21.15.70:0/3232692693 >> v1:172.21.15.70:6789/0 conn(0x7f7efc06c3e0 legacy=0x7f7efc160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:49.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.260+0000 7f7efbe00640 1 --2- 172.21.15.70:0/3232692693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7efc0b2fe0 0x7f7ee4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:49.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.260+0000 7f7efbe00640 1 --2- 172.21.15.70:0/3232692693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ee4003ef0 0x7f7ee40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:49.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.260+0000 7f7efbe00640 1 --2- 172.21.15.70:0/3232692693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ee4004d00 0x7f7ee4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:49.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.260+0000 7f7efbe00640 1 -- 172.21.15.70:0/3232692693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0b1880 con 0x7f7ee4004d00 2024-09-13T16:02:49.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.260+0000 7f7efbe00640 1 -- 172.21.15.70:0/3232692693 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0b3420 con 0x7f7ee4003ef0 2024-09-13T16:02:49.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.260+0000 7f7efbe00640 1 -- 172.21.15.70:0/3232692693 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee400b9d0 con 0x7f7efc0b2fe0 2024-09-13T16:02:49.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.261+0000 7f7f02000640 1 --2- 172.21.15.70:0/3232692693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ee4004d00 0x7f7ee4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:49.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.261+0000 7f7f00c00640 1 --2- 172.21.15.70:0/3232692693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ee4003ef0 0x7f7ee40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:49.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.261+0000 7f7f01600640 1 --2- 172.21.15.70:0/3232692693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7efc0b2fe0 0x7f7ee4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:49.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.261+0000 7f7f02000640 1 -- 172.21.15.70:0/3232692693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7efc0b2fe0 msgr2=0x7f7ee4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:49.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.261+0000 7f7f02000640 1 --2- 172.21.15.70:0/3232692693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7efc0b2fe0 0x7f7ee4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.261+0000 7f7f02000640 1 -- 172.21.15.70:0/3232692693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ee4003ef0 msgr2=0x7f7ee40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:49.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.261+0000 7f7f02000640 1 --2- 172.21.15.70:0/3232692693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ee4003ef0 0x7f7ee40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.261+0000 7f7f02000640 1 -- 172.21.15.70:0/3232692693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee4003520 con 0x7f7ee4004d00 2024-09-13T16:02:49.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.261+0000 7f7f00c00640 1 --2- 172.21.15.70:0/3232692693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ee4003ef0 0x7f7ee40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:49.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.262+0000 7f7f02000640 1 --2- 172.21.15.70:0/3232692693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ee4004d00 0x7f7ee4005180 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400c270 tx=0x7f7ee40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d33d3ac964e2d9f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:49.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.262+0000 7f7efbe00640 1 -- 172.21.15.70:0/3232692693 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4005ad0 con 0x7f7ee4004d00 2024-09-13T16:02:49.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.262+0000 7f7efbe00640 1 -- 172.21.15.70:0/3232692693 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef4005c30 con 0x7f7ee4004d00 2024-09-13T16:02:49.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.262+0000 7f7efbe00640 1 -- 172.21.15.70:0/3232692693 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4007290 con 0x7f7ee4004d00 2024-09-13T16:02:49.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.263+0000 7f7f04000640 1 -- 172.21.15.70:0/3232692693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ee4004d00 msgr2=0x7f7ee4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:49.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.263+0000 7f7f04000640 1 --2- 172.21.15.70:0/3232692693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ee4004d00 0x7f7ee4005180 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400c270 tx=0x7f7ee40057f0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.263+0000 7f7f02000640 1 -- 172.21.15.70:0/3232692693 reap_dead start 2024-09-13T16:02:49.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.263+0000 7f7f04000640 1 -- 172.21.15.70:0/3232692693 shutdown_connections 2024-09-13T16:02:49.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.263+0000 7f7f04000640 1 -- 172.21.15.70:0/3232692693 >> 172.21.15.70:0/3232692693 conn(0x7f7efc0b0580 msgr2=0x7f7efc0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:49.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.263+0000 7f7f04000640 1 -- 172.21.15.70:0/3232692693 shutdown_connections 2024-09-13T16:02:49.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.263+0000 7f7f04000640 1 -- 172.21.15.70:0/3232692693 wait complete. 2024-09-13T16:02:49.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.265+0000 7f7f04000640 1 Processor -- start 2024-09-13T16:02:49.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.265+0000 7f7f04000640 1 -- start start 2024-09-13T16:02:49.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.266+0000 7f7f04000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ee4004d00 0x7f7efc15c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:49.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.266+0000 7f7f04000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7efc13b740 0x7f7efc13d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:49.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.266+0000 7f7f04000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7efc13bbc0 0x7f7efc13de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:49.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.266+0000 7f7f04000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc141b10 con 0x7f7ee4004d00 2024-09-13T16:02:49.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.266+0000 7f7f04000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc13ea50 con 0x7f7efc13b740 2024-09-13T16:02:49.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.266+0000 7f7f04000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc15c710 con 0x7f7efc13bbc0 2024-09-13T16:02:49.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.266+0000 7f7f01600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ee4004d00 0x7f7efc15c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.266+0000 7f7f01600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ee4004d00 0x7f7efc15c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37016/0 (socket says 172.21.15.70:37016) 2024-09-13T16:02:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.266+0000 7f7f01600640 1 -- 172.21.15.70:0/3259267728 learned_addr learned my addr 172.21.15.70:0/3259267728 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.266+0000 7f7f02000640 1 --2- 172.21.15.70:0/3259267728 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7efc13bbc0 0x7f7efc13de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.266+0000 7f7f00c00640 1 --2- 172.21.15.70:0/3259267728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7efc13b740 0x7f7efc13d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.266+0000 7f7f01600640 1 -- 172.21.15.70:0/3259267728 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7efc13bbc0 msgr2=0x7f7efc13de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.266+0000 7f7f01600640 1 --2- 172.21.15.70:0/3259267728 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7efc13bbc0 0x7f7efc13de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.266+0000 7f7f01600640 1 -- 172.21.15.70:0/3259267728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7efc13b740 msgr2=0x7f7efc13d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.266+0000 7f7f01600640 1 --2- 172.21.15.70:0/3259267728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7efc13b740 0x7f7efc13d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.266+0000 7f7f01600640 1 -- 172.21.15.70:0/3259267728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc140f90 con 0x7f7ee4004d00 2024-09-13T16:02:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.267+0000 7f7f01600640 1 --2- 172.21.15.70:0/3259267728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ee4004d00 0x7f7efc15c1d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0011e30 tx=0x7f7ef000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.267+0000 7f7ef9600640 1 -- 172.21.15.70:0/3259267728 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef000e040 con 0x7f7ee4004d00 2024-09-13T16:02:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.267+0000 7f7ef9600640 1 -- 172.21.15.70:0/3259267728 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef000f040 con 0x7f7ee4004d00 2024-09-13T16:02:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.267+0000 7f7f04000640 1 -- 172.21.15.70:0/3259267728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7efc141270 con 0x7f7ee4004d00 2024-09-13T16:02:49.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.267+0000 7f7ef9600640 1 -- 172.21.15.70:0/3259267728 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0009c00 con 0x7f7ee4004d00 2024-09-13T16:02:49.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.267+0000 7f7f04000640 1 -- 172.21.15.70:0/3259267728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7efc141830 con 0x7f7ee4004d00 2024-09-13T16:02:49.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.268+0000 7f7f04000640 1 -- 172.21.15.70:0/3259267728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7efc06c890 con 0x7f7ee4004d00 2024-09-13T16:02:49.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.269+0000 7f7ef9600640 1 -- 172.21.15.70:0/3259267728 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7ef0015850 con 0x7f7ee4004d00 2024-09-13T16:02:49.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.270+0000 7f7ef9600640 1 --2- 172.21.15.70:0/3259267728 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7edc06ac00 0x7f7edc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:49.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.270+0000 7f7ef9600640 1 -- 172.21.15.70:0/3259267728 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7ef008a2e0 con 0x7f7ee4004d00 2024-09-13T16:02:49.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.270+0000 7f7f00c00640 1 --2- 172.21.15.70:0/3259267728 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7edc06ac00 0x7f7edc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:49.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.270+0000 7f7f00c00640 1 --2- 172.21.15.70:0/3259267728 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7edc06ac00 0x7f7edc06d0c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7efc13ff00 tx=0x7f7ee8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:49.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.274+0000 7f7ef9600640 1 -- 172.21.15.70:0/3259267728 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7ef0055460 con 0x7f7ee4004d00 2024-09-13T16:02:49.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.444+0000 7f7f04000640 1 -- 172.21.15.70:0/3259267728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7efc15f070 con 0x7f7ee4004d00 2024-09-13T16:02:49.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.444+0000 7f7ef9600640 1 -- 172.21.15.70:0/3259267728 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7ef0058a80 con 0x7f7ee4004d00 2024-09-13T16:02:49.447 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-13T16:02:49.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.446+0000 7f7f04000640 1 -- 172.21.15.70:0/3259267728 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7edc06ac00 msgr2=0x7f7edc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:49.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.446+0000 7f7f04000640 1 --2- 172.21.15.70:0/3259267728 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7edc06ac00 0x7f7edc06d0c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7efc13ff00 tx=0x7f7ee8008040 comp rx=0 tx=0).stop 2024-09-13T16:02:49.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.446+0000 7f7f04000640 1 -- 172.21.15.70:0/3259267728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ee4004d00 msgr2=0x7f7efc15c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:49.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.446+0000 7f7f04000640 1 --2- 172.21.15.70:0/3259267728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ee4004d00 0x7f7efc15c1d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0011e30 tx=0x7f7ef000f580 comp rx=0 tx=0).stop 2024-09-13T16:02:49.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.447+0000 7f7f04000640 1 -- 172.21.15.70:0/3259267728 shutdown_connections 2024-09-13T16:02:49.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.447+0000 7f7f04000640 1 --2- 172.21.15.70:0/3259267728 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7efc13bbc0 0x7f7efc13de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.447+0000 7f7f04000640 1 --2- 172.21.15.70:0/3259267728 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7edc06ac00 0x7f7edc06d0c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.447+0000 7f7f04000640 1 --2- 172.21.15.70:0/3259267728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7efc13b740 0x7f7efc13d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.447+0000 7f7f04000640 1 --2- 172.21.15.70:0/3259267728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ee4004d00 0x7f7efc15c1d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.447+0000 7f7f04000640 1 -- 172.21.15.70:0/3259267728 >> 172.21.15.70:0/3259267728 conn(0x7f7efc0b0580 msgr2=0x7f7efc0ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:49.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.447+0000 7f7f04000640 1 -- 172.21.15.70:0/3259267728 shutdown_connections 2024-09-13T16:02:49.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.447+0000 7f7f04000640 1 -- 172.21.15.70:0/3259267728 wait complete. 2024-09-13T16:02:49.465 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T16:02:49.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.617+0000 7f503de00640 1 Processor -- start 2024-09-13T16:02:49.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.618+0000 7f503de00640 1 -- start start 2024-09-13T16:02:49.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.619+0000 7f503de00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f503815dc30 0x7f50380cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:49.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.619+0000 7f503de00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50380cb8d0 con 0x7f503806a5e0 2024-09-13T16:02:49.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.619+0000 7f503de00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50380cbbb0 con 0x7f50380cb3d0 2024-09-13T16:02:49.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.619+0000 7f503de00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503815e010 con 0x7f503815dc30 2024-09-13T16:02:49.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.619+0000 7f503d400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f503806a5e0 0x7f5038070430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:57338/0 (socket says 172.21.15.70:57338) 2024-09-13T16:02:49.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.619+0000 7f503d400640 1 -- 172.21.15.70:0/1394303548 learned_addr learned my addr 172.21.15.70:0/1394303548 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:49.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.619+0000 7f503ca00640 1 --2- 172.21.15.70:0/1394303548 >> v2:172.21.15.107:3300/0 conn(0x7f503815dc30 0x7f50380cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:49.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.619+0000 7f5037400640 1 -- 172.21.15.70:0/1394303548 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53630923 0 0) 0x7f50380cb8d0 con 0x7f503806a5e0 2024-09-13T16:02:49.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.619+0000 7f5037400640 1 -- 172.21.15.70:0/1394303548 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5020003520 con 0x7f503806a5e0 2024-09-13T16:02:49.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.620+0000 7f5037400640 1 -- 172.21.15.70:0/1394303548 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1366392036 0 0) 0x7f5020003520 con 0x7f503806a5e0 2024-09-13T16:02:49.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.620+0000 7f5037400640 1 -- 172.21.15.70:0/1394303548 >> v2:172.21.15.107:3300/0 conn(0x7f503815dc30 msgr2=0x7f50380cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:49.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.620+0000 7f5037400640 1 --2- 172.21.15.70:0/1394303548 >> v2:172.21.15.107:3300/0 conn(0x7f503815dc30 0x7f50380cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.620+0000 7f5037400640 1 -- 172.21.15.70:0/1394303548 >> v1:172.21.15.107:6789/0 conn(0x7f50380cb3d0 legacy=0x7f5038069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:49.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.620+0000 7f5037400640 1 -- 172.21.15.70:0/1394303548 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50380cbe90 con 0x7f503806a5e0 2024-09-13T16:02:49.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.620+0000 7f5037400640 1 -- 172.21.15.70:0/1394303548 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f50300019f0 con 0x7f503806a5e0 2024-09-13T16:02:49.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.620+0000 7f5037400640 1 -- 172.21.15.70:0/1394303548 >> v1:172.21.15.70:6789/0 conn(0x7f503806a5e0 legacy=0x7f5038070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:49.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.620+0000 7f5037400640 1 --2- 172.21.15.70:0/1394303548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020003970 0x7f5020003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:49.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.620+0000 7f5037400640 1 --2- 172.21.15.70:0/1394303548 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50200047c0 0x7f5020004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:49.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.620+0000 7f5037400640 1 --2- 172.21.15.70:0/1394303548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5020005180 0x7f502000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:49.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.620+0000 7f5037400640 1 -- 172.21.15.70:0/1394303548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502000bff0 con 0x7f5020003970 2024-09-13T16:02:49.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.620+0000 7f5037400640 1 -- 172.21.15.70:0/1394303548 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502000c160 con 0x7f5020005180 2024-09-13T16:02:49.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.620+0000 7f5037400640 1 -- 172.21.15.70:0/1394303548 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502000c320 con 0x7f50200047c0 2024-09-13T16:02:49.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.620+0000 7f503ca00640 1 --2- 172.21.15.70:0/1394303548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020003970 0x7f5020003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:49.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.620+0000 7f503d400640 1 --2- 172.21.15.70:0/1394303548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5020005180 0x7f502000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:49.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.620+0000 7f5037e00640 1 --2- 172.21.15.70:0/1394303548 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50200047c0 0x7f5020004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:49.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.621+0000 7f503ca00640 1 -- 172.21.15.70:0/1394303548 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50200047c0 msgr2=0x7f5020004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:49.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.621+0000 7f503ca00640 1 --2- 172.21.15.70:0/1394303548 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50200047c0 0x7f5020004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.621+0000 7f503ca00640 1 -- 172.21.15.70:0/1394303548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5020005180 msgr2=0x7f502000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:49.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.621+0000 7f503ca00640 1 --2- 172.21.15.70:0/1394303548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5020005180 0x7f502000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.621+0000 7f503ca00640 1 -- 172.21.15.70:0/1394303548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5020003520 con 0x7f5020003970 2024-09-13T16:02:49.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.621+0000 7f503d400640 1 --2- 172.21.15.70:0/1394303548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5020005180 0x7f502000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:49.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.621+0000 7f503d400640 1 -- 172.21.15.70:0/1394303548 reap_dead start 2024-09-13T16:02:49.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.622+0000 7f503ca00640 1 --2- 172.21.15.70:0/1394303548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020003970 0x7f5020003d90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f502c009ac0 tx=0x7f50200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75bc2d7fd3af6803 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:49.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.622+0000 7f5037400640 1 -- 172.21.15.70:0/1394303548 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c031400 con 0x7f5020003970 2024-09-13T16:02:49.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.622+0000 7f5037400640 1 -- 172.21.15.70:0/1394303548 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c02d050 con 0x7f5020003970 2024-09-13T16:02:49.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.622+0000 7f5037400640 1 -- 172.21.15.70:0/1394303548 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c031780 con 0x7f5020003970 2024-09-13T16:02:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.622+0000 7f503de00640 1 -- 172.21.15.70:0/1394303548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020003970 msgr2=0x7f5020003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.622+0000 7f503de00640 1 --2- 172.21.15.70:0/1394303548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020003970 0x7f5020003d90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f502c009ac0 tx=0x7f50200057f0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.622+0000 7f503de00640 1 -- 172.21.15.70:0/1394303548 shutdown_connections 2024-09-13T16:02:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.622+0000 7f503de00640 1 --2- 172.21.15.70:0/1394303548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020003970 0x7f5020003d90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.622+0000 7f503de00640 1 -- 172.21.15.70:0/1394303548 >> 172.21.15.70:0/1394303548 conn(0x7f50380affd0 msgr2=0x7f50380b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.622+0000 7f503de00640 1 -- 172.21.15.70:0/1394303548 shutdown_connections 2024-09-13T16:02:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.622+0000 7f503de00640 1 -- 172.21.15.70:0/1394303548 wait complete. 2024-09-13T16:02:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.624+0000 7f503de00640 1 Processor -- start 2024-09-13T16:02:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.624+0000 7f503de00640 1 -- start start 2024-09-13T16:02:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.625+0000 7f503de00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5020003970 0x7f503814e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.625+0000 7f503de00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50380b18a0 0x7f50380b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.625+0000 7f503de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50380ac870 0x7f50380accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.625+0000 7f503de00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50380b3090 con 0x7f50380b18a0 2024-09-13T16:02:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.625+0000 7f503de00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50380ad230 con 0x7f50380ac870 2024-09-13T16:02:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.625+0000 7f503de00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503814eb10 con 0x7f5020003970 2024-09-13T16:02:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.625+0000 7f5037e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50380b18a0 0x7f50380b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.625+0000 7f5037e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50380b18a0 0x7f50380b1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37026/0 (socket says 172.21.15.70:37026) 2024-09-13T16:02:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.625+0000 7f5037e00640 1 -- 172.21.15.70:0/2866849275 learned_addr learned my addr 172.21.15.70:0/2866849275 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.625+0000 7f503ca00640 1 --2- 172.21.15.70:0/2866849275 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5020003970 0x7f503814e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.625+0000 7f503d400640 1 --2- 172.21.15.70:0/2866849275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50380ac870 0x7f50380accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.626+0000 7f5037e00640 1 -- 172.21.15.70:0/2866849275 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5020003970 msgr2=0x7f503814e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.626+0000 7f5037e00640 1 --2- 172.21.15.70:0/2866849275 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5020003970 0x7f503814e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.626+0000 7f5037e00640 1 -- 172.21.15.70:0/2866849275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50380ac870 msgr2=0x7f50380accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.626+0000 7f5037e00640 1 --2- 172.21.15.70:0/2866849275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50380ac870 0x7f50380accf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.626+0000 7f5037e00640 1 -- 172.21.15.70:0/2866849275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50380b2410 con 0x7f50380b18a0 2024-09-13T16:02:49.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.626+0000 7f5037e00640 1 --2- 172.21.15.70:0/2866849275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50380b18a0 0x7f50380b1d20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f502400e490 tx=0x7f502400e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:49.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.626+0000 7f5034c00640 1 -- 172.21.15.70:0/2866849275 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50240053a0 con 0x7f50380b18a0 2024-09-13T16:02:49.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.626+0000 7f5034c00640 1 -- 172.21.15.70:0/2866849275 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50240035f0 con 0x7f50380b18a0 2024-09-13T16:02:49.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.626+0000 7f5034c00640 1 -- 172.21.15.70:0/2866849275 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5024003980 con 0x7f50380b18a0 2024-09-13T16:02:49.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.626+0000 7f503de00640 1 -- 172.21.15.70:0/2866849275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50380b26f0 con 0x7f50380b18a0 2024-09-13T16:02:49.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.626+0000 7f503de00640 1 -- 172.21.15.70:0/2866849275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50380b2cb0 con 0x7f50380b18a0 2024-09-13T16:02:49.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.627+0000 7f503de00640 1 -- 172.21.15.70:0/2866849275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5038067320 con 0x7f50380b18a0 2024-09-13T16:02:49.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.628+0000 7f5034c00640 1 -- 172.21.15.70:0/2866849275 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5024003ae0 con 0x7f50380b18a0 2024-09-13T16:02:49.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.629+0000 7f5034c00640 1 --2- 172.21.15.70:0/2866849275 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f501806ac00 0x7f501806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:49.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.629+0000 7f5034c00640 1 -- 172.21.15.70:0/2866849275 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5024088fd0 con 0x7f50380b18a0 2024-09-13T16:02:49.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.629+0000 7f503ca00640 1 --2- 172.21.15.70:0/2866849275 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f501806ac00 0x7f501806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:49.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.630+0000 7f503ca00640 1 --2- 172.21.15.70:0/2866849275 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f501806ac00 0x7f501806d0c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f502c033000 tx=0x7f502c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:49.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.633+0000 7f5034c00640 1 -- 172.21.15.70:0/2866849275 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f50240541f0 con 0x7f50380b18a0 2024-09-13T16:02:49.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.815+0000 7f503de00640 1 -- 172.21.15.70:0/2866849275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f50380cd9f0 con 0x7f50380b18a0 2024-09-13T16:02:49.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.816+0000 7f5034c00640 1 -- 172.21.15.70:0/2866849275 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v35) v1 ==== 80+0+122 (secure 0 0 0) 0x7f5024057810 con 0x7f50380b18a0 2024-09-13T16:02:49.818 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6837/3554365995 2024-09-14T16:02:41.167987+0000 2024-09-13T16:02:49.818 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6835/3554365995 2024-09-14T16:02:41.167987+0000 2024-09-13T16:02:49.818 INFO:teuthology.orchestra.run.smithi070.stderr:listed 2 entries 2024-09-13T16:02:49.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.818+0000 7f503de00640 1 -- 172.21.15.70:0/2866849275 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f501806ac00 msgr2=0x7f501806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:49.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.818+0000 7f503de00640 1 --2- 172.21.15.70:0/2866849275 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f501806ac00 0x7f501806d0c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f502c033000 tx=0x7f502c008030 comp rx=0 tx=0).stop 2024-09-13T16:02:49.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.818+0000 7f503de00640 1 -- 172.21.15.70:0/2866849275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50380b18a0 msgr2=0x7f50380b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:49.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.818+0000 7f503de00640 1 --2- 172.21.15.70:0/2866849275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50380b18a0 0x7f50380b1d20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f502400e490 tx=0x7f502400e950 comp rx=0 tx=0).stop 2024-09-13T16:02:49.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.818+0000 7f503de00640 1 -- 172.21.15.70:0/2866849275 shutdown_connections 2024-09-13T16:02:49.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.818+0000 7f503de00640 1 --2- 172.21.15.70:0/2866849275 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f501806ac00 0x7f501806d0c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.818+0000 7f503de00640 1 --2- 172.21.15.70:0/2866849275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50380ac870 0x7f50380accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.818+0000 7f503de00640 1 --2- 172.21.15.70:0/2866849275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50380b18a0 0x7f50380b1d20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.818+0000 7f503de00640 1 --2- 172.21.15.70:0/2866849275 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5020003970 0x7f503814e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:49.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.818+0000 7f503de00640 1 -- 172.21.15.70:0/2866849275 >> 172.21.15.70:0/2866849275 conn(0x7f50380affd0 msgr2=0x7f50380af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:49.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.818+0000 7f503de00640 1 -- 172.21.15.70:0/2866849275 shutdown_connections 2024-09-13T16:02:49.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:49.818+0000 7f503de00640 1 -- 172.21.15.70:0/2866849275 wait complete. 2024-09-13T16:02:49.836 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T16:02:49.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:49.836 DEBUG:teuthology.orchestra.run.smithi070:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T16:02:49.899 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2024-09-13T16:02:49.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:49.899 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T16:02:49.935 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:02:49.936 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:02:49.976 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T16:02:49.976 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:02:49.976 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:02:50.011 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T16:02:50.011 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:02:50.011 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:02:50.054 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T16:02:50.054 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:02:50.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.203+0000 7feda1000640 1 Processor -- start 2024-09-13T16:02:50.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.204+0000 7feda1000640 1 -- start start 2024-09-13T16:02:50.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.205+0000 7feda1000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fed9c15a5c0 0x7fed9c0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:50.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.205+0000 7feda1000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fed9c0cbac0 0x7fed9c0b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:50.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.205+0000 7feda1000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9c0cbfc0 con 0x7fed9c0afe10 2024-09-13T16:02:50.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.205+0000 7feda1000640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c0cce20 con 0x7fed9c0cbac0 2024-09-13T16:02:50.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.205+0000 7feda1000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c0707a0 con 0x7fed9c15a5c0 2024-09-13T16:02:50.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.205+0000 7fed9aa00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fed9c0cbac0 0x7fed9c0b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:50.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.205+0000 7fed9aa00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fed9c0cbac0 0x7fed9c0b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51872/0 (socket says 172.21.15.70:51872) 2024-09-13T16:02:50.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.205+0000 7fed9aa00640 1 -- 172.21.15.70:0/2727978552 learned_addr learned my addr 172.21.15.70:0/2727978552 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:50.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.205+0000 7fed9b400640 1 --2- 172.21.15.70:0/2727978552 >> v2:172.21.15.107:3300/0 conn(0x7fed9c15a5c0 0x7fed9c0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:50.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.206+0000 7fed9aa00640 1 -- 172.21.15.70:0/2727978552 >> v2:172.21.15.107:3300/0 conn(0x7fed9c15a5c0 msgr2=0x7fed9c0b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:50.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.206+0000 7fed9aa00640 1 --2- 172.21.15.70:0/2727978552 >> v2:172.21.15.107:3300/0 conn(0x7fed9c15a5c0 0x7fed9c0b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.206+0000 7fed9aa00640 1 -- 172.21.15.70:0/2727978552 >> v1:172.21.15.107:6789/0 conn(0x7fed9c0afe10 legacy=0x7fed9c06f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:50.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.206+0000 7fed9aa00640 1 -- 172.21.15.70:0/2727978552 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c070a80 con 0x7fed9c0cbac0 2024-09-13T16:02:50.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.207+0000 7fed9aa00640 1 --2- 172.21.15.70:0/2727978552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9c0cbac0 0x7fed9c0b3ef0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fed9c067270 tx=0x7fed8802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4580b819756b91c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:50.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.207+0000 7fed9a000640 1 -- 172.21.15.70:0/2727978552 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88032440 con 0x7fed9c0cbac0 2024-09-13T16:02:50.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.207+0000 7fed9a000640 1 -- 172.21.15.70:0/2727978552 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed880325a0 con 0x7fed9c0cbac0 2024-09-13T16:02:50.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.207+0000 7fed9a000640 1 -- 172.21.15.70:0/2727978552 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88032930 con 0x7fed9c0cbac0 2024-09-13T16:02:50.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.207+0000 7feda1000640 1 -- 172.21.15.70:0/2727978552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9c0cbac0 msgr2=0x7fed9c0b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:50.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.207+0000 7feda1000640 1 --2- 172.21.15.70:0/2727978552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9c0cbac0 0x7fed9c0b3ef0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fed9c067270 tx=0x7fed8802a270 comp rx=0 tx=0).stop 2024-09-13T16:02:50.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.208+0000 7feda1000640 1 -- 172.21.15.70:0/2727978552 shutdown_connections 2024-09-13T16:02:50.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.208+0000 7feda1000640 1 --2- 172.21.15.70:0/2727978552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9c0cbac0 0x7fed9c0b3ef0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.208+0000 7feda1000640 1 --2- 172.21.15.70:0/2727978552 >> v2:172.21.15.107:3300/0 conn(0x7fed9c15a5c0 0x7fed9c0b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.208+0000 7feda1000640 1 -- 172.21.15.70:0/2727978552 >> 172.21.15.70:0/2727978552 conn(0x7fed9c0ae310 msgr2=0x7fed9c0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:50.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.208+0000 7feda1000640 1 -- 172.21.15.70:0/2727978552 shutdown_connections 2024-09-13T16:02:50.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.208+0000 7feda1000640 1 -- 172.21.15.70:0/2727978552 wait complete. 2024-09-13T16:02:50.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.209+0000 7feda1000640 1 Processor -- start 2024-09-13T16:02:50.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.209+0000 7feda1000640 1 -- start start 2024-09-13T16:02:50.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.210+0000 7feda1000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed9c0afe10 0x7fed9c1e4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:50.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.210+0000 7feda1000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9c0cbac0 0x7fed9c1e0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:50.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.210+0000 7feda1000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed9c15a5c0 0x7fed9c151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:50.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.210+0000 7feda1000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c1df6b0 con 0x7fed9c0cbac0 2024-09-13T16:02:50.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.210+0000 7feda1000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c1e1c80 con 0x7fed9c15a5c0 2024-09-13T16:02:50.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.210+0000 7feda1000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c1e1f60 con 0x7fed9c0afe10 2024-09-13T16:02:50.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.211+0000 7fed9aa00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9c0cbac0 0x7fed9c1e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:50.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.211+0000 7fed9b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed9c0afe10 0x7fed9c1e4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:50.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.211+0000 7fed9b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed9c0afe10 0x7fed9c1e4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:47152/0 (socket says 172.21.15.70:47152) 2024-09-13T16:02:50.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.211+0000 7fed9b400640 1 -- 172.21.15.70:0/3656475139 learned_addr learned my addr 172.21.15.70:0/3656475139 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:50.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.211+0000 7fed9be00640 1 --2- 172.21.15.70:0/3656475139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed9c15a5c0 0x7fed9c151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:50.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.211+0000 7fed9aa00640 1 -- 172.21.15.70:0/3656475139 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed9c0afe10 msgr2=0x7fed9c1e4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:50.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.211+0000 7fed9aa00640 1 --2- 172.21.15.70:0/3656475139 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed9c0afe10 0x7fed9c1e4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.211+0000 7fed9aa00640 1 -- 172.21.15.70:0/3656475139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed9c15a5c0 msgr2=0x7fed9c151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:50.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.211+0000 7fed9aa00640 1 --2- 172.21.15.70:0/3656475139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed9c15a5c0 0x7fed9c151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.211+0000 7fed9aa00640 1 -- 172.21.15.70:0/3656475139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed880094d0 con 0x7fed9c0cbac0 2024-09-13T16:02:50.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.211+0000 7fed9b400640 1 --2- 172.21.15.70:0/3656475139 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed9c0afe10 0x7fed9c1e4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:50.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.211+0000 7fed9be00640 1 --2- 172.21.15.70:0/3656475139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed9c15a5c0 0x7fed9c151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:50.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.212+0000 7fed9aa00640 1 --2- 172.21.15.70:0/3656475139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9c0cbac0 0x7fed9c1e0100 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fed88031000 tx=0x7fed880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:50.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.212+0000 7fed93400640 1 -- 172.21.15.70:0/3656475139 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88032440 con 0x7fed9c0cbac0 2024-09-13T16:02:50.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.212+0000 7fed93400640 1 -- 172.21.15.70:0/3656475139 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed88030bc0 con 0x7fed9c0cbac0 2024-09-13T16:02:50.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.212+0000 7fed93400640 1 -- 172.21.15.70:0/3656475139 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8803d440 con 0x7fed9c0cbac0 2024-09-13T16:02:50.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.212+0000 7feda1000640 1 -- 172.21.15.70:0/3656475139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9c1df900 con 0x7fed9c0cbac0 2024-09-13T16:02:50.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.212+0000 7feda1000640 1 -- 172.21.15.70:0/3656475139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c1e4ad0 con 0x7fed9c0cbac0 2024-09-13T16:02:50.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.213+0000 7feda1000640 1 -- 172.21.15.70:0/3656475139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9c067360 con 0x7fed9c0cbac0 2024-09-13T16:02:50.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.214+0000 7fed93400640 1 -- 172.21.15.70:0/3656475139 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fed88039040 con 0x7fed9c0cbac0 2024-09-13T16:02:50.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.215+0000 7fed93400640 1 --2- 172.21.15.70:0/3656475139 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fed7c06ac00 0x7fed7c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:50.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.215+0000 7fed93400640 1 -- 172.21.15.70:0/3656475139 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fed880a9e80 con 0x7fed9c0cbac0 2024-09-13T16:02:50.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.215+0000 7fed9b400640 1 --2- 172.21.15.70:0/3656475139 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fed7c06ac00 0x7fed7c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:50.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.216+0000 7fed9b400640 1 --2- 172.21.15.70:0/3656475139 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fed7c06ac00 0x7fed7c06d0c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009f50 tx=0x7fed8c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:50.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.219+0000 7fed93400640 1 -- 172.21.15.70:0/3656475139 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fed88075080 con 0x7fed9c0cbac0 2024-09-13T16:02:50.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.424+0000 7feda1000640 1 -- 172.21.15.70:0/3656475139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed9c071f30 con 0x7fed9c0cbac0 2024-09-13T16:02:50.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.424+0000 7fed93400640 1 -- 172.21.15.70:0/3656475139 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4742 (secure 0 0 0) 0x7fed88037090 con 0x7fed9c0cbac0 2024-09-13T16:02:50.427 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:50.427 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2990833970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":2990833970},{"type":"v1","addr":"172.21.15.70:6837","nonce":2990833970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/1247927631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1247927631},{"type":"v1","addr":"172.21.15.70:6836","nonce":1247927631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/1077617661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1077617661},{"type":"v1","addr":"172.21.15.107:6834","nonce":1077617661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:02:16.987283+0000","modified":"2024-09-13T16:02:45.193131+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5124":{"gid":5124,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6835/2709979655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2709979655},{"type":"v1","addr":"172.21.15.107:6835","nonce":2709979655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T16:02:50.427 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 22 2024-09-13T16:02:50.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.426+0000 7feda1000640 1 -- 172.21.15.70:0/3656475139 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fed7c06ac00 msgr2=0x7fed7c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:50.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.426+0000 7feda1000640 1 --2- 172.21.15.70:0/3656475139 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fed7c06ac00 0x7fed7c06d0c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009f50 tx=0x7fed8c009190 comp rx=0 tx=0).stop 2024-09-13T16:02:50.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.426+0000 7feda1000640 1 -- 172.21.15.70:0/3656475139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9c0cbac0 msgr2=0x7fed9c1e0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:50.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.426+0000 7feda1000640 1 --2- 172.21.15.70:0/3656475139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9c0cbac0 0x7fed9c1e0100 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fed88031000 tx=0x7fed880046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.427+0000 7feda1000640 1 -- 172.21.15.70:0/3656475139 shutdown_connections 2024-09-13T16:02:50.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.427+0000 7feda1000640 1 --2- 172.21.15.70:0/3656475139 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fed7c06ac00 0x7fed7c06d0c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.427+0000 7feda1000640 1 --2- 172.21.15.70:0/3656475139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed9c15a5c0 0x7fed9c151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.427+0000 7feda1000640 1 --2- 172.21.15.70:0/3656475139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9c0cbac0 0x7fed9c1e0100 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.427+0000 7feda1000640 1 --2- 172.21.15.70:0/3656475139 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed9c0afe10 0x7fed9c1e4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.427+0000 7feda1000640 1 -- 172.21.15.70:0/3656475139 >> 172.21.15.70:0/3656475139 conn(0x7fed9c0ae310 msgr2=0x7fed9c06c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:50.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.427+0000 7feda1000640 1 -- 172.21.15.70:0/3656475139 shutdown_connections 2024-09-13T16:02:50.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.427+0000 7feda1000640 1 -- 172.21.15.70:0/3656475139 wait complete. 2024-09-13T16:02:50.444 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:02:50.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.595+0000 7f7045c00640 1 Processor -- start 2024-09-13T16:02:50.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.595+0000 7f7045c00640 1 -- start start 2024-09-13T16:02:50.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.596+0000 7f7045c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70400b3990 0x7f7040159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:50.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.596+0000 7f7045c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f704006f660 0x7f704006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:50.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.596+0000 7f7045c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7040159fc0 con 0x7f7040153b20 2024-09-13T16:02:50.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.596+0000 7f7045c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70400b3df0 con 0x7f704006f660 2024-09-13T16:02:50.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.596+0000 7f7045c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70400ce600 con 0x7f70400b3990 2024-09-13T16:02:50.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.596+0000 7f703f400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f704006f660 0x7f704006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:50.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.597+0000 7f703ea00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7040153b20 0x7f70400b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:34590/0 (socket says 172.21.15.70:34590) 2024-09-13T16:02:50.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.597+0000 7f703e000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70400b3990 0x7f7040159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:50.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.597+0000 7f703ea00640 1 -- 172.21.15.70:0/2971445367 learned_addr learned my addr 172.21.15.70:0/2971445367 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:50.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.597+0000 7f703f400640 1 -- 172.21.15.70:0/2971445367 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70400b3990 msgr2=0x7f7040159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:50.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.597+0000 7f703f400640 1 --2- 172.21.15.70:0/2971445367 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70400b3990 0x7f7040159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.597+0000 7f703f400640 1 -- 172.21.15.70:0/2971445367 >> v1:172.21.15.107:6789/0 conn(0x7f7040153b20 legacy=0x7f70400b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:50.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.597+0000 7f703f400640 1 -- 172.21.15.70:0/2971445367 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7040153f00 con 0x7f704006f660 2024-09-13T16:02:50.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.597+0000 7f703e000640 1 --2- 172.21.15.70:0/2971445367 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70400b3990 0x7f7040159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:50.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.598+0000 7f703f400640 1 --2- 172.21.15.70:0/2971445367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f704006f660 0x7f704006faf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7038009d90 tx=0x7f703802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8340a8d2071694e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:50.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.598+0000 7f703d600640 1 -- 172.21.15.70:0/2971445367 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038007740 con 0x7f704006f660 2024-09-13T16:02:50.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.598+0000 7f703d600640 1 -- 172.21.15.70:0/2971445367 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703802d050 con 0x7f704006f660 2024-09-13T16:02:50.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.598+0000 7f703d600640 1 -- 172.21.15.70:0/2971445367 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038007ac0 con 0x7f704006f660 2024-09-13T16:02:50.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.599+0000 7f7045c00640 1 -- 172.21.15.70:0/2971445367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f704006f660 msgr2=0x7f704006faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:50.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.599+0000 7f7045c00640 1 --2- 172.21.15.70:0/2971445367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f704006f660 0x7f704006faf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7038009d90 tx=0x7f703802a660 comp rx=0 tx=0).stop 2024-09-13T16:02:50.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.599+0000 7f7045c00640 1 -- 172.21.15.70:0/2971445367 shutdown_connections 2024-09-13T16:02:50.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.599+0000 7f7045c00640 1 --2- 172.21.15.70:0/2971445367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f704006f660 0x7f704006faf0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.599+0000 7f7045c00640 1 --2- 172.21.15.70:0/2971445367 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70400b3990 0x7f7040159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.599+0000 7f7045c00640 1 -- 172.21.15.70:0/2971445367 >> 172.21.15.70:0/2971445367 conn(0x7f70400b0510 msgr2=0x7f70400b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:50.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.599+0000 7f7045c00640 1 -- 172.21.15.70:0/2971445367 shutdown_connections 2024-09-13T16:02:50.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.599+0000 7f7045c00640 1 -- 172.21.15.70:0/2971445367 wait complete. 2024-09-13T16:02:50.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.601+0000 7f7045c00640 1 Processor -- start 2024-09-13T16:02:50.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.601+0000 7f7045c00640 1 -- start start 2024-09-13T16:02:50.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.602+0000 7f7045c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f704006f660 0x7f70400b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:50.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.602+0000 7f7045c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70400b3990 0x7f7040165bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:50.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.602+0000 7f7045c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7040153b20 0x7f70400cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:50.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.602+0000 7f7045c00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70400aed50 con 0x7f70400b3990 2024-09-13T16:02:50.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.602+0000 7f7045c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70400ae420 con 0x7f7040153b20 2024-09-13T16:02:50.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.602+0000 7f7045c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70400ae700 con 0x7f704006f660 2024-09-13T16:02:50.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.602+0000 7f703e000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70400b3990 0x7f7040165bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:50.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.602+0000 7f703ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f704006f660 0x7f70400b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:50.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.602+0000 7f703ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f704006f660 0x7f70400b2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:47166/0 (socket says 172.21.15.70:47166) 2024-09-13T16:02:50.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.602+0000 7f703ea00640 1 -- 172.21.15.70:0/1943609693 learned_addr learned my addr 172.21.15.70:0/1943609693 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:50.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.602+0000 7f703f400640 1 --2- 172.21.15.70:0/1943609693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7040153b20 0x7f70400cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:50.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.603+0000 7f703e000640 1 -- 172.21.15.70:0/1943609693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f704006f660 msgr2=0x7f70400b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:50.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.603+0000 7f703e000640 1 --2- 172.21.15.70:0/1943609693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f704006f660 0x7f70400b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.603+0000 7f703e000640 1 -- 172.21.15.70:0/1943609693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7040153b20 msgr2=0x7f70400cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:50.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.603+0000 7f703e000640 1 --2- 172.21.15.70:0/1943609693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7040153b20 0x7f70400cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.603+0000 7f703e000640 1 -- 172.21.15.70:0/1943609693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c009400 con 0x7f70400b3990 2024-09-13T16:02:50.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.603+0000 7f703e000640 1 --2- 172.21.15.70:0/1943609693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70400b3990 0x7f7040165bf0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f702c00e840 tx=0x7f702c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:50.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.603+0000 7f7036a00640 1 -- 172.21.15.70:0/1943609693 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c00c940 con 0x7f70400b3990 2024-09-13T16:02:50.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.603+0000 7f7036a00640 1 -- 172.21.15.70:0/1943609693 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c00caa0 con 0x7f70400b3990 2024-09-13T16:02:50.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.603+0000 7f7036a00640 1 -- 172.21.15.70:0/1943609693 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c00ce30 con 0x7f70400b3990 2024-09-13T16:02:50.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.603+0000 7f7045c00640 1 -- 172.21.15.70:0/1943609693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7038009a70 con 0x7f70400b3990 2024-09-13T16:02:50.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.603+0000 7f7045c00640 1 -- 172.21.15.70:0/1943609693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7040166130 con 0x7f70400b3990 2024-09-13T16:02:50.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.604+0000 7f7045c00640 1 -- 172.21.15.70:0/1943609693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70400aeec0 con 0x7f70400b3990 2024-09-13T16:02:50.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.605+0000 7f7036a00640 1 -- 172.21.15.70:0/1943609693 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f702c013470 con 0x7f70400b3990 2024-09-13T16:02:50.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.606+0000 7f7036a00640 1 --2- 172.21.15.70:0/1943609693 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f702006ac00 0x7f702006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:50.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.606+0000 7f7036a00640 1 -- 172.21.15.70:0/1943609693 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f702c089580 con 0x7f70400b3990 2024-09-13T16:02:50.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.606+0000 7f703ea00640 1 --2- 172.21.15.70:0/1943609693 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f702006ac00 0x7f702006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:50.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.607+0000 7f703ea00640 1 --2- 172.21.15.70:0/1943609693 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f702006ac00 0x7f702006d0c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7030005880 tx=0x7f7030009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.610+0000 7f7036a00640 1 -- 172.21.15.70:0/1943609693 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f702c054710 con 0x7f70400b3990 2024-09-13T16:02:50.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.780+0000 7f7045c00640 1 -- 172.21.15.70:0/1943609693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f704015a7b0 con 0x7f70400b3990 2024-09-13T16:02:50.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.782+0000 7f7036a00640 1 -- 172.21.15.70:0/1943609693 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16662 (secure 0 0 0) 0x7f702c057d30 con 0x7f70400b3990 2024-09-13T16:02:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:50.784 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":35,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:02:41.168027+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:02:15.044503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T16:02:15.981176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6837/3554365995":"2024-09-14T16:02:41.167987+0000","172.21.15.70:6835/3554365995":"2024-09-14T16:02:41.167987+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:02:50.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.784+0000 7f7045c00640 1 -- 172.21.15.70:0/1943609693 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f702006ac00 msgr2=0x7f702006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:50.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.784+0000 7f7045c00640 1 --2- 172.21.15.70:0/1943609693 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f702006ac00 0x7f702006d0c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7030005880 tx=0x7f7030009040 comp rx=0 tx=0).stop 2024-09-13T16:02:50.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.784+0000 7f7045c00640 1 -- 172.21.15.70:0/1943609693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70400b3990 msgr2=0x7f7040165bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:50.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.784+0000 7f7045c00640 1 --2- 172.21.15.70:0/1943609693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70400b3990 0x7f7040165bf0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f702c00e840 tx=0x7f702c00ed00 comp rx=0 tx=0).stop 2024-09-13T16:02:50.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.784+0000 7f7045c00640 1 -- 172.21.15.70:0/1943609693 shutdown_connections 2024-09-13T16:02:50.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.784+0000 7f7045c00640 1 --2- 172.21.15.70:0/1943609693 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f702006ac00 0x7f702006d0c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.784+0000 7f7045c00640 1 --2- 172.21.15.70:0/1943609693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7040153b20 0x7f70400cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.784+0000 7f7045c00640 1 --2- 172.21.15.70:0/1943609693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70400b3990 0x7f7040165bf0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.784+0000 7f7045c00640 1 --2- 172.21.15.70:0/1943609693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f704006f660 0x7f70400b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.784+0000 7f7045c00640 1 -- 172.21.15.70:0/1943609693 >> 172.21.15.70:0/1943609693 conn(0x7f70400b0510 msgr2=0x7f70400b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:50.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.784+0000 7f7045c00640 1 -- 172.21.15.70:0/1943609693 shutdown_connections 2024-09-13T16:02:50.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.784+0000 7f7045c00640 1 -- 172.21.15.70:0/1943609693 wait complete. 2024-09-13T16:02:50.801 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:01:06.070694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:02:15.044503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:02:15.981176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:02:50.802 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:02:50.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.954+0000 7f4a57a00640 1 Processor -- start 2024-09-13T16:02:50.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.954+0000 7f4a57a00640 1 -- start start 2024-09-13T16:02:50.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.955+0000 7f4a57a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4a50156f60 0x7f4a5015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:50.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.955+0000 7f4a57a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a50071690 0x7f4a500cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:50.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.955+0000 7f4a57a00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5006f5f0 con 0x7f4a500cafa0 2024-09-13T16:02:50.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.955+0000 7f4a57a00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5015aa30 con 0x7f4a50156f60 2024-09-13T16:02:50.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.955+0000 7f4a57a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a50070450 con 0x7f4a50071690 2024-09-13T16:02:50.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.956+0000 7f4a55000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4a50156f60 0x7f4a5015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:50.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.956+0000 7f4a4fe00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f4a500cafa0 0x7f4a50070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53422/0 (socket says 172.21.15.70:53422) 2024-09-13T16:02:50.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.956+0000 7f4a4fe00640 1 -- 172.21.15.70:0/1240010050 learned_addr learned my addr 172.21.15.70:0/1240010050 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:50.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.956+0000 7f4a55a00640 1 --2- 172.21.15.70:0/1240010050 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a50071690 0x7f4a500cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:50.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.956+0000 7f4a55000640 1 -- 172.21.15.70:0/1240010050 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a50071690 msgr2=0x7f4a500cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:50.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.956+0000 7f4a55000640 1 --2- 172.21.15.70:0/1240010050 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a50071690 0x7f4a500cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.956+0000 7f4a55000640 1 -- 172.21.15.70:0/1240010050 >> v1:172.21.15.70:6789/0 conn(0x7f4a500cafa0 legacy=0x7f4a50070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:50.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.956+0000 7f4a55000640 1 -- 172.21.15.70:0/1240010050 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5006f840 con 0x7f4a50156f60 2024-09-13T16:02:50.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.957+0000 7f4a55000640 1 --2- 172.21.15.70:0/1240010050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a50156f60 0x7f4a5015a4f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4a400097a0 tx=0x7f4a4002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a050ce24b0daf5af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:50.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.957+0000 7f4a4f400640 1 -- 172.21.15.70:0/1240010050 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40032440 con 0x7f4a50156f60 2024-09-13T16:02:50.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.957+0000 7f4a4f400640 1 -- 172.21.15.70:0/1240010050 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a400325a0 con 0x7f4a50156f60 2024-09-13T16:02:50.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.957+0000 7f4a4f400640 1 -- 172.21.15.70:0/1240010050 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40032930 con 0x7f4a50156f60 2024-09-13T16:02:50.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.958+0000 7f4a57a00640 1 -- 172.21.15.70:0/1240010050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a50156f60 msgr2=0x7f4a5015a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:50.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.958+0000 7f4a57a00640 1 --2- 172.21.15.70:0/1240010050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a50156f60 0x7f4a5015a4f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4a400097a0 tx=0x7f4a4002a180 comp rx=0 tx=0).stop 2024-09-13T16:02:50.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.958+0000 7f4a57a00640 1 -- 172.21.15.70:0/1240010050 shutdown_connections 2024-09-13T16:02:50.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.958+0000 7f4a57a00640 1 --2- 172.21.15.70:0/1240010050 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a50071690 0x7f4a500cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.958+0000 7f4a57a00640 1 --2- 172.21.15.70:0/1240010050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a50156f60 0x7f4a5015a4f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.958+0000 7f4a57a00640 1 -- 172.21.15.70:0/1240010050 >> 172.21.15.70:0/1240010050 conn(0x7f4a500b0580 msgr2=0x7f4a500b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:50.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.958+0000 7f4a57a00640 1 -- 172.21.15.70:0/1240010050 shutdown_connections 2024-09-13T16:02:50.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.958+0000 7f4a57a00640 1 -- 172.21.15.70:0/1240010050 wait complete. 2024-09-13T16:02:50.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.960+0000 7f4a57a00640 1 Processor -- start 2024-09-13T16:02:50.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.960+0000 7f4a57a00640 1 -- start start 2024-09-13T16:02:50.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.960+0000 7f4a57a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a50071690 0x7f4a50147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:50.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.960+0000 7f4a57a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a500cafa0 0x7f4a50148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:50.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.960+0000 7f4a57a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a50156f60 0x7f4a50148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:50.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.960+0000 7f4a57a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5014b2b0 con 0x7f4a500cafa0 2024-09-13T16:02:50.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.960+0000 7f4a57a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a50148240 con 0x7f4a50156f60 2024-09-13T16:02:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.960+0000 7f4a57a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5015da80 con 0x7f4a50071690 2024-09-13T16:02:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.961+0000 7f4a4fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a500cafa0 0x7f4a50148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.961+0000 7f4a4fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a500cafa0 0x7f4a50148410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51904/0 (socket says 172.21.15.70:51904) 2024-09-13T16:02:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.961+0000 7f4a4fe00640 1 -- 172.21.15.70:0/45632803 learned_addr learned my addr 172.21.15.70:0/45632803 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.961+0000 7f4a55000640 1 --2- 172.21.15.70:0/45632803 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a50071690 0x7f4a50147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.961+0000 7f4a55a00640 1 --2- 172.21.15.70:0/45632803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a50156f60 0x7f4a50148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.961+0000 7f4a4fe00640 1 -- 172.21.15.70:0/45632803 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a50071690 msgr2=0x7f4a50147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.961+0000 7f4a4fe00640 1 --2- 172.21.15.70:0/45632803 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a50071690 0x7f4a50147d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.961+0000 7f4a4fe00640 1 -- 172.21.15.70:0/45632803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a50156f60 msgr2=0x7f4a50148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.961+0000 7f4a4fe00640 1 --2- 172.21.15.70:0/45632803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a50156f60 0x7f4a50148950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.961+0000 7f4a4fe00640 1 -- 172.21.15.70:0/45632803 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a40009400 con 0x7f4a500cafa0 2024-09-13T16:02:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.961+0000 7f4a4fe00640 1 --2- 172.21.15.70:0/45632803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a500cafa0 0x7f4a50148410 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00c4d0 tx=0x7f4a3c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.961+0000 7f4a4cc00640 1 -- 172.21.15.70:0/45632803 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c005ce0 con 0x7f4a500cafa0 2024-09-13T16:02:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.962+0000 7f4a4cc00640 1 -- 172.21.15.70:0/45632803 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3c005e40 con 0x7f4a500cafa0 2024-09-13T16:02:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.962+0000 7f4a4cc00640 1 -- 172.21.15.70:0/45632803 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c007270 con 0x7f4a500cafa0 2024-09-13T16:02:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.962+0000 7f4a57a00640 1 -- 172.21.15.70:0/45632803 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5014b500 con 0x7f4a500cafa0 2024-09-13T16:02:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.962+0000 7f4a57a00640 1 -- 172.21.15.70:0/45632803 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5014bac0 con 0x7f4a500cafa0 2024-09-13T16:02:50.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.963+0000 7f4a57a00640 1 -- 172.21.15.70:0/45632803 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a500708c0 con 0x7f4a500cafa0 2024-09-13T16:02:50.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.964+0000 7f4a4cc00640 1 -- 172.21.15.70:0/45632803 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4a3c0073d0 con 0x7f4a500cafa0 2024-09-13T16:02:50.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.965+0000 7f4a4cc00640 1 --2- 172.21.15.70:0/45632803 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4a3006ac30 0x7f4a3006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:50.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.965+0000 7f4a4cc00640 1 -- 172.21.15.70:0/45632803 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4a3c0887d0 con 0x7f4a500cafa0 2024-09-13T16:02:50.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.965+0000 7f4a55000640 1 --2- 172.21.15.70:0/45632803 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4a3006ac30 0x7f4a3006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:50.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.966+0000 7f4a55000640 1 --2- 172.21.15.70:0/45632803 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4a3006ac30 0x7f4a3006d0f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4a40034000 tx=0x7f4a4002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:50.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:50.969+0000 7f4a4cc00640 1 -- 172.21.15.70:0/45632803 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4a500708c0 con 0x7f4a500cafa0 2024-09-13T16:02:51.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.135+0000 7f4a57a00640 1 -- 172.21.15.70:0/45632803 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a500708c0 con 0x7f4a500cafa0 2024-09-13T16:02:51.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.136+0000 7f4a4cc00640 1 -- 172.21.15.70:0/45632803 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a500708c0 con 0x7f4a500cafa0 2024-09-13T16:02:51.138 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-13T16:02:51.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.138+0000 7f4a57a00640 1 -- 172.21.15.70:0/45632803 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4a3006ac30 msgr2=0x7f4a3006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:51.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.138+0000 7f4a57a00640 1 --2- 172.21.15.70:0/45632803 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4a3006ac30 0x7f4a3006d0f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4a40034000 tx=0x7f4a4002e000 comp rx=0 tx=0).stop 2024-09-13T16:02:51.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.138+0000 7f4a57a00640 1 -- 172.21.15.70:0/45632803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a500cafa0 msgr2=0x7f4a50148410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:51.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.138+0000 7f4a57a00640 1 --2- 172.21.15.70:0/45632803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a500cafa0 0x7f4a50148410 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00c4d0 tx=0x7f4a3c00c990 comp rx=0 tx=0).stop 2024-09-13T16:02:51.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.138+0000 7f4a57a00640 1 -- 172.21.15.70:0/45632803 shutdown_connections 2024-09-13T16:02:51.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.138+0000 7f4a57a00640 1 --2- 172.21.15.70:0/45632803 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f4a3006ac30 0x7f4a3006d0f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.138+0000 7f4a57a00640 1 --2- 172.21.15.70:0/45632803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a50156f60 0x7f4a50148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.138+0000 7f4a57a00640 1 --2- 172.21.15.70:0/45632803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a500cafa0 0x7f4a50148410 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.138+0000 7f4a57a00640 1 --2- 172.21.15.70:0/45632803 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4a50071690 0x7f4a50147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.138+0000 7f4a57a00640 1 -- 172.21.15.70:0/45632803 >> 172.21.15.70:0/45632803 conn(0x7f4a500b0580 msgr2=0x7f4a500afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:51.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.138+0000 7f4a57a00640 1 -- 172.21.15.70:0/45632803 shutdown_connections 2024-09-13T16:02:51.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.138+0000 7f4a57a00640 1 -- 172.21.15.70:0/45632803 wait complete. 2024-09-13T16:02:51.156 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:02:51.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.313+0000 7fb7a5e00640 1 Processor -- start 2024-09-13T16:02:51.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.313+0000 7fb7a5e00640 1 -- start start 2024-09-13T16:02:51.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.314+0000 7fb7a5e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb7a01566f0 0x7fb7a0070170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:51.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.314+0000 7fb7a5e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb7a00ae060 0x7fb7a015c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:51.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.314+0000 7fb7a5e00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a006fce0 con 0x7fb7a006be40 2024-09-13T16:02:51.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.314+0000 7fb7a5e00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a006c820 con 0x7fb7a00ae060 2024-09-13T16:02:51.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.314+0000 7fb7a5e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a006f690 con 0x7fb7a01566f0 2024-09-13T16:02:51.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.315+0000 7fb79f400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb7a00ae060 0x7fb7a015c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:51.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.315+0000 7fb79e000640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb7a006be40 0x7fb7a00ad950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53426/0 (socket says 172.21.15.70:53426) 2024-09-13T16:02:51.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.315+0000 7fb79e000640 1 -- 172.21.15.70:0/128224611 learned_addr learned my addr 172.21.15.70:0/128224611 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:51.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.315+0000 7fb79ea00640 1 --2- 172.21.15.70:0/128224611 >> v2:172.21.15.107:3300/0 conn(0x7fb7a01566f0 0x7fb7a0070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:51.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.315+0000 7fb79d600640 1 -- 172.21.15.70:0/128224611 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681011419 0 0) 0x7fb7a006fce0 con 0x7fb7a006be40 2024-09-13T16:02:51.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.315+0000 7fb79d600640 1 -- 172.21.15.70:0/128224611 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb784005730 con 0x7fb7a006be40 2024-09-13T16:02:51.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.315+0000 7fb79f400640 1 -- 172.21.15.70:0/128224611 >> v2:172.21.15.107:3300/0 conn(0x7fb7a01566f0 msgr2=0x7fb7a0070170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:51.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.315+0000 7fb79f400640 1 --2- 172.21.15.70:0/128224611 >> v2:172.21.15.107:3300/0 conn(0x7fb7a01566f0 0x7fb7a0070170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.315+0000 7fb79f400640 1 -- 172.21.15.70:0/128224611 >> v1:172.21.15.70:6789/0 conn(0x7fb7a006be40 legacy=0x7fb7a00ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:51.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.315+0000 7fb79f400640 1 -- 172.21.15.70:0/128224611 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a006f970 con 0x7fb7a00ae060 2024-09-13T16:02:51.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.315+0000 7fb79ea00640 1 --2- 172.21.15.70:0/128224611 >> v2:172.21.15.107:3300/0 conn(0x7fb7a01566f0 0x7fb7a0070170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:51.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.316+0000 7fb79f400640 1 --2- 172.21.15.70:0/128224611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7a00ae060 0x7fb7a015c800 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00677f0 tx=0x7fb79802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc4ed09343b3325 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:51.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.316+0000 7fb79d600640 1 -- 172.21.15.70:0/128224611 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79802aea0 con 0x7fb7a00ae060 2024-09-13T16:02:51.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.316+0000 7fb79d600640 1 -- 172.21.15.70:0/128224611 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79802d050 con 0x7fb7a00ae060 2024-09-13T16:02:51.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.316+0000 7fb79d600640 1 -- 172.21.15.70:0/128224611 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb798007960 con 0x7fb7a00ae060 2024-09-13T16:02:51.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.317+0000 7fb7a5e00640 1 -- 172.21.15.70:0/128224611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7a00ae060 msgr2=0x7fb7a015c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:51.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.317+0000 7fb7a5e00640 1 --2- 172.21.15.70:0/128224611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7a00ae060 0x7fb7a015c800 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00677f0 tx=0x7fb79802a680 comp rx=0 tx=0).stop 2024-09-13T16:02:51.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.317+0000 7fb7a5e00640 1 -- 172.21.15.70:0/128224611 shutdown_connections 2024-09-13T16:02:51.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.317+0000 7fb7a5e00640 1 --2- 172.21.15.70:0/128224611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7a00ae060 0x7fb7a015c800 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.317+0000 7fb7a5e00640 1 --2- 172.21.15.70:0/128224611 >> v2:172.21.15.107:3300/0 conn(0x7fb7a01566f0 0x7fb7a0070170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.317+0000 7fb7a5e00640 1 -- 172.21.15.70:0/128224611 >> 172.21.15.70:0/128224611 conn(0x7fb7a00b0580 msgr2=0x7fb7a00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:51.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.317+0000 7fb7a5e00640 1 -- 172.21.15.70:0/128224611 shutdown_connections 2024-09-13T16:02:51.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.317+0000 7fb7a5e00640 1 -- 172.21.15.70:0/128224611 wait complete. 2024-09-13T16:02:51.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.318+0000 7fb7a5e00640 1 Processor -- start 2024-09-13T16:02:51.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.319+0000 7fb7a5e00640 1 -- start start 2024-09-13T16:02:51.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.319+0000 7fb7a5e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7a006be40 0x7fb7a01511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:51.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.319+0000 7fb7a5e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7a00ae060 0x7fb7a00a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:51.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.319+0000 7fb7a5e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7a01566f0 0x7fb7a00a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:51.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.319+0000 7fb7a5e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a00a8460 con 0x7fb7a01566f0 2024-09-13T16:02:51.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.319+0000 7fb7a5e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a00a8740 con 0x7fb7a00ae060 2024-09-13T16:02:51.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.319+0000 7fb7a5e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a00a8a20 con 0x7fb7a006be40 2024-09-13T16:02:51.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.320+0000 7fb79f400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7a01566f0 0x7fb7a00a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:51.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.320+0000 7fb79f400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7a01566f0 0x7fb7a00a9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51922/0 (socket says 172.21.15.70:51922) 2024-09-13T16:02:51.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.320+0000 7fb79f400640 1 -- 172.21.15.70:0/3618764680 learned_addr learned my addr 172.21.15.70:0/3618764680 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:51.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.320+0000 7fb79ea00640 1 --2- 172.21.15.70:0/3618764680 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7a006be40 0x7fb7a01511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:51.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.320+0000 7fb79e000640 1 --2- 172.21.15.70:0/3618764680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7a00ae060 0x7fb7a00a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:51.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.320+0000 7fb79f400640 1 -- 172.21.15.70:0/3618764680 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7a006be40 msgr2=0x7fb7a01511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:51.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.320+0000 7fb79f400640 1 --2- 172.21.15.70:0/3618764680 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7a006be40 0x7fb7a01511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.320+0000 7fb79f400640 1 -- 172.21.15.70:0/3618764680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7a00ae060 msgr2=0x7fb7a00a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:51.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.320+0000 7fb79f400640 1 --2- 172.21.15.70:0/3618764680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7a00ae060 0x7fb7a00a9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.320+0000 7fb79f400640 1 -- 172.21.15.70:0/3618764680 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb790009400 con 0x7fb7a01566f0 2024-09-13T16:02:51.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.320+0000 7fb79ea00640 1 --2- 172.21.15.70:0/3618764680 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7a006be40 0x7fb7a01511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:51.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.320+0000 7fb79e000640 1 --2- 172.21.15.70:0/3618764680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7a00ae060 0x7fb7a00a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:51.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.320+0000 7fb79f400640 1 --2- 172.21.15.70:0/3618764680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7a01566f0 0x7fb7a00a9f40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb79802ac70 tx=0x7fb798004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:51.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.321+0000 7fb797400640 1 -- 172.21.15.70:0/3618764680 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79803c830 con 0x7fb7a01566f0 2024-09-13T16:02:51.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.321+0000 7fb797400640 1 -- 172.21.15.70:0/3618764680 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79803c990 con 0x7fb7a01566f0 2024-09-13T16:02:51.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.321+0000 7fb7a5e00640 1 -- 172.21.15.70:0/3618764680 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb798009a70 con 0x7fb7a01566f0 2024-09-13T16:02:51.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.321+0000 7fb797400640 1 -- 172.21.15.70:0/3618764680 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79803cd00 con 0x7fb7a01566f0 2024-09-13T16:02:51.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.321+0000 7fb7a5e00640 1 -- 172.21.15.70:0/3618764680 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a00a8fe0 con 0x7fb7a01566f0 2024-09-13T16:02:51.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.322+0000 7fb7a5e00640 1 -- 172.21.15.70:0/3618764680 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a00715d0 con 0x7fb7a01566f0 2024-09-13T16:02:51.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.323+0000 7fb797400640 1 -- 172.21.15.70:0/3618764680 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb798031400 con 0x7fb7a01566f0 2024-09-13T16:02:51.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.324+0000 7fb797400640 1 --2- 172.21.15.70:0/3618764680 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb78006ac00 0x7fb78006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:51.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.324+0000 7fb797400640 1 -- 172.21.15.70:0/3618764680 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb7980aade0 con 0x7fb7a01566f0 2024-09-13T16:02:51.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.324+0000 7fb79ea00640 1 --2- 172.21.15.70:0/3618764680 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb78006ac00 0x7fb78006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:51.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.324+0000 7fb79ea00640 1 --2- 172.21.15.70:0/3618764680 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb78006ac00 0x7fb78006d0c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb7a01f1800 tx=0x7fb790008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:51.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.328+0000 7fb797400640 1 -- 172.21.15.70:0/3618764680 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb798076080 con 0x7fb7a01566f0 2024-09-13T16:02:51.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.496+0000 7fb7a5e00640 1 -- 172.21.15.70:0/3618764680 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb7a0070fa0 con 0x7fb7a01566f0 2024-09-13T16:02:51.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.496+0000 7fb797400640 1 -- 172.21.15.70:0/3618764680 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb798040020 con 0x7fb7a01566f0 2024-09-13T16:02:51.499 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-13T16:02:51.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.499+0000 7fb7a5e00640 1 -- 172.21.15.70:0/3618764680 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb78006ac00 msgr2=0x7fb78006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:51.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.499+0000 7fb7a5e00640 1 --2- 172.21.15.70:0/3618764680 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb78006ac00 0x7fb78006d0c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb7a01f1800 tx=0x7fb790008040 comp rx=0 tx=0).stop 2024-09-13T16:02:51.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.499+0000 7fb7a5e00640 1 -- 172.21.15.70:0/3618764680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7a01566f0 msgr2=0x7fb7a00a9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:51.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.499+0000 7fb7a5e00640 1 --2- 172.21.15.70:0/3618764680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7a01566f0 0x7fb7a00a9f40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb79802ac70 tx=0x7fb798004a40 comp rx=0 tx=0).stop 2024-09-13T16:02:51.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.499+0000 7fb7a5e00640 1 -- 172.21.15.70:0/3618764680 shutdown_connections 2024-09-13T16:02:51.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.499+0000 7fb7a5e00640 1 --2- 172.21.15.70:0/3618764680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7a01566f0 0x7fb7a00a9f40 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.499+0000 7fb7a5e00640 1 --2- 172.21.15.70:0/3618764680 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb78006ac00 0x7fb78006d0c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.499+0000 7fb7a5e00640 1 --2- 172.21.15.70:0/3618764680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7a00ae060 0x7fb7a00a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.499+0000 7fb7a5e00640 1 --2- 172.21.15.70:0/3618764680 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7a006be40 0x7fb7a01511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.499+0000 7fb7a5e00640 1 -- 172.21.15.70:0/3618764680 >> 172.21.15.70:0/3618764680 conn(0x7fb7a00b0580 msgr2=0x7fb7a01586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:51.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.499+0000 7fb7a5e00640 1 -- 172.21.15.70:0/3618764680 shutdown_connections 2024-09-13T16:02:51.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.499+0000 7fb7a5e00640 1 -- 172.21.15.70:0/3618764680 wait complete. 2024-09-13T16:02:51.516 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:02:51.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.669+0000 7f2d8aa00640 1 Processor -- start 2024-09-13T16:02:51.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.669+0000 7f2d8aa00640 1 -- start start 2024-09-13T16:02:51.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.670+0000 7f2d8aa00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2d8406f830 0x7f2d8406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:51.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.670+0000 7f2d8aa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d84070420 0x7f2d840cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:51.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.670+0000 7f2d8aa00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d840ce490 con 0x7f2d84154ad0 2024-09-13T16:02:51.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.670+0000 7f2d8aa00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d8406b5b0 con 0x7f2d8406f830 2024-09-13T16:02:51.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.670+0000 7f2d8aa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8406b7c0 con 0x7f2d84070420 2024-09-13T16:02:51.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.670+0000 7f2d7be00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2d8406f830 0x7f2d8406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:51.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.671+0000 7f2d7be00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2d8406f830 0x7f2d8406fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51936/0 (socket says 172.21.15.70:51936) 2024-09-13T16:02:51.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.671+0000 7f2d7be00640 1 -- 172.21.15.70:0/591343938 learned_addr learned my addr 172.21.15.70:0/591343938 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:51.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.671+0000 7f2d88a00640 1 --2- 172.21.15.70:0/591343938 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d84070420 0x7f2d840cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:51.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.671+0000 7f2d7be00640 1 -- 172.21.15.70:0/591343938 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d84070420 msgr2=0x7f2d840cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:51.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.671+0000 7f2d7be00640 1 --2- 172.21.15.70:0/591343938 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d84070420 0x7f2d840cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.671+0000 7f2d7be00640 1 -- 172.21.15.70:0/591343938 >> v1:172.21.15.107:6789/0 conn(0x7f2d84154ad0 legacy=0x7f2d840cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:51.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.671+0000 7f2d7be00640 1 -- 172.21.15.70:0/591343938 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8406baa0 con 0x7f2d8406f830 2024-09-13T16:02:51.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.671+0000 7f2d88a00640 1 --2- 172.21.15.70:0/591343938 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d84070420 0x7f2d840cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:51.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.672+0000 7f2d7be00640 1 --2- 172.21.15.70:0/591343938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d8406f830 0x7f2d8406fee0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009870 tx=0x7f2d6c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c56f82d92256126 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:51.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.672+0000 7f2d83400640 1 -- 172.21.15.70:0/591343938 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c032440 con 0x7f2d8406f830 2024-09-13T16:02:51.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.672+0000 7f2d83400640 1 -- 172.21.15.70:0/591343938 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6c0325a0 con 0x7f2d8406f830 2024-09-13T16:02:51.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.672+0000 7f2d83400640 1 -- 172.21.15.70:0/591343938 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c032930 con 0x7f2d8406f830 2024-09-13T16:02:51.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.673+0000 7f2d8aa00640 1 -- 172.21.15.70:0/591343938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d8406f830 msgr2=0x7f2d8406fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:51.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.673+0000 7f2d8aa00640 1 --2- 172.21.15.70:0/591343938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d8406f830 0x7f2d8406fee0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009870 tx=0x7f2d6c02a1c0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.673+0000 7f2d8aa00640 1 -- 172.21.15.70:0/591343938 shutdown_connections 2024-09-13T16:02:51.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.673+0000 7f2d8aa00640 1 --2- 172.21.15.70:0/591343938 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d84070420 0x7f2d840cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.673+0000 7f2d8aa00640 1 --2- 172.21.15.70:0/591343938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d8406f830 0x7f2d8406fee0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.673+0000 7f2d8aa00640 1 -- 172.21.15.70:0/591343938 >> 172.21.15.70:0/591343938 conn(0x7f2d840b0580 msgr2=0x7f2d840b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:51.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.673+0000 7f2d8aa00640 1 -- 172.21.15.70:0/591343938 shutdown_connections 2024-09-13T16:02:51.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.673+0000 7f2d8aa00640 1 -- 172.21.15.70:0/591343938 wait complete. 2024-09-13T16:02:51.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.675+0000 7f2d8aa00640 1 Processor -- start 2024-09-13T16:02:51.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.675+0000 7f2d8aa00640 1 -- start start 2024-09-13T16:02:51.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.676+0000 7f2d8aa00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d84070420 0x7f2d84146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:51.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.676+0000 7f2d8aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d84154ad0 0x7f2d84146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:51.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.676+0000 7f2d8aa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d841518f0 0x7f2d8414de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:51.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.676+0000 7f2d8aa00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8414d9b0 con 0x7f2d84070420 2024-09-13T16:02:51.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.676+0000 7f2d8aa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d841474f0 con 0x7f2d84154ad0 2024-09-13T16:02:51.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.676+0000 7f2d8aa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84151da0 con 0x7f2d841518f0 2024-09-13T16:02:51.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.676+0000 7f2d83e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d84070420 0x7f2d84146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:51.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.676+0000 7f2d83e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d84070420 0x7f2d84146c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51950/0 (socket says 172.21.15.70:51950) 2024-09-13T16:02:51.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.676+0000 7f2d83e00640 1 -- 172.21.15.70:0/3197412482 learned_addr learned my addr 172.21.15.70:0/3197412482 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:51.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.676+0000 7f2d7be00640 1 --2- 172.21.15.70:0/3197412482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d84154ad0 0x7f2d84146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:51.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.676+0000 7f2d88a00640 1 --2- 172.21.15.70:0/3197412482 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d841518f0 0x7f2d8414de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:51.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.676+0000 7f2d83e00640 1 -- 172.21.15.70:0/3197412482 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d841518f0 msgr2=0x7f2d8414de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:51.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.676+0000 7f2d83e00640 1 --2- 172.21.15.70:0/3197412482 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d841518f0 0x7f2d8414de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.676+0000 7f2d83e00640 1 -- 172.21.15.70:0/3197412482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d84154ad0 msgr2=0x7f2d84146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:51.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.676+0000 7f2d83e00640 1 --2- 172.21.15.70:0/3197412482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d84154ad0 0x7f2d84146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.676+0000 7f2d83e00640 1 -- 172.21.15.70:0/3197412482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c0094d0 con 0x7f2d84070420 2024-09-13T16:02:51.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.676+0000 7f2d88a00640 1 --2- 172.21.15.70:0/3197412482 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d841518f0 0x7f2d8414de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:51.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.677+0000 7f2d83e00640 1 --2- 172.21.15.70:0/3197412482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d84070420 0x7f2d84146c50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400c430 tx=0x7f2d7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:51.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.677+0000 7f2d80c00640 1 -- 172.21.15.70:0/3197412482 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740052d0 con 0x7f2d84070420 2024-09-13T16:02:51.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.677+0000 7f2d80c00640 1 -- 172.21.15.70:0/3197412482 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d74005430 con 0x7f2d84070420 2024-09-13T16:02:51.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.677+0000 7f2d8aa00640 1 -- 172.21.15.70:0/3197412482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8414cda0 con 0x7f2d84070420 2024-09-13T16:02:51.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.677+0000 7f2d80c00640 1 -- 172.21.15.70:0/3197412482 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74003830 con 0x7f2d84070420 2024-09-13T16:02:51.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.677+0000 7f2d8aa00640 1 -- 172.21.15.70:0/3197412482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8414d360 con 0x7f2d84070420 2024-09-13T16:02:51.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.678+0000 7f2d8aa00640 1 -- 172.21.15.70:0/3197412482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8406fee0 con 0x7f2d84070420 2024-09-13T16:02:51.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.679+0000 7f2d80c00640 1 -- 172.21.15.70:0/3197412482 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2d74003990 con 0x7f2d84070420 2024-09-13T16:02:51.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.680+0000 7f2d80c00640 1 --2- 172.21.15.70:0/3197412482 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2d6006ac30 0x7f2d6006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:51.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.680+0000 7f2d80c00640 1 -- 172.21.15.70:0/3197412482 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2d74088930 con 0x7f2d84070420 2024-09-13T16:02:51.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.680+0000 7f2d7be00640 1 --2- 172.21.15.70:0/3197412482 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2d6006ac30 0x7f2d6006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:51.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.681+0000 7f2d7be00640 1 --2- 172.21.15.70:0/3197412482 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2d6006ac30 0x7f2d6006d0f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c034000 tx=0x7f2d6c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:51.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.684+0000 7f2d80c00640 1 -- 172.21.15.70:0/3197412482 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2d74053ac0 con 0x7f2d84070420 2024-09-13T16:02:51.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.852+0000 7f2d8aa00640 1 -- 172.21.15.70:0/3197412482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2d84159880 con 0x7f2d84070420 2024-09-13T16:02:51.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.852+0000 7f2d80c00640 1 -- 172.21.15.70:0/3197412482 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2d740570e0 con 0x7f2d84070420 2024-09-13T16:02:51.854 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-13T16:02:51.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.854+0000 7f2d8aa00640 1 -- 172.21.15.70:0/3197412482 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2d6006ac30 msgr2=0x7f2d6006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:51.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.854+0000 7f2d8aa00640 1 --2- 172.21.15.70:0/3197412482 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2d6006ac30 0x7f2d6006d0f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c034000 tx=0x7f2d6c02e000 comp rx=0 tx=0).stop 2024-09-13T16:02:51.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.854+0000 7f2d8aa00640 1 -- 172.21.15.70:0/3197412482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d84070420 msgr2=0x7f2d84146c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:51.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.854+0000 7f2d8aa00640 1 --2- 172.21.15.70:0/3197412482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d84070420 0x7f2d84146c50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400c430 tx=0x7f2d7400c8f0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.854+0000 7f2d8aa00640 1 -- 172.21.15.70:0/3197412482 shutdown_connections 2024-09-13T16:02:51.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.854+0000 7f2d8aa00640 1 --2- 172.21.15.70:0/3197412482 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d841518f0 0x7f2d8414de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.854+0000 7f2d8aa00640 1 --2- 172.21.15.70:0/3197412482 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f2d6006ac30 0x7f2d6006d0f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.854+0000 7f2d8aa00640 1 --2- 172.21.15.70:0/3197412482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d84154ad0 0x7f2d84146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.854+0000 7f2d8aa00640 1 --2- 172.21.15.70:0/3197412482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d84070420 0x7f2d84146c50 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:51.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.854+0000 7f2d8aa00640 1 -- 172.21.15.70:0/3197412482 >> 172.21.15.70:0/3197412482 conn(0x7f2d840b0580 msgr2=0x7f2d840b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:51.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.855+0000 7f2d8aa00640 1 -- 172.21.15.70:0/3197412482 shutdown_connections 2024-09-13T16:02:51.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:51.855+0000 7f2d8aa00640 1 -- 172.21.15.70:0/3197412482 wait complete. 2024-09-13T16:02:51.872 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:02:52.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.023+0000 7fda06800640 1 Processor -- start 2024-09-13T16:02:52.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.023+0000 7fda06800640 1 -- start start 2024-09-13T16:02:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.024+0000 7fda06800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fda00159480 0x7fda000ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.024+0000 7fda06800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fda00071560 0x7fda000b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.024+0000 7fda06800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda000cd850 con 0x7fda0006f4b0 2024-09-13T16:02:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.024+0000 7fda06800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda000cd570 con 0x7fda00071560 2024-09-13T16:02:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.024+0000 7fda06800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda000b1740 con 0x7fda00159480 2024-09-13T16:02:52.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.025+0000 7fda05e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fda00071560 0x7fda000b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:52.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.025+0000 7fda05e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fda00071560 0x7fda000b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51956/0 (socket says 172.21.15.70:51956) 2024-09-13T16:02:52.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.025+0000 7fda05e00640 1 -- 172.21.15.70:0/1842638940 learned_addr learned my addr 172.21.15.70:0/1842638940 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:52.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.025+0000 7fda05400640 1 --2- 172.21.15.70:0/1842638940 >> v2:172.21.15.107:3300/0 conn(0x7fda00159480 0x7fda000ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:52.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.025+0000 7fda05e00640 1 -- 172.21.15.70:0/1842638940 >> v2:172.21.15.107:3300/0 conn(0x7fda00159480 msgr2=0x7fda000ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:52.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.025+0000 7fda05e00640 1 --2- 172.21.15.70:0/1842638940 >> v2:172.21.15.107:3300/0 conn(0x7fda00159480 0x7fda000ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.025+0000 7fda05e00640 1 -- 172.21.15.70:0/1842638940 >> v1:172.21.15.107:6789/0 conn(0x7fda0006f4b0 legacy=0x7fda00070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:52.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.025+0000 7fda05e00640 1 -- 172.21.15.70:0/1842638940 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda000b1a20 con 0x7fda00071560 2024-09-13T16:02:52.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.026+0000 7fda05e00640 1 --2- 172.21.15.70:0/1842638940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda00071560 0x7fda000b2220 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fda00067270 tx=0x7fd9f802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22913f2e51895b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:52.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.026+0000 7fd9ffe00640 1 -- 172.21.15.70:0/1842638940 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f800b2d0 con 0x7fda00071560 2024-09-13T16:02:52.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.027+0000 7fd9ffe00640 1 -- 172.21.15.70:0/1842638940 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f802f070 con 0x7fda00071560 2024-09-13T16:02:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.027+0000 7fd9ffe00640 1 -- 172.21.15.70:0/1842638940 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8009820 con 0x7fda00071560 2024-09-13T16:02:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.027+0000 7fda06800640 1 -- 172.21.15.70:0/1842638940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda00071560 msgr2=0x7fda000b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.027+0000 7fda06800640 1 --2- 172.21.15.70:0/1842638940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda00071560 0x7fda000b2220 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fda00067270 tx=0x7fd9f802c8b0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.027+0000 7fda06800640 1 -- 172.21.15.70:0/1842638940 shutdown_connections 2024-09-13T16:02:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.027+0000 7fda06800640 1 --2- 172.21.15.70:0/1842638940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda00071560 0x7fda000b2220 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.027+0000 7fda06800640 1 --2- 172.21.15.70:0/1842638940 >> v2:172.21.15.107:3300/0 conn(0x7fda00159480 0x7fda000ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.027+0000 7fda06800640 1 -- 172.21.15.70:0/1842638940 >> 172.21.15.70:0/1842638940 conn(0x7fda000ae310 msgr2=0x7fda000ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.027+0000 7fda06800640 1 -- 172.21.15.70:0/1842638940 shutdown_connections 2024-09-13T16:02:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.027+0000 7fda06800640 1 -- 172.21.15.70:0/1842638940 wait complete. 2024-09-13T16:02:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.029+0000 7fda06800640 1 Processor -- start 2024-09-13T16:02:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.029+0000 7fda06800640 1 -- start start 2024-09-13T16:02:52.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.030+0000 7fda06800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda0006f4b0 0x7fda0014c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:52.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.030+0000 7fda06800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda00071560 0x7fda001ede50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:52.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.030+0000 7fda06800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda00159480 0x7fda00157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:52.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.030+0000 7fda06800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0014cc40 con 0x7fda0006f4b0 2024-09-13T16:02:52.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.030+0000 7fda06800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0014c960 con 0x7fda00159480 2024-09-13T16:02:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.030+0000 7fda06800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0006b5b0 con 0x7fda00071560 2024-09-13T16:02:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.030+0000 7fda05400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda0006f4b0 0x7fda0014c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.030+0000 7fda05400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda0006f4b0 0x7fda0014c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51970/0 (socket says 172.21.15.70:51970) 2024-09-13T16:02:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.030+0000 7fda05400640 1 -- 172.21.15.70:0/793151587 learned_addr learned my addr 172.21.15.70:0/793151587 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.030+0000 7fda04a00640 1 --2- 172.21.15.70:0/793151587 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda00071560 0x7fda001ede50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.030+0000 7fda05e00640 1 --2- 172.21.15.70:0/793151587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda00159480 0x7fda00157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.030+0000 7fda05400640 1 -- 172.21.15.70:0/793151587 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda00071560 msgr2=0x7fda001ede50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.030+0000 7fda05400640 1 --2- 172.21.15.70:0/793151587 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda00071560 0x7fda001ede50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.030+0000 7fda05400640 1 -- 172.21.15.70:0/793151587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda00159480 msgr2=0x7fda00157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.030+0000 7fda05400640 1 --2- 172.21.15.70:0/793151587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda00159480 0x7fda00157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.030+0000 7fda05400640 1 -- 172.21.15.70:0/793151587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f800bd40 con 0x7fda0006f4b0 2024-09-13T16:02:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.030+0000 7fda05e00640 1 --2- 172.21.15.70:0/793151587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda00159480 0x7fda00157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.031+0000 7fda05400640 1 --2- 172.21.15.70:0/793151587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda0006f4b0 0x7fda0014c140 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400d5f0 tx=0x7fd9f400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.031+0000 7fd9fd600640 1 -- 172.21.15.70:0/793151587 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f40125f0 con 0x7fda0006f4b0 2024-09-13T16:02:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.031+0000 7fd9fd600640 1 -- 172.21.15.70:0/793151587 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f4012750 con 0x7fda0006f4b0 2024-09-13T16:02:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.031+0000 7fd9fd600640 1 -- 172.21.15.70:0/793151587 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4012b00 con 0x7fda0006f4b0 2024-09-13T16:02:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.031+0000 7fda06800640 1 -- 172.21.15.70:0/793151587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0006b890 con 0x7fda0006f4b0 2024-09-13T16:02:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.031+0000 7fda06800640 1 -- 172.21.15.70:0/793151587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0006be50 con 0x7fda0006f4b0 2024-09-13T16:02:52.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.032+0000 7fda06800640 1 -- 172.21.15.70:0/793151587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda00067360 con 0x7fda0006f4b0 2024-09-13T16:02:52.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.033+0000 7fd9fd600640 1 -- 172.21.15.70:0/793151587 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd9f4012c60 con 0x7fda0006f4b0 2024-09-13T16:02:52.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.034+0000 7fd9fd600640 1 --2- 172.21.15.70:0/793151587 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd9e006ac30 0x7fd9e006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:52.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.034+0000 7fd9fd600640 1 -- 172.21.15.70:0/793151587 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd9f40897b0 con 0x7fda0006f4b0 2024-09-13T16:02:52.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.034+0000 7fda04a00640 1 --2- 172.21.15.70:0/793151587 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd9e006ac30 0x7fd9e006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:52.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.035+0000 7fda04a00640 1 --2- 172.21.15.70:0/793151587 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd9e006ac30 0x7fd9e006d0f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fda0015c6f0 tx=0x7fd9ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:52.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.038+0000 7fd9fd600640 1 -- 172.21.15.70:0/793151587 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd9f40549c0 con 0x7fda0006f4b0 2024-09-13T16:02:52.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.245+0000 7fda06800640 1 -- 172.21.15.70:0/793151587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda000b2220 con 0x7fda0006f4b0 2024-09-13T16:02:52.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.245+0000 7fd9fd600640 1 -- 172.21.15.70:0/793151587 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4742 (secure 0 0 0) 0x7fd9f4057fe0 con 0x7fda0006f4b0 2024-09-13T16:02:52.248 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:52.248 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2990833970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":2990833970},{"type":"v1","addr":"172.21.15.70:6837","nonce":2990833970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/1247927631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1247927631},{"type":"v1","addr":"172.21.15.70:6836","nonce":1247927631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/1077617661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1077617661},{"type":"v1","addr":"172.21.15.107:6834","nonce":1077617661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:02:16.987283+0000","modified":"2024-09-13T16:02:45.193131+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5124":{"gid":5124,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6835/2709979655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2709979655},{"type":"v1","addr":"172.21.15.107:6835","nonce":2709979655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T16:02:52.248 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 22 2024-09-13T16:02:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.248+0000 7fda06800640 1 -- 172.21.15.70:0/793151587 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd9e006ac30 msgr2=0x7fd9e006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.248+0000 7fda06800640 1 --2- 172.21.15.70:0/793151587 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd9e006ac30 0x7fd9e006d0f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fda0015c6f0 tx=0x7fd9ec009040 comp rx=0 tx=0).stop 2024-09-13T16:02:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.248+0000 7fda06800640 1 -- 172.21.15.70:0/793151587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda0006f4b0 msgr2=0x7fda0014c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.248+0000 7fda06800640 1 --2- 172.21.15.70:0/793151587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda0006f4b0 0x7fda0014c140 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400d5f0 tx=0x7fd9f400dab0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.248+0000 7fda06800640 1 -- 172.21.15.70:0/793151587 shutdown_connections 2024-09-13T16:02:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.248+0000 7fda06800640 1 --2- 172.21.15.70:0/793151587 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd9e006ac30 0x7fd9e006d0f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.248+0000 7fda06800640 1 --2- 172.21.15.70:0/793151587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda00159480 0x7fda00157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.248+0000 7fda06800640 1 --2- 172.21.15.70:0/793151587 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda00071560 0x7fda001ede50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.248+0000 7fda06800640 1 --2- 172.21.15.70:0/793151587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda0006f4b0 0x7fda0014c140 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.248+0000 7fda06800640 1 -- 172.21.15.70:0/793151587 >> 172.21.15.70:0/793151587 conn(0x7fda000ae310 msgr2=0x7fda000af090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:52.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.248+0000 7fda06800640 1 -- 172.21.15.70:0/793151587 shutdown_connections 2024-09-13T16:02:52.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.248+0000 7fda06800640 1 -- 172.21.15.70:0/793151587 wait complete. 2024-09-13T16:02:52.265 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:02:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.417+0000 7fcd52400640 1 Processor -- start 2024-09-13T16:02:52.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.417+0000 7fcd52400640 1 -- start start 2024-09-13T16:02:52.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.418+0000 7fcd52400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcd4c153b20 0x7fcd4c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:52.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.418+0000 7fcd52400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd4c06f660 0x7fcd4c06fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:52.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.418+0000 7fcd52400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd4c153f00 con 0x7fcd4c159a80 2024-09-13T16:02:52.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.418+0000 7fcd52400640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd4c0ce600 con 0x7fcd4c153b20 2024-09-13T16:02:52.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.418+0000 7fcd52400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c070f90 con 0x7fcd4c06f660 2024-09-13T16:02:52.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.418+0000 7fcd4b400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcd4c153b20 0x7fcd4c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:52.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.418+0000 7fcd4b400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcd4c153b20 0x7fcd4c0b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51976/0 (socket says 172.21.15.70:51976) 2024-09-13T16:02:52.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.418+0000 7fcd4b400640 1 -- 172.21.15.70:0/597978888 learned_addr learned my addr 172.21.15.70:0/597978888 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:52.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.419+0000 7fcd4be00640 1 --2- 172.21.15.70:0/597978888 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd4c06f660 0x7fcd4c06fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:52.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.419+0000 7fcd4b400640 1 -- 172.21.15.70:0/597978888 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd4c06f660 msgr2=0x7fcd4c06fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:52.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.419+0000 7fcd4b400640 1 --2- 172.21.15.70:0/597978888 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd4c06f660 0x7fcd4c06fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.419+0000 7fcd4b400640 1 -- 172.21.15.70:0/597978888 >> v1:172.21.15.107:6789/0 conn(0x7fcd4c159a80 legacy=0x7fcd4c0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:52.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.419+0000 7fcd4b400640 1 -- 172.21.15.70:0/597978888 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c0b1a40 con 0x7fcd4c153b20 2024-09-13T16:02:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.419+0000 7fcd4be00640 1 --2- 172.21.15.70:0/597978888 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd4c06f660 0x7fcd4c06fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.420+0000 7fcd4b400640 1 --2- 172.21.15.70:0/597978888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd4c153b20 0x7fcd4c0b3990 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0098a0 tx=0x7fcd3c02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681f8bf63dbec89 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.420+0000 7fcd4a000640 1 -- 172.21.15.70:0/597978888 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c032440 con 0x7fcd4c153b20 2024-09-13T16:02:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.420+0000 7fcd4a000640 1 -- 172.21.15.70:0/597978888 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c0325a0 con 0x7fcd4c153b20 2024-09-13T16:02:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.420+0000 7fcd4a000640 1 -- 172.21.15.70:0/597978888 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c032930 con 0x7fcd4c153b20 2024-09-13T16:02:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.421+0000 7fcd52400640 1 -- 172.21.15.70:0/597978888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd4c153b20 msgr2=0x7fcd4c0b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.421+0000 7fcd52400640 1 --2- 172.21.15.70:0/597978888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd4c153b20 0x7fcd4c0b3990 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0098a0 tx=0x7fcd3c02a290 comp rx=0 tx=0).stop 2024-09-13T16:02:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.421+0000 7fcd52400640 1 -- 172.21.15.70:0/597978888 shutdown_connections 2024-09-13T16:02:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.421+0000 7fcd52400640 1 --2- 172.21.15.70:0/597978888 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd4c06f660 0x7fcd4c06fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.421+0000 7fcd52400640 1 --2- 172.21.15.70:0/597978888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd4c153b20 0x7fcd4c0b3990 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.421+0000 7fcd52400640 1 -- 172.21.15.70:0/597978888 >> 172.21.15.70:0/597978888 conn(0x7fcd4c0b0510 msgr2=0x7fcd4c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.421+0000 7fcd52400640 1 -- 172.21.15.70:0/597978888 shutdown_connections 2024-09-13T16:02:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.421+0000 7fcd52400640 1 -- 172.21.15.70:0/597978888 wait complete. 2024-09-13T16:02:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.422+0000 7fcd52400640 1 Processor -- start 2024-09-13T16:02:52.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.423+0000 7fcd52400640 1 -- start start 2024-09-13T16:02:52.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.423+0000 7fcd52400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd4c06f660 0x7fcd4c150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:52.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.423+0000 7fcd52400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd4c153b20 0x7fcd4c14f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:52.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.423+0000 7fcd52400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd4c159a80 0x7fcd4c152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:52.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.423+0000 7fcd52400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c151440 con 0x7fcd4c06f660 2024-09-13T16:02:52.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.423+0000 7fcd52400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c1f22b0 con 0x7fcd4c159a80 2024-09-13T16:02:52.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.423+0000 7fcd52400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c14fbe0 con 0x7fcd4c153b20 2024-09-13T16:02:52.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.424+0000 7fcd4b400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd4c06f660 0x7fcd4c150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:52.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.424+0000 7fcd4b400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd4c06f660 0x7fcd4c150f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51982/0 (socket says 172.21.15.70:51982) 2024-09-13T16:02:52.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.424+0000 7fcd4b400640 1 -- 172.21.15.70:0/1620476511 learned_addr learned my addr 172.21.15.70:0/1620476511 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:52.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.424+0000 7fcd4b400640 1 -- 172.21.15.70:0/1620476511 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd4c153b20 msgr2=0x7fcd4c14f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:52.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.424+0000 7fcd4b400640 1 --2- 172.21.15.70:0/1620476511 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd4c153b20 0x7fcd4c14f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.424+0000 7fcd4b400640 1 -- 172.21.15.70:0/1620476511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd4c159a80 msgr2=0x7fcd4c152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:52.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.424+0000 7fcd4b400640 1 --2- 172.21.15.70:0/1620476511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd4c159a80 0x7fcd4c152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.424+0000 7fcd4b400640 1 -- 172.21.15.70:0/1620476511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c0094d0 con 0x7fcd4c06f660 2024-09-13T16:02:52.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.424+0000 7fcd4b400640 1 --2- 172.21.15.70:0/1620476511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd4c06f660 0x7fcd4c150f00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0098a0 tx=0x7fcd3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:52.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.425+0000 7fcd43400640 1 -- 172.21.15.70:0/1620476511 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c032440 con 0x7fcd4c06f660 2024-09-13T16:02:52.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.425+0000 7fcd43400640 1 -- 172.21.15.70:0/1620476511 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c030b80 con 0x7fcd4c06f660 2024-09-13T16:02:52.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.425+0000 7fcd43400640 1 -- 172.21.15.70:0/1620476511 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c03d440 con 0x7fcd4c06f660 2024-09-13T16:02:52.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.425+0000 7fcd52400640 1 -- 172.21.15.70:0/1620476511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4c1f2570 con 0x7fcd4c06f660 2024-09-13T16:02:52.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.425+0000 7fcd52400640 1 -- 172.21.15.70:0/1620476511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4c1f2b30 con 0x7fcd4c06f660 2024-09-13T16:02:52.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.426+0000 7fcd52400640 1 -- 172.21.15.70:0/1620476511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4c0b3990 con 0x7fcd4c06f660 2024-09-13T16:02:52.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.427+0000 7fcd43400640 1 -- 172.21.15.70:0/1620476511 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcd3c039040 con 0x7fcd4c06f660 2024-09-13T16:02:52.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.427+0000 7fcd43400640 1 --2- 172.21.15.70:0/1620476511 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fcd2c06ac00 0x7fcd2c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:52.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.428+0000 7fcd43400640 1 -- 172.21.15.70:0/1620476511 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fcd3c0a9e60 con 0x7fcd4c06f660 2024-09-13T16:02:52.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.428+0000 7fcd4aa00640 1 --2- 172.21.15.70:0/1620476511 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fcd2c06ac00 0x7fcd2c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:52.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.428+0000 7fcd4aa00640 1 --2- 172.21.15.70:0/1620476511 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fcd2c06ac00 0x7fcd2c06d0c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcd38000f60 tx=0x7fcd380079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:52.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.431+0000 7fcd43400640 1 -- 172.21.15.70:0/1620476511 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcd3c075070 con 0x7fcd4c06f660 2024-09-13T16:02:52.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.602+0000 7fcd52400640 1 -- 172.21.15.70:0/1620476511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd4c0cc100 con 0x7fcd4c06f660 2024-09-13T16:02:52.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.603+0000 7fcd43400640 1 -- 172.21.15.70:0/1620476511 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16662 (secure 0 0 0) 0x7fcd3c041090 con 0x7fcd4c06f660 2024-09-13T16:02:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:52.605 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":35,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:02:41.168027+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:02:15.044503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T16:02:15.981176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6837/3554365995":"2024-09-14T16:02:41.167987+0000","172.21.15.70:6835/3554365995":"2024-09-14T16:02:41.167987+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:02:52.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.605+0000 7fcd52400640 1 -- 172.21.15.70:0/1620476511 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fcd2c06ac00 msgr2=0x7fcd2c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:52.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.605+0000 7fcd52400640 1 --2- 172.21.15.70:0/1620476511 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fcd2c06ac00 0x7fcd2c06d0c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcd38000f60 tx=0x7fcd380079b0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.605+0000 7fcd52400640 1 -- 172.21.15.70:0/1620476511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd4c06f660 msgr2=0x7fcd4c150f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:52.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.605+0000 7fcd52400640 1 --2- 172.21.15.70:0/1620476511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd4c06f660 0x7fcd4c150f00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0098a0 tx=0x7fcd3c0046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.605+0000 7fcd52400640 1 -- 172.21.15.70:0/1620476511 shutdown_connections 2024-09-13T16:02:52.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.605+0000 7fcd52400640 1 --2- 172.21.15.70:0/1620476511 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fcd2c06ac00 0x7fcd2c06d0c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.605+0000 7fcd52400640 1 --2- 172.21.15.70:0/1620476511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd4c159a80 0x7fcd4c152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.605+0000 7fcd52400640 1 --2- 172.21.15.70:0/1620476511 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcd4c153b20 0x7fcd4c14f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.605+0000 7fcd52400640 1 --2- 172.21.15.70:0/1620476511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd4c06f660 0x7fcd4c150f00 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.605+0000 7fcd52400640 1 -- 172.21.15.70:0/1620476511 >> 172.21.15.70:0/1620476511 conn(0x7fcd4c0b0510 msgr2=0x7fcd4c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:52.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.605+0000 7fcd52400640 1 -- 172.21.15.70:0/1620476511 shutdown_connections 2024-09-13T16:02:52.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.605+0000 7fcd52400640 1 -- 172.21.15.70:0/1620476511 wait complete. 2024-09-13T16:02:52.624 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T16:02:52.624 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:02:52.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.774+0000 7f629c600640 1 Processor -- start 2024-09-13T16:02:52.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.774+0000 7f629c600640 1 -- start start 2024-09-13T16:02:52.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.775+0000 7f629c600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f62940b1e40 0x7f6294159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:52.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.775+0000 7f629c600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62940b2220 0x7f62940b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:52.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.775+0000 7f629c600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629415a430 con 0x7f62940b2660 2024-09-13T16:02:52.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.775+0000 7f629c600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62941598b0 con 0x7f62940b1e40 2024-09-13T16:02:52.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.775+0000 7f629c600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6294159b90 con 0x7f62940b2220 2024-09-13T16:02:52.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.776+0000 7f6299200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62940b2220 0x7f62940b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:52.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.776+0000 7f629a600640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f62940b2660 0x7f629406b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:34620/0 (socket says 172.21.15.70:34620) 2024-09-13T16:02:52.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.776+0000 7f6299200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62940b2220 0x7f62940b2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:47244/0 (socket says 172.21.15.70:47244) 2024-09-13T16:02:52.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.776+0000 7f6299c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f62940b1e40 0x7f6294159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:52.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.776+0000 7f6299200640 1 -- 172.21.15.70:0/2001908836 learned_addr learned my addr 172.21.15.70:0/2001908836 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:52.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.776+0000 7f6299c00640 1 -- 172.21.15.70:0/2001908836 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62940b2220 msgr2=0x7f62940b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:52.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.776+0000 7f6299c00640 1 --2- 172.21.15.70:0/2001908836 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62940b2220 0x7f62940b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.776+0000 7f6299c00640 1 -- 172.21.15.70:0/2001908836 >> v1:172.21.15.107:6789/0 conn(0x7f62940b2660 legacy=0x7f629406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:52.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.776+0000 7f6299c00640 1 -- 172.21.15.70:0/2001908836 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6294159e70 con 0x7f62940b1e40 2024-09-13T16:02:52.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.776+0000 7f6299200640 1 --2- 172.21.15.70:0/2001908836 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62940b2220 0x7f62940b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:52.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.778+0000 7f6299c00640 1 --2- 172.21.15.70:0/2001908836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62940b1e40 0x7f6294159210 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f62880097a0 tx=0x7f628802a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f754f867f9c287b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:52.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.778+0000 7f6293e00640 1 -- 172.21.15.70:0/2001908836 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628802ae40 con 0x7f62940b1e40 2024-09-13T16:02:52.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.778+0000 7f6293e00640 1 -- 172.21.15.70:0/2001908836 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6288032440 con 0x7f62940b1e40 2024-09-13T16:02:52.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.778+0000 7f6293e00640 1 -- 172.21.15.70:0/2001908836 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62880327d0 con 0x7f62940b1e40 2024-09-13T16:02:52.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.778+0000 7f629c600640 1 -- 172.21.15.70:0/2001908836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62940b1e40 msgr2=0x7f6294159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:52.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.778+0000 7f629c600640 1 --2- 172.21.15.70:0/2001908836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62940b1e40 0x7f6294159210 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f62880097a0 tx=0x7f628802a0f0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.778+0000 7f629c600640 1 -- 172.21.15.70:0/2001908836 shutdown_connections 2024-09-13T16:02:52.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.778+0000 7f629c600640 1 --2- 172.21.15.70:0/2001908836 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62940b2220 0x7f62940b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.778+0000 7f629c600640 1 --2- 172.21.15.70:0/2001908836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62940b1e40 0x7f6294159210 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.778+0000 7f629c600640 1 -- 172.21.15.70:0/2001908836 >> 172.21.15.70:0/2001908836 conn(0x7f62940b0510 msgr2=0x7f62940b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:52.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.779+0000 7f629c600640 1 -- 172.21.15.70:0/2001908836 shutdown_connections 2024-09-13T16:02:52.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.779+0000 7f629c600640 1 -- 172.21.15.70:0/2001908836 wait complete. 2024-09-13T16:02:52.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.780+0000 7f629c600640 1 Processor -- start 2024-09-13T16:02:52.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.780+0000 7f629c600640 1 -- start start 2024-09-13T16:02:52.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.781+0000 7f629c600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62940b1e40 0x7f6294157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:52.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.781+0000 7f629c600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62940b2220 0x7f6294158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:52.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.781+0000 7f629c600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62940b2660 0x7f629413c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:52.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.781+0000 7f629c600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62940a9810 con 0x7f62940b2660 2024-09-13T16:02:52.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.781+0000 7f629c600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629413edc0 con 0x7f62940b2220 2024-09-13T16:02:52.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.781+0000 7f629c600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629413f0a0 con 0x7f62940b1e40 2024-09-13T16:02:52.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.781+0000 7f629a600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62940b2660 0x7f629413c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:52.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.781+0000 7f629a600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62940b2660 0x7f629413c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51990/0 (socket says 172.21.15.70:51990) 2024-09-13T16:02:52.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.781+0000 7f6299200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62940b2220 0x7f6294158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:52.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.781+0000 7f629a600640 1 -- 172.21.15.70:0/3740114820 learned_addr learned my addr 172.21.15.70:0/3740114820 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:52.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.781+0000 7f6299c00640 1 --2- 172.21.15.70:0/3740114820 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62940b1e40 0x7f6294157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:52.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.782+0000 7f629a600640 1 -- 172.21.15.70:0/3740114820 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62940b1e40 msgr2=0x7f6294157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:52.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.782+0000 7f629a600640 1 --2- 172.21.15.70:0/3740114820 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62940b1e40 0x7f6294157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.782+0000 7f629a600640 1 -- 172.21.15.70:0/3740114820 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62940b2220 msgr2=0x7f6294158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:52.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.782+0000 7f629a600640 1 --2- 172.21.15.70:0/3740114820 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62940b2220 0x7f6294158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.782+0000 7f629a600640 1 -- 172.21.15.70:0/3740114820 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62800094d0 con 0x7f62940b2660 2024-09-13T16:02:52.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.782+0000 7f629a600640 1 --2- 172.21.15.70:0/3740114820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62940b2660 0x7f629413c1d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c730 tx=0x7f628c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:52.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.782+0000 7f6291600640 1 -- 172.21.15.70:0/3740114820 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c00ce40 con 0x7f62940b2660 2024-09-13T16:02:52.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.782+0000 7f6291600640 1 -- 172.21.15.70:0/3740114820 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c00a640 con 0x7f62940b2660 2024-09-13T16:02:52.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.782+0000 7f629c600640 1 -- 172.21.15.70:0/3740114820 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6288009400 con 0x7f62940b2660 2024-09-13T16:02:52.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.782+0000 7f6291600640 1 -- 172.21.15.70:0/3740114820 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c00a9f0 con 0x7f62940b2660 2024-09-13T16:02:52.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.783+0000 7f629c600640 1 -- 172.21.15.70:0/3740114820 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629413f660 con 0x7f62940b2660 2024-09-13T16:02:52.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.784+0000 7f629c600640 1 -- 172.21.15.70:0/3740114820 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62940adad0 con 0x7f62940b2660 2024-09-13T16:02:52.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.784+0000 7f6291600640 1 -- 172.21.15.70:0/3740114820 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f628c00ab50 con 0x7f62940b2660 2024-09-13T16:02:52.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.786+0000 7f6291600640 1 --2- 172.21.15.70:0/3740114820 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f627406ac00 0x7f627406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:52.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.786+0000 7f6291600640 1 -- 172.21.15.70:0/3740114820 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f628c088a50 con 0x7f62940b2660 2024-09-13T16:02:52.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.786+0000 7f6299c00640 1 --2- 172.21.15.70:0/3740114820 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f627406ac00 0x7f627406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:52.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.787+0000 7f6299c00640 1 --2- 172.21.15.70:0/3740114820 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f627406ac00 0x7f627406d0c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6288034000 tx=0x7f628802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:52.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.790+0000 7f6291600640 1 -- 172.21.15.70:0/3740114820 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f628c053c70 con 0x7f62940b2660 2024-09-13T16:02:52.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.992+0000 7f629c600640 1 -- 172.21.15.70:0/3740114820 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6294159210 con 0x7f62940b2660 2024-09-13T16:02:52.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.993+0000 7f6291600640 1 -- 172.21.15.70:0/3740114820 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f628c017020 con 0x7f62940b2660 2024-09-13T16:02:52.995 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:52.995 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2990833970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":2990833970},{"type":"v1","addr":"172.21.15.70:6837","nonce":2990833970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/1247927631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1247927631},{"type":"v1","addr":"172.21.15.70:6836","nonce":1247927631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/1077617661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1077617661},{"type":"v1","addr":"172.21.15.107:6834","nonce":1077617661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:02:16.987283+0000","modified":"2024-09-13T16:02:45.193131+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5124":{"gid":5124,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6835/2709979655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2709979655},{"type":"v1","addr":"172.21.15.107:6835","nonce":2709979655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T16:02:52.995 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 22 2024-09-13T16:02:52.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.995+0000 7f629c600640 1 -- 172.21.15.70:0/3740114820 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f627406ac00 msgr2=0x7f627406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:52.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.995+0000 7f629c600640 1 --2- 172.21.15.70:0/3740114820 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f627406ac00 0x7f627406d0c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6288034000 tx=0x7f628802e000 comp rx=0 tx=0).stop 2024-09-13T16:02:52.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.995+0000 7f629c600640 1 -- 172.21.15.70:0/3740114820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62940b2660 msgr2=0x7f629413c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:52.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.995+0000 7f629c600640 1 --2- 172.21.15.70:0/3740114820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62940b2660 0x7f629413c1d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c730 tx=0x7f628c00cbf0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.995+0000 7f629c600640 1 -- 172.21.15.70:0/3740114820 shutdown_connections 2024-09-13T16:02:52.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.995+0000 7f629c600640 1 --2- 172.21.15.70:0/3740114820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62940b2660 0x7f629413c1d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.995+0000 7f629c600640 1 --2- 172.21.15.70:0/3740114820 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f627406ac00 0x7f627406d0c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.995+0000 7f629c600640 1 --2- 172.21.15.70:0/3740114820 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62940b2220 0x7f6294158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.995+0000 7f629c600640 1 --2- 172.21.15.70:0/3740114820 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62940b1e40 0x7f6294157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:52.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.995+0000 7f629c600640 1 -- 172.21.15.70:0/3740114820 >> 172.21.15.70:0/3740114820 conn(0x7f62940b0510 msgr2=0x7f62940af880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:52.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.995+0000 7f629c600640 1 -- 172.21.15.70:0/3740114820 shutdown_connections 2024-09-13T16:02:52.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:52.995+0000 7f629c600640 1 -- 172.21.15.70:0/3740114820 wait complete. 2024-09-13T16:02:53.014 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:02:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.162+0000 7f1923200640 1 Processor -- start 2024-09-13T16:02:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.163+0000 7f1923200640 1 -- start start 2024-09-13T16:02:53.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.164+0000 7f1923200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1924159480 0x7f19240ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:53.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.164+0000 7f1923200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f192406f4b0 0x7f1924070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:53.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.164+0000 7f1923200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19240717c0 con 0x7f1924071390 2024-09-13T16:02:53.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.164+0000 7f1923200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19240cd850 con 0x7f192406f4b0 2024-09-13T16:02:53.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.164+0000 7f1923200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19240cd570 con 0x7f1924159480 2024-09-13T16:02:53.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.164+0000 7f1919400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f192406f4b0 0x7f1924070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:53.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.164+0000 7f1919400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f192406f4b0 0x7f1924070e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52006/0 (socket says 172.21.15.70:52006) 2024-09-13T16:02:53.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.164+0000 7f1919400640 1 -- 172.21.15.70:0/2544628288 learned_addr learned my addr 172.21.15.70:0/2544628288 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:53.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.164+0000 7f1921e00640 1 --2- 172.21.15.70:0/2544628288 >> v2:172.21.15.107:3300/0 conn(0x7f1924159480 0x7f19240ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:53.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.165+0000 7f1919400640 1 -- 172.21.15.70:0/2544628288 >> v2:172.21.15.107:3300/0 conn(0x7f1924159480 msgr2=0x7f19240ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:53.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.165+0000 7f1919400640 1 --2- 172.21.15.70:0/2544628288 >> v2:172.21.15.107:3300/0 conn(0x7f1924159480 0x7f19240ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.165+0000 7f1919400640 1 -- 172.21.15.70:0/2544628288 >> v1:172.21.15.107:6789/0 conn(0x7f1924071390 legacy=0x7f192415ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:53.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.165+0000 7f1919400640 1 -- 172.21.15.70:0/2544628288 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19240b1740 con 0x7f192406f4b0 2024-09-13T16:02:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.166+0000 7f1919400640 1 --2- 172.21.15.70:0/2544628288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192406f4b0 0x7f1924070e50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1924067270 tx=0x7f190c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb189f604ed1ef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.166+0000 7f1921400640 1 -- 172.21.15.70:0/2544628288 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c032440 con 0x7f192406f4b0 2024-09-13T16:02:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.166+0000 7f1921400640 1 -- 172.21.15.70:0/2544628288 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c0325a0 con 0x7f192406f4b0 2024-09-13T16:02:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.166+0000 7f1921400640 1 -- 172.21.15.70:0/2544628288 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c032930 con 0x7f192406f4b0 2024-09-13T16:02:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.167+0000 7f1923200640 1 -- 172.21.15.70:0/2544628288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192406f4b0 msgr2=0x7f1924070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.167+0000 7f1923200640 1 --2- 172.21.15.70:0/2544628288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192406f4b0 0x7f1924070e50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1924067270 tx=0x7f190c02a200 comp rx=0 tx=0).stop 2024-09-13T16:02:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.167+0000 7f1923200640 1 -- 172.21.15.70:0/2544628288 shutdown_connections 2024-09-13T16:02:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.167+0000 7f1923200640 1 --2- 172.21.15.70:0/2544628288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192406f4b0 0x7f1924070e50 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.167+0000 7f1923200640 1 --2- 172.21.15.70:0/2544628288 >> v2:172.21.15.107:3300/0 conn(0x7f1924159480 0x7f19240ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.167+0000 7f1923200640 1 -- 172.21.15.70:0/2544628288 >> 172.21.15.70:0/2544628288 conn(0x7f19240ae310 msgr2=0x7f19240ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:53.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.167+0000 7f1923200640 1 -- 172.21.15.70:0/2544628288 shutdown_connections 2024-09-13T16:02:53.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.167+0000 7f1923200640 1 -- 172.21.15.70:0/2544628288 wait complete. 2024-09-13T16:02:53.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.168+0000 7f1923200640 1 Processor -- start 2024-09-13T16:02:53.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.168+0000 7f1923200640 1 -- start start 2024-09-13T16:02:53.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.169+0000 7f1923200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192406f4b0 0x7f1924145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:53.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.169+0000 7f1923200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1924071390 0x7f19241489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:53.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.169+0000 7f1923200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1924159480 0x7f192414a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:53.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.169+0000 7f1923200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192415a200 con 0x7f192406f4b0 2024-09-13T16:02:53.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.169+0000 7f1923200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1924146160 con 0x7f1924159480 2024-09-13T16:02:53.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.169+0000 7f1923200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1924157d60 con 0x7f1924071390 2024-09-13T16:02:53.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.169+0000 7f1921e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192406f4b0 0x7f1924145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:53.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.169+0000 7f1921e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192406f4b0 0x7f1924145c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52014/0 (socket says 172.21.15.70:52014) 2024-09-13T16:02:53.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.170+0000 7f1921e00640 1 -- 172.21.15.70:0/112621865 learned_addr learned my addr 172.21.15.70:0/112621865 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:53.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.170+0000 7f1919400640 1 --2- 172.21.15.70:0/112621865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1924071390 0x7f19241489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:53.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.170+0000 7f1922800640 1 --2- 172.21.15.70:0/112621865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1924159480 0x7f192414a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:53.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.170+0000 7f1921e00640 1 -- 172.21.15.70:0/112621865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1924071390 msgr2=0x7f19241489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:53.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.170+0000 7f1921e00640 1 --2- 172.21.15.70:0/112621865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1924071390 0x7f19241489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.170+0000 7f1921e00640 1 -- 172.21.15.70:0/112621865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1924159480 msgr2=0x7f192414a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:53.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.170+0000 7f1921e00640 1 --2- 172.21.15.70:0/112621865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1924159480 0x7f192414a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.170+0000 7f1921e00640 1 -- 172.21.15.70:0/112621865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190c0094d0 con 0x7f192406f4b0 2024-09-13T16:02:53.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.170+0000 7f1921e00640 1 --2- 172.21.15.70:0/112621865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192406f4b0 0x7f1924145c20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f191400e870 tx=0x7f191400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:53.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.170+0000 7f191aa00640 1 -- 172.21.15.70:0/112621865 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19140094f0 con 0x7f192406f4b0 2024-09-13T16:02:53.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.170+0000 7f191aa00640 1 -- 172.21.15.70:0/112621865 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191400c8e0 con 0x7f192406f4b0 2024-09-13T16:02:53.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.170+0000 7f1923200640 1 -- 172.21.15.70:0/112621865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1924158040 con 0x7f192406f4b0 2024-09-13T16:02:53.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.170+0000 7f191aa00640 1 -- 172.21.15.70:0/112621865 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191400cc90 con 0x7f192406f4b0 2024-09-13T16:02:53.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.171+0000 7f1923200640 1 -- 172.21.15.70:0/112621865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192414b2f0 con 0x7f192406f4b0 2024-09-13T16:02:53.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.172+0000 7f1923200640 1 -- 172.21.15.70:0/112621865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1924067360 con 0x7f192406f4b0 2024-09-13T16:02:53.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.172+0000 7f191aa00640 1 -- 172.21.15.70:0/112621865 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1914013470 con 0x7f192406f4b0 2024-09-13T16:02:53.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.174+0000 7f191aa00640 1 --2- 172.21.15.70:0/112621865 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f190006ac00 0x7f190006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:53.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.174+0000 7f191aa00640 1 -- 172.21.15.70:0/112621865 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f1914089430 con 0x7f192406f4b0 2024-09-13T16:02:53.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.174+0000 7f1919400640 1 --2- 172.21.15.70:0/112621865 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f190006ac00 0x7f190006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:53.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.174+0000 7f1919400640 1 --2- 172.21.15.70:0/112621865 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f190006ac00 0x7f190006d0c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f190c034000 tx=0x7f190c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:53.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.178+0000 7f191aa00640 1 -- 172.21.15.70:0/112621865 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f19140545a0 con 0x7f192406f4b0 2024-09-13T16:02:53.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.380+0000 7f1923200640 1 -- 172.21.15.70:0/112621865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19240aec20 con 0x7f192406f4b0 2024-09-13T16:02:53.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.381+0000 7f191aa00640 1 -- 172.21.15.70:0/112621865 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f1914057bc0 con 0x7f192406f4b0 2024-09-13T16:02:53.383 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:53.383 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2990833970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":2990833970},{"type":"v1","addr":"172.21.15.70:6837","nonce":2990833970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/1247927631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1247927631},{"type":"v1","addr":"172.21.15.70:6836","nonce":1247927631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/1077617661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1077617661},{"type":"v1","addr":"172.21.15.107:6834","nonce":1077617661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:02:16.987283+0000","modified":"2024-09-13T16:02:45.193131+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5124":{"gid":5124,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6835/2709979655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2709979655},{"type":"v1","addr":"172.21.15.107:6835","nonce":2709979655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T16:02:53.383 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 22 2024-09-13T16:02:53.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.383+0000 7f1923200640 1 -- 172.21.15.70:0/112621865 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f190006ac00 msgr2=0x7f190006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.383+0000 7f1923200640 1 --2- 172.21.15.70:0/112621865 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f190006ac00 0x7f190006d0c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f190c034000 tx=0x7f190c02e000 comp rx=0 tx=0).stop 2024-09-13T16:02:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.383+0000 7f1923200640 1 -- 172.21.15.70:0/112621865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192406f4b0 msgr2=0x7f1924145c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.383+0000 7f1923200640 1 --2- 172.21.15.70:0/112621865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192406f4b0 0x7f1924145c20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f191400e870 tx=0x7f191400ed30 comp rx=0 tx=0).stop 2024-09-13T16:02:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.383+0000 7f1923200640 1 -- 172.21.15.70:0/112621865 shutdown_connections 2024-09-13T16:02:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.383+0000 7f1923200640 1 --2- 172.21.15.70:0/112621865 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f190006ac00 0x7f190006d0c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.383+0000 7f1923200640 1 --2- 172.21.15.70:0/112621865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1924159480 0x7f192414a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.383+0000 7f1923200640 1 --2- 172.21.15.70:0/112621865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1924071390 0x7f19241489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.383+0000 7f1923200640 1 --2- 172.21.15.70:0/112621865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192406f4b0 0x7f1924145c20 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.383+0000 7f1923200640 1 -- 172.21.15.70:0/112621865 >> 172.21.15.70:0/112621865 conn(0x7f19240ae310 msgr2=0x7f19240ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.383+0000 7f1923200640 1 -- 172.21.15.70:0/112621865 shutdown_connections 2024-09-13T16:02:53.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.383+0000 7f1923200640 1 -- 172.21.15.70:0/112621865 wait complete. 2024-09-13T16:02:53.401 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:02:53.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.550+0000 7f3217e00640 1 Processor -- start 2024-09-13T16:02:53.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.551+0000 7f3217e00640 1 -- start start 2024-09-13T16:02:53.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.552+0000 7f3217e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3218159480 0x7f32180ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:53.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.552+0000 7f3217e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f321806f4b0 0x7f3218070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:53.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.552+0000 7f3217e00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32180717c0 con 0x7f3218071390 2024-09-13T16:02:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.552+0000 7f3217e00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32180cd850 con 0x7f3218159480 2024-09-13T16:02:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.552+0000 7f3217e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32180cd570 con 0x7f321806f4b0 2024-09-13T16:02:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.552+0000 7f3216a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3218159480 0x7f32180ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.552+0000 7f3217400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3218071390 0x7f321815ce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53436/0 (socket says 172.21.15.70:53436) 2024-09-13T16:02:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.552+0000 7f3217400640 1 -- 172.21.15.70:0/3812776748 learned_addr learned my addr 172.21.15.70:0/3812776748 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.552+0000 7f320e000640 1 --2- 172.21.15.70:0/3812776748 >> v2:172.21.15.107:3300/0 conn(0x7f321806f4b0 0x7f3218070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.552+0000 7f3216a00640 1 -- 172.21.15.70:0/3812776748 >> v2:172.21.15.107:3300/0 conn(0x7f321806f4b0 msgr2=0x7f3218070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.553+0000 7f3216a00640 1 --2- 172.21.15.70:0/3812776748 >> v2:172.21.15.107:3300/0 conn(0x7f321806f4b0 0x7f3218070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.553+0000 7f3216a00640 1 -- 172.21.15.70:0/3812776748 >> v1:172.21.15.70:6789/0 conn(0x7f3218071390 legacy=0x7f321815ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.553+0000 7f3216a00640 1 -- 172.21.15.70:0/3812776748 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32180b1740 con 0x7f3218159480 2024-09-13T16:02:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.553+0000 7f320e000640 1 --2- 172.21.15.70:0/3812776748 >> v2:172.21.15.107:3300/0 conn(0x7f321806f4b0 0x7f3218070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.553+0000 7f3216000640 1 -- 172.21.15.70:0/3812776748 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302093784 0 0) 0x7f32180717c0 con 0x7f3218071390 2024-09-13T16:02:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.554+0000 7f3216a00640 1 --2- 172.21.15.70:0/3812776748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3218159480 0x7f32180ccf90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f321806e030 tx=0x7f320802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f5b495aa7042c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.554+0000 7f3216000640 1 -- 172.21.15.70:0/3812776748 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320802ae60 con 0x7f3218159480 2024-09-13T16:02:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.554+0000 7f3216000640 1 -- 172.21.15.70:0/3812776748 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3208032440 con 0x7f3218159480 2024-09-13T16:02:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.554+0000 7f3216000640 1 -- 172.21.15.70:0/3812776748 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32080327d0 con 0x7f3218159480 2024-09-13T16:02:53.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.554+0000 7f3217e00640 1 -- 172.21.15.70:0/3812776748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3218159480 msgr2=0x7f32180ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:53.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.554+0000 7f3217e00640 1 --2- 172.21.15.70:0/3812776748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3218159480 0x7f32180ccf90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f321806e030 tx=0x7f320802a110 comp rx=0 tx=0).stop 2024-09-13T16:02:53.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.554+0000 7f3217e00640 1 -- 172.21.15.70:0/3812776748 shutdown_connections 2024-09-13T16:02:53.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.554+0000 7f3217e00640 1 --2- 172.21.15.70:0/3812776748 >> v2:172.21.15.107:3300/0 conn(0x7f321806f4b0 0x7f3218070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.555+0000 7f3217e00640 1 --2- 172.21.15.70:0/3812776748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3218159480 0x7f32180ccf90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.555+0000 7f3217e00640 1 -- 172.21.15.70:0/3812776748 >> 172.21.15.70:0/3812776748 conn(0x7f32180ae310 msgr2=0x7f32180ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:53.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.555+0000 7f3217e00640 1 -- 172.21.15.70:0/3812776748 shutdown_connections 2024-09-13T16:02:53.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.555+0000 7f3217e00640 1 -- 172.21.15.70:0/3812776748 wait complete. 2024-09-13T16:02:53.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.556+0000 7f3217e00640 1 Processor -- start 2024-09-13T16:02:53.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.556+0000 7f3217e00640 1 -- start start 2024-09-13T16:02:53.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.557+0000 7f3217e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f321806f4b0 0x7f321814dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:53.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.557+0000 7f3217e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3218071390 0x7f32181546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:53.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.557+0000 7f3217e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3218159480 0x7f32180b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:53.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.557+0000 7f3217e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321815b830 con 0x7f3218071390 2024-09-13T16:02:53.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.557+0000 7f3217e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3218154be0 con 0x7f321806f4b0 2024-09-13T16:02:53.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.557+0000 7f3217e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321815af00 con 0x7f3218159480 2024-09-13T16:02:53.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.557+0000 7f320e000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3218071390 0x7f32181546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:53.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.557+0000 7f320e000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3218071390 0x7f32181546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52032/0 (socket says 172.21.15.70:52032) 2024-09-13T16:02:53.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.557+0000 7f320e000640 1 -- 172.21.15.70:0/2379089165 learned_addr learned my addr 172.21.15.70:0/2379089165 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:53.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.558+0000 7f3216a00640 1 --2- 172.21.15.70:0/2379089165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f321806f4b0 0x7f321814dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:53.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.558+0000 7f3217400640 1 --2- 172.21.15.70:0/2379089165 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3218159480 0x7f32180b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:53.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.558+0000 7f320e000640 1 -- 172.21.15.70:0/2379089165 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3218159480 msgr2=0x7f32180b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:53.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.558+0000 7f320e000640 1 --2- 172.21.15.70:0/2379089165 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3218159480 0x7f32180b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.558+0000 7f320e000640 1 -- 172.21.15.70:0/2379089165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f321806f4b0 msgr2=0x7f321814dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:53.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.558+0000 7f320e000640 1 --2- 172.21.15.70:0/2379089165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f321806f4b0 0x7f321814dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.558+0000 7f320e000640 1 -- 172.21.15.70:0/2379089165 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3208009400 con 0x7f3218071390 2024-09-13T16:02:53.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.558+0000 7f3217400640 1 --2- 172.21.15.70:0/2379089165 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3218159480 0x7f32180b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:53.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.558+0000 7f320e000640 1 --2- 172.21.15.70:0/2379089165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3218071390 0x7f32181546a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f320000c7f0 tx=0x7f320000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:53.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.558+0000 7f320f400640 1 -- 172.21.15.70:0/2379089165 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200007a30 con 0x7f3218071390 2024-09-13T16:02:53.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.559+0000 7f320f400640 1 -- 172.21.15.70:0/2379089165 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3200007b90 con 0x7f3218071390 2024-09-13T16:02:53.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.559+0000 7f320f400640 1 -- 172.21.15.70:0/2379089165 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320000ce40 con 0x7f3218071390 2024-09-13T16:02:53.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.559+0000 7f3217e00640 1 -- 172.21.15.70:0/2379089165 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321815b1e0 con 0x7f3218071390 2024-09-13T16:02:53.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.559+0000 7f3217e00640 1 -- 172.21.15.70:0/2379089165 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3218154e80 con 0x7f3218071390 2024-09-13T16:02:53.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.560+0000 7f3217e00640 1 -- 172.21.15.70:0/2379089165 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3218067360 con 0x7f3218071390 2024-09-13T16:02:53.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.561+0000 7f320f400640 1 -- 172.21.15.70:0/2379089165 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f32000113f0 con 0x7f3218071390 2024-09-13T16:02:53.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.561+0000 7f320f400640 1 --2- 172.21.15.70:0/2379089165 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f31f406ac00 0x7f31f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:53.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.562+0000 7f320f400640 1 -- 172.21.15.70:0/2379089165 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3200089580 con 0x7f3218071390 2024-09-13T16:02:53.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.562+0000 7f3216a00640 1 --2- 172.21.15.70:0/2379089165 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f31f406ac00 0x7f31f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:53.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.562+0000 7f3216a00640 1 --2- 172.21.15.70:0/2379089165 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f31f406ac00 0x7f31f406d0c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3208034000 tx=0x7f320802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:53.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.566+0000 7f320f400640 1 -- 172.21.15.70:0/2379089165 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3200054710 con 0x7f3218071390 2024-09-13T16:02:53.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.737+0000 7f3217e00640 1 -- 172.21.15.70:0/2379089165 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3218070e50 con 0x7f3218071390 2024-09-13T16:02:53.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.738+0000 7f320f400640 1 -- 172.21.15.70:0/2379089165 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16662 (secure 0 0 0) 0x7f3200057d30 con 0x7f3218071390 2024-09-13T16:02:53.740 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:02:53.741 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":35,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:02:41.168027+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:02:15.044503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T16:02:15.981176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6837/3554365995":"2024-09-14T16:02:41.167987+0000","172.21.15.70:6835/3554365995":"2024-09-14T16:02:41.167987+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:02:53.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.740+0000 7f3217e00640 1 -- 172.21.15.70:0/2379089165 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f31f406ac00 msgr2=0x7f31f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:53.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.740+0000 7f3217e00640 1 --2- 172.21.15.70:0/2379089165 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f31f406ac00 0x7f31f406d0c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3208034000 tx=0x7f320802e000 comp rx=0 tx=0).stop 2024-09-13T16:02:53.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.740+0000 7f3217e00640 1 -- 172.21.15.70:0/2379089165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3218071390 msgr2=0x7f32181546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:53.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.740+0000 7f3217e00640 1 --2- 172.21.15.70:0/2379089165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3218071390 0x7f32181546a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f320000c7f0 tx=0x7f320000cbf0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.740+0000 7f3217e00640 1 -- 172.21.15.70:0/2379089165 shutdown_connections 2024-09-13T16:02:53.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.740+0000 7f3217e00640 1 --2- 172.21.15.70:0/2379089165 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3218159480 0x7f32180b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.740+0000 7f3217e00640 1 --2- 172.21.15.70:0/2379089165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3218071390 0x7f32181546a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.740+0000 7f3217e00640 1 --2- 172.21.15.70:0/2379089165 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f31f406ac00 0x7f31f406d0c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.740+0000 7f3217e00640 1 --2- 172.21.15.70:0/2379089165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f321806f4b0 0x7f321814dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.740+0000 7f3217e00640 1 -- 172.21.15.70:0/2379089165 >> 172.21.15.70:0/2379089165 conn(0x7f32180ae310 msgr2=0x7f32180ad060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:53.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.740+0000 7f3217e00640 1 -- 172.21.15.70:0/2379089165 shutdown_connections 2024-09-13T16:02:53.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.740+0000 7f3217e00640 1 -- 172.21.15.70:0/2379089165 wait complete. 2024-09-13T16:02:53.759 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T16:02:53.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.909+0000 7f40f4c00640 1 Processor -- start 2024-09-13T16:02:53.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.910+0000 7f40f4c00640 1 -- start start 2024-09-13T16:02:53.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.911+0000 7f40f4c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f015dc30 0x7f40f00cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:53.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.911+0000 7f40f4c00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f00cb8d0 con 0x7f40f006a5e0 2024-09-13T16:02:53.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.911+0000 7f40f4c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f00cbbb0 con 0x7f40f00cb3d0 2024-09-13T16:02:53.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.911+0000 7f40f4c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f015e010 con 0x7f40f015dc30 2024-09-13T16:02:53.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.911+0000 7f40efe00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f40f006a5e0 0x7f40f0070430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53452/0 (socket says 172.21.15.70:53452) 2024-09-13T16:02:53.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.911+0000 7f40efe00640 1 -- 172.21.15.70:0/3559410578 learned_addr learned my addr 172.21.15.70:0/3559410578 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:53.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.911+0000 7f40ef400640 1 --2- 172.21.15.70:0/3559410578 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f015dc30 0x7f40f00cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:53.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.911+0000 7f40eea00640 1 -- 172.21.15.70:0/3559410578 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285850804 0 0) 0x7f40f00cb8d0 con 0x7f40f006a5e0 2024-09-13T16:02:53.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.912+0000 7f40eea00640 1 -- 172.21.15.70:0/3559410578 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40d4003520 con 0x7f40f006a5e0 2024-09-13T16:02:53.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.912+0000 7f40ef400640 1 -- 172.21.15.70:0/3559410578 >> v1:172.21.15.107:6789/0 conn(0x7f40f00cb3d0 legacy=0x7f40f0069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:53.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.912+0000 7f40ef400640 1 -- 172.21.15.70:0/3559410578 >> v1:172.21.15.70:6789/0 conn(0x7f40f006a5e0 legacy=0x7f40f0070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:53.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.912+0000 7f40ef400640 1 -- 172.21.15.70:0/3559410578 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f00cbe90 con 0x7f40f015dc30 2024-09-13T16:02:53.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.913+0000 7f40ef400640 1 --2- 172.21.15.70:0/3559410578 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f015dc30 0x7f40f00cd9f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f40e00097d0 tx=0x7f40e002a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=765abc09a474f8e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:53.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.913+0000 7f40eea00640 1 -- 172.21.15.70:0/3559410578 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e0032440 con 0x7f40f015dc30 2024-09-13T16:02:53.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.913+0000 7f40eea00640 1 -- 172.21.15.70:0/3559410578 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e00325a0 con 0x7f40f015dc30 2024-09-13T16:02:53.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.913+0000 7f40eea00640 1 -- 172.21.15.70:0/3559410578 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e0032930 con 0x7f40f015dc30 2024-09-13T16:02:53.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.914+0000 7f40f4c00640 1 -- 172.21.15.70:0/3559410578 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f015dc30 msgr2=0x7f40f00cd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:53.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.914+0000 7f40f4c00640 1 --2- 172.21.15.70:0/3559410578 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f015dc30 0x7f40f00cd9f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f40e00097d0 tx=0x7f40e002a200 comp rx=0 tx=0).stop 2024-09-13T16:02:53.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.914+0000 7f40f4c00640 1 -- 172.21.15.70:0/3559410578 shutdown_connections 2024-09-13T16:02:53.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.914+0000 7f40f4c00640 1 --2- 172.21.15.70:0/3559410578 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f015dc30 0x7f40f00cd9f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.914+0000 7f40f4c00640 1 -- 172.21.15.70:0/3559410578 >> 172.21.15.70:0/3559410578 conn(0x7f40f00affd0 msgr2=0x7f40f00b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:53.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.914+0000 7f40f4c00640 1 -- 172.21.15.70:0/3559410578 shutdown_connections 2024-09-13T16:02:53.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.914+0000 7f40f4c00640 1 -- 172.21.15.70:0/3559410578 wait complete. 2024-09-13T16:02:53.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.915+0000 7f40f4c00640 1 Processor -- start 2024-09-13T16:02:53.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.916+0000 7f40f4c00640 1 -- start start 2024-09-13T16:02:53.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.916+0000 7f40f4c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f006a5e0 0x7f40f0150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:53.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.916+0000 7f40f4c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40f00cb3d0 0x7f40f00a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:53.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.916+0000 7f40f4c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40f015dc30 0x7f40f00a89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:53.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.916+0000 7f40f4c00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f01548c0 con 0x7f40f00cb3d0 2024-09-13T16:02:53.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.916+0000 7f40f4c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0154ba0 con 0x7f40f015dc30 2024-09-13T16:02:53.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.916+0000 7f40f4c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f01560a0 con 0x7f40f006a5e0 2024-09-13T16:02:53.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.917+0000 7f40e6a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40f00cb3d0 0x7f40f00a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:53.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.917+0000 7f40e6a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40f00cb3d0 0x7f40f00a8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52038/0 (socket says 172.21.15.70:52038) 2024-09-13T16:02:53.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.917+0000 7f40e6a00640 1 -- 172.21.15.70:0/3209047310 learned_addr learned my addr 172.21.15.70:0/3209047310 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:53.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.917+0000 7f40ef400640 1 --2- 172.21.15.70:0/3209047310 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f006a5e0 0x7f40f0150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:53.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.917+0000 7f40e6a00640 1 -- 172.21.15.70:0/3209047310 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f006a5e0 msgr2=0x7f40f0150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:53.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.917+0000 7f40efe00640 1 --2- 172.21.15.70:0/3209047310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40f015dc30 0x7f40f00a89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:53.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.917+0000 7f40e6a00640 1 --2- 172.21.15.70:0/3209047310 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f006a5e0 0x7f40f0150ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.917+0000 7f40e6a00640 1 -- 172.21.15.70:0/3209047310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40f015dc30 msgr2=0x7f40f00a89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:53.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.917+0000 7f40e6a00640 1 --2- 172.21.15.70:0/3209047310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40f015dc30 0x7f40f00a89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:53.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.917+0000 7f40e6a00640 1 -- 172.21.15.70:0/3209047310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e0009400 con 0x7f40f00cb3d0 2024-09-13T16:02:53.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.917+0000 7f40efe00640 1 --2- 172.21.15.70:0/3209047310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40f015dc30 0x7f40f00a89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:53.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.917+0000 7f40e6a00640 1 --2- 172.21.15.70:0/3209047310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40f00cb3d0 0x7f40f00a8460 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f40d800c400 tx=0x7f40d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:53.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.918+0000 7f40e7e00640 1 -- 172.21.15.70:0/3209047310 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d80052d0 con 0x7f40f00cb3d0 2024-09-13T16:02:53.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.918+0000 7f40e7e00640 1 -- 172.21.15.70:0/3209047310 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d8005430 con 0x7f40f00cb3d0 2024-09-13T16:02:53.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.918+0000 7f40e7e00640 1 -- 172.21.15.70:0/3209047310 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8003830 con 0x7f40f00cb3d0 2024-09-13T16:02:53.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.918+0000 7f40f4c00640 1 -- 172.21.15.70:0/3209047310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f0156380 con 0x7f40f00cb3d0 2024-09-13T16:02:53.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.918+0000 7f40f4c00640 1 -- 172.21.15.70:0/3209047310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f01513e0 con 0x7f40f00cb3d0 2024-09-13T16:02:53.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.919+0000 7f40f4c00640 1 -- 172.21.15.70:0/3209047310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f0154d60 con 0x7f40f00cb3d0 2024-09-13T16:02:53.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.920+0000 7f40e7e00640 1 -- 172.21.15.70:0/3209047310 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f40d8003990 con 0x7f40f00cb3d0 2024-09-13T16:02:53.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.921+0000 7f40e7e00640 1 --2- 172.21.15.70:0/3209047310 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f40cc06ac00 0x7f40cc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:53.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.921+0000 7f40e7e00640 1 -- 172.21.15.70:0/3209047310 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f40d8088a20 con 0x7f40f00cb3d0 2024-09-13T16:02:53.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.921+0000 7f40ef400640 1 --2- 172.21.15.70:0/3209047310 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f40cc06ac00 0x7f40cc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:53.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.922+0000 7f40ef400640 1 --2- 172.21.15.70:0/3209047310 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f40cc06ac00 0x7f40cc06d0c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f40e0034000 tx=0x7f40e002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:53.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:53.925+0000 7f40e7e00640 1 -- 172.21.15.70:0/3209047310 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f40d8053b00 con 0x7f40f00cb3d0 2024-09-13T16:02:54.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.129+0000 7f40f4c00640 1 -- 172.21.15.70:0/3209047310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f40f01568a0 con 0x7f40f00cb3d0 2024-09-13T16:02:54.131 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-13T16:02:54.130+0000 7fe88e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T16:02:54.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.140+0000 7f40e7e00640 1 -- 172.21.15.70:0/3209047310 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7f40f01568a0 con 0x7f40f00cb3d0 2024-09-13T16:02:54.142 INFO:teuthology.orchestra.run.smithi070.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T16:02:54.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.142+0000 7f40f4c00640 1 -- 172.21.15.70:0/3209047310 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f40cc06ac00 msgr2=0x7f40cc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:54.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.142+0000 7f40f4c00640 1 --2- 172.21.15.70:0/3209047310 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f40cc06ac00 0x7f40cc06d0c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f40e0034000 tx=0x7f40e002e000 comp rx=0 tx=0).stop 2024-09-13T16:02:54.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.142+0000 7f40f4c00640 1 -- 172.21.15.70:0/3209047310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40f00cb3d0 msgr2=0x7f40f00a8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:54.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.142+0000 7f40f4c00640 1 --2- 172.21.15.70:0/3209047310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40f00cb3d0 0x7f40f00a8460 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f40d800c400 tx=0x7f40d800c8c0 comp rx=0 tx=0).stop 2024-09-13T16:02:54.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.142+0000 7f40f4c00640 1 -- 172.21.15.70:0/3209047310 shutdown_connections 2024-09-13T16:02:54.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.142+0000 7f40f4c00640 1 --2- 172.21.15.70:0/3209047310 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f40cc06ac00 0x7f40cc06d0c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:54.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.142+0000 7f40f4c00640 1 --2- 172.21.15.70:0/3209047310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40f015dc30 0x7f40f00a89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:54.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.142+0000 7f40f4c00640 1 --2- 172.21.15.70:0/3209047310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40f00cb3d0 0x7f40f00a8460 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:54.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.142+0000 7f40f4c00640 1 --2- 172.21.15.70:0/3209047310 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f006a5e0 0x7f40f0150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:54.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.142+0000 7f40f4c00640 1 -- 172.21.15.70:0/3209047310 >> 172.21.15.70:0/3209047310 conn(0x7f40f00affd0 msgr2=0x7f40f00af6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:54.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.142+0000 7f40f4c00640 1 -- 172.21.15.70:0/3209047310 shutdown_connections 2024-09-13T16:02:54.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.142+0000 7f40f4c00640 1 -- 172.21.15.70:0/3209047310 wait complete. 2024-09-13T16:02:54.149 INFO:tasks.ceph.mds.b.smithi107.stderr: -627> 2024-09-13T16:02:45.352+0000 7f6ac4a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T16:02:54.160 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T16:02:54.192 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-09-13T16:02:54.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.314+0000 7f985be00640 1 Processor -- start 2024-09-13T16:02:54.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.314+0000 7f985be00640 1 -- start start 2024-09-13T16:02:54.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.315+0000 7f985be00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f985c0b23d0 0x7f985c06bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:54.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.315+0000 7f985be00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985c159010 con 0x7f985c06c2e0 2024-09-13T16:02:54.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.315+0000 7f985be00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985c06c720 con 0x7f985c158c30 2024-09-13T16:02:54.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.315+0000 7f985be00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985c0cbde0 con 0x7f985c0b23d0 2024-09-13T16:02:54.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.315+0000 7f985b400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f985c06c2e0 0x7f985c0cc200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53458/0 (socket says 172.21.15.70:53458) 2024-09-13T16:02:54.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.315+0000 7f985b400640 1 -- 172.21.15.70:0/2694237871 learned_addr learned my addr 172.21.15.70:0/2694237871 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:54.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.316+0000 7f985a000640 1 --2- 172.21.15.70:0/2694237871 >> v2:172.21.15.107:3300/0 conn(0x7f985c0b23d0 0x7f985c06bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:54.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.316+0000 7f9859600640 1 -- 172.21.15.70:0/2694237871 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536687337 0 0) 0x7f985c159010 con 0x7f985c06c2e0 2024-09-13T16:02:54.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.316+0000 7f9859600640 1 -- 172.21.15.70:0/2694237871 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9840003520 con 0x7f985c06c2e0 2024-09-13T16:02:54.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.316+0000 7f985a000640 1 -- 172.21.15.70:0/2694237871 >> v1:172.21.15.107:6789/0 conn(0x7f985c158c30 legacy=0x7f985c0b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:54.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.316+0000 7f985a000640 1 -- 172.21.15.70:0/2694237871 >> v1:172.21.15.70:6789/0 conn(0x7f985c06c2e0 legacy=0x7f985c0cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:54.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.316+0000 7f985a000640 1 -- 172.21.15.70:0/2694237871 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c0b2940 con 0x7f985c0b23d0 2024-09-13T16:02:54.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.317+0000 7f985a000640 1 --2- 172.21.15.70:0/2694237871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f985c0b23d0 0x7f985c06bda0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f98480097a0 tx=0x7f984802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54a660391b5658e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:54.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.317+0000 7f9859600640 1 -- 172.21.15.70:0/2694237871 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848032440 con 0x7f985c0b23d0 2024-09-13T16:02:54.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.317+0000 7f9859600640 1 -- 172.21.15.70:0/2694237871 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98480325a0 con 0x7f985c0b23d0 2024-09-13T16:02:54.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.317+0000 7f9859600640 1 -- 172.21.15.70:0/2694237871 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848032930 con 0x7f985c0b23d0 2024-09-13T16:02:54.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.318+0000 7f985be00640 1 -- 172.21.15.70:0/2694237871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f985c0b23d0 msgr2=0x7f985c06bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:54.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.318+0000 7f985be00640 1 --2- 172.21.15.70:0/2694237871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f985c0b23d0 0x7f985c06bda0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f98480097a0 tx=0x7f984802a230 comp rx=0 tx=0).stop 2024-09-13T16:02:54.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.318+0000 7f985be00640 1 -- 172.21.15.70:0/2694237871 shutdown_connections 2024-09-13T16:02:54.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.318+0000 7f985be00640 1 --2- 172.21.15.70:0/2694237871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f985c0b23d0 0x7f985c06bda0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:54.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.318+0000 7f985be00640 1 -- 172.21.15.70:0/2694237871 >> 172.21.15.70:0/2694237871 conn(0x7f985c069ed0 msgr2=0x7f985c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:54.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.318+0000 7f985be00640 1 -- 172.21.15.70:0/2694237871 shutdown_connections 2024-09-13T16:02:54.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.318+0000 7f985be00640 1 -- 172.21.15.70:0/2694237871 wait complete. 2024-09-13T16:02:54.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.320+0000 7f985be00640 1 Processor -- start 2024-09-13T16:02:54.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.320+0000 7f985be00640 1 -- start start 2024-09-13T16:02:54.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.320+0000 7f985be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f985c06c2e0 0x7f985c14def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:54.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.320+0000 7f985be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f985c0b23d0 0x7f985c14af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:54.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.320+0000 7f985be00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f985c158c30 0x7f985c14cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:54.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.321+0000 7f985be00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c1583c0 con 0x7f985c158c30 2024-09-13T16:02:54.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.321+0000 7f985be00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c14b4a0 con 0x7f985c06c2e0 2024-09-13T16:02:54.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.321+0000 7f985be00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c152ed0 con 0x7f985c0b23d0 2024-09-13T16:02:54.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.321+0000 7f985b400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f985c158c30 0x7f985c14cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:54.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.321+0000 7f985b400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f985c158c30 0x7f985c14cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52054/0 (socket says 172.21.15.70:52054) 2024-09-13T16:02:54.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.321+0000 7f985b400640 1 -- 172.21.15.70:0/543174932 learned_addr learned my addr 172.21.15.70:0/543174932 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:54.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.321+0000 7f985aa00640 1 --2- 172.21.15.70:0/543174932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f985c06c2e0 0x7f985c14def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:54.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.321+0000 7f985a000640 1 --2- 172.21.15.70:0/543174932 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f985c0b23d0 0x7f985c14af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:54.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.321+0000 7f985b400640 1 -- 172.21.15.70:0/543174932 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f985c0b23d0 msgr2=0x7f985c14af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:54.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.321+0000 7f985b400640 1 --2- 172.21.15.70:0/543174932 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f985c0b23d0 0x7f985c14af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:54.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.321+0000 7f985b400640 1 -- 172.21.15.70:0/543174932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f985c06c2e0 msgr2=0x7f985c14def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:54.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.321+0000 7f985b400640 1 --2- 172.21.15.70:0/543174932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f985c06c2e0 0x7f985c14def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:54.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.321+0000 7f985b400640 1 -- 172.21.15.70:0/543174932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9848009400 con 0x7f985c158c30 2024-09-13T16:02:54.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.322+0000 7f985b400640 1 --2- 172.21.15.70:0/543174932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f985c158c30 0x7f985c14cbb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f985400cb40 tx=0x7f985400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:54.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.322+0000 7f9852a00640 1 -- 172.21.15.70:0/543174932 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985400aca0 con 0x7f985c158c30 2024-09-13T16:02:54.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.322+0000 7f9852a00640 1 -- 172.21.15.70:0/543174932 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985400ae00 con 0x7f985c158c30 2024-09-13T16:02:54.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.322+0000 7f9852a00640 1 -- 172.21.15.70:0/543174932 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854012620 con 0x7f985c158c30 2024-09-13T16:02:54.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.322+0000 7f985be00640 1 -- 172.21.15.70:0/543174932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985c153360 con 0x7f985c158c30 2024-09-13T16:02:54.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.322+0000 7f985be00640 1 -- 172.21.15.70:0/543174932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985c152880 con 0x7f985c158c30 2024-09-13T16:02:54.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.323+0000 7f985be00640 1 -- 172.21.15.70:0/543174932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985c153080 con 0x7f985c158c30 2024-09-13T16:02:54.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.324+0000 7f9852a00640 1 -- 172.21.15.70:0/543174932 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9854007070 con 0x7f985c158c30 2024-09-13T16:02:54.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.325+0000 7f9852a00640 1 --2- 172.21.15.70:0/543174932 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f983c06ac30 0x7f983c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:54.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.325+0000 7f9852a00640 1 -- 172.21.15.70:0/543174932 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f9854089340 con 0x7f985c158c30 2024-09-13T16:02:54.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.325+0000 7f985aa00640 1 --2- 172.21.15.70:0/543174932 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f983c06ac30 0x7f983c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:54.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.326+0000 7f985aa00640 1 --2- 172.21.15.70:0/543174932 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f983c06ac30 0x7f983c06d0f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f985c0cae10 tx=0x7f984c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:54.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.329+0000 7f9852a00640 1 -- 172.21.15.70:0/543174932 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f985c153080 con 0x7f985c158c30 2024-09-13T16:02:54.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:54.531+0000 7f985be00640 1 -- 172.21.15.70:0/543174932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f985c153040 con 0x7f985c158c30 2024-09-13T16:02:55.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.142+0000 7f9852a00640 1 -- 172.21.15.70:0/543174932 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9854054510 con 0x7f985c158c30 2024-09-13T16:02:55.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.144+0000 7f985be00640 1 -- 172.21.15.70:0/543174932 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f983c06ac30 msgr2=0x7f983c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:55.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.144+0000 7f985be00640 1 --2- 172.21.15.70:0/543174932 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f983c06ac30 0x7f983c06d0f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f985c0cae10 tx=0x7f984c009040 comp rx=0 tx=0).stop 2024-09-13T16:02:55.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.144+0000 7f985be00640 1 -- 172.21.15.70:0/543174932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f985c158c30 msgr2=0x7f985c14cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:55.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.144+0000 7f985be00640 1 --2- 172.21.15.70:0/543174932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f985c158c30 0x7f985c14cbb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f985400cb40 tx=0x7f985400a060 comp rx=0 tx=0).stop 2024-09-13T16:02:55.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.145+0000 7f985be00640 1 -- 172.21.15.70:0/543174932 shutdown_connections 2024-09-13T16:02:55.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.145+0000 7f985be00640 1 --2- 172.21.15.70:0/543174932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f985c158c30 0x7f985c14cbb0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:55.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.145+0000 7f985be00640 1 --2- 172.21.15.70:0/543174932 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f985c0b23d0 0x7f985c14af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:55.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.145+0000 7f985be00640 1 --2- 172.21.15.70:0/543174932 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f983c06ac30 0x7f983c06d0f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.145+0000 7f985be00640 1 --2- 172.21.15.70:0/543174932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f985c06c2e0 0x7f985c14def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.145+0000 7f985be00640 1 -- 172.21.15.70:0/543174932 >> 172.21.15.70:0/543174932 conn(0x7f985c069ed0 msgr2=0x7f985c0b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.145+0000 7f985be00640 1 -- 172.21.15.70:0/543174932 shutdown_connections 2024-09-13T16:02:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.145+0000 7f985be00640 1 -- 172.21.15.70:0/543174932 wait complete. 2024-09-13T16:02:55.165 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T16:02:55.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.322+0000 7ffbdf200640 1 Processor -- start 2024-09-13T16:02:55.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.322+0000 7ffbdf200640 1 -- start start 2024-09-13T16:02:55.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.322+0000 7ffbdf200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffbe015c8d0 0x7ffbe00cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:55.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.322+0000 7ffbdf200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffbe00cf5f0 0x7ffbe00b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:55.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.322+0000 7ffbdf200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe00b5b70 con 0x7ffbe00d1410 2024-09-13T16:02:55.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.322+0000 7ffbdf200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe00d1bf0 con 0x7ffbe015c8d0 2024-09-13T16:02:55.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.322+0000 7ffbdf200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe00d1ed0 con 0x7ffbe00cf5f0 2024-09-13T16:02:55.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.323+0000 7ffbde800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffbe00cf5f0 0x7ffbe00b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:55.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.323+0000 7ffbdd400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ffbe00d1410 0x7ffbe00ceee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:34664/0 (socket says 172.21.15.70:34664) 2024-09-13T16:02:55.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.323+0000 7ffbdde00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffbe015c8d0 0x7ffbe00cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:55.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.323+0000 7ffbdd400640 1 -- 172.21.15.70:0/981057264 learned_addr learned my addr 172.21.15.70:0/981057264 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:55.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.323+0000 7ffbdde00640 1 -- 172.21.15.70:0/981057264 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffbe00cf5f0 msgr2=0x7ffbe00b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:55.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.323+0000 7ffbdde00640 1 --2- 172.21.15.70:0/981057264 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffbe00cf5f0 0x7ffbe00b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:55.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.323+0000 7ffbdde00640 1 -- 172.21.15.70:0/981057264 >> v1:172.21.15.107:6789/0 conn(0x7ffbe00d1410 legacy=0x7ffbe00ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:55.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.323+0000 7ffbdde00640 1 -- 172.21.15.70:0/981057264 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe00d21b0 con 0x7ffbe015c8d0 2024-09-13T16:02:55.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.324+0000 7ffbdde00640 1 --2- 172.21.15.70:0/981057264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe015c8d0 0x7ffbe00cd9c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009d90 tx=0x7ffbd002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef07c6b192f00b21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:55.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.325+0000 7ffbdca00640 1 -- 172.21.15.70:0/981057264 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0007740 con 0x7ffbe015c8d0 2024-09-13T16:02:55.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.325+0000 7ffbdca00640 1 -- 172.21.15.70:0/981057264 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd002d050 con 0x7ffbe015c8d0 2024-09-13T16:02:55.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.325+0000 7ffbdca00640 1 -- 172.21.15.70:0/981057264 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0007ac0 con 0x7ffbe015c8d0 2024-09-13T16:02:55.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.325+0000 7ffbdf200640 1 -- 172.21.15.70:0/981057264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe015c8d0 msgr2=0x7ffbe00cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:55.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.325+0000 7ffbdf200640 1 --2- 172.21.15.70:0/981057264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe015c8d0 0x7ffbe00cd9c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009d90 tx=0x7ffbd002a660 comp rx=0 tx=0).stop 2024-09-13T16:02:55.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.325+0000 7ffbdf200640 1 -- 172.21.15.70:0/981057264 shutdown_connections 2024-09-13T16:02:55.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.325+0000 7ffbdf200640 1 --2- 172.21.15.70:0/981057264 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffbe00cf5f0 0x7ffbe00b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:55.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.325+0000 7ffbdf200640 1 --2- 172.21.15.70:0/981057264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe015c8d0 0x7ffbe00cd9c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:55.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.325+0000 7ffbdf200640 1 -- 172.21.15.70:0/981057264 >> 172.21.15.70:0/981057264 conn(0x7ffbe006a520 msgr2=0x7ffbe006a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:55.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.325+0000 7ffbdf200640 1 -- 172.21.15.70:0/981057264 shutdown_connections 2024-09-13T16:02:55.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.325+0000 7ffbdf200640 1 -- 172.21.15.70:0/981057264 wait complete. 2024-09-13T16:02:55.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.327+0000 7ffbdf200640 1 Processor -- start 2024-09-13T16:02:55.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.327+0000 7ffbdf200640 1 -- start start 2024-09-13T16:02:55.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.328+0000 7ffbdf200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe00cf5f0 0x7ffbe00c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:55.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.328+0000 7ffbdf200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffbe00d1410 0x7ffbe015da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:55.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.328+0000 7ffbdf200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffbe015c8d0 0x7ffbe01f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:55.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.328+0000 7ffbdf200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe015eb30 con 0x7ffbe00d1410 2024-09-13T16:02:55.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.328+0000 7ffbdf200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe015dfc0 con 0x7ffbe00cf5f0 2024-09-13T16:02:55.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.328+0000 7ffbdf200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe015e290 con 0x7ffbe015c8d0 2024-09-13T16:02:55.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.328+0000 7ffbdd400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffbe00d1410 0x7ffbe015da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:55.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.328+0000 7ffbdd400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffbe00d1410 0x7ffbe015da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52056/0 (socket says 172.21.15.70:52056) 2024-09-13T16:02:55.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.328+0000 7ffbdd400640 1 -- 172.21.15.70:0/3339445557 learned_addr learned my addr 172.21.15.70:0/3339445557 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:55.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.328+0000 7ffbde800640 1 --2- 172.21.15.70:0/3339445557 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffbe015c8d0 0x7ffbe01f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:55.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.328+0000 7ffbdde00640 1 --2- 172.21.15.70:0/3339445557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe00cf5f0 0x7ffbe00c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:55.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.329+0000 7ffbdd400640 1 -- 172.21.15.70:0/3339445557 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffbe015c8d0 msgr2=0x7ffbe01f5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:55.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.329+0000 7ffbdd400640 1 --2- 172.21.15.70:0/3339445557 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffbe015c8d0 0x7ffbe01f5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:55.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.329+0000 7ffbdd400640 1 -- 172.21.15.70:0/3339445557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe00cf5f0 msgr2=0x7ffbe00c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:55.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.329+0000 7ffbdd400640 1 --2- 172.21.15.70:0/3339445557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe00cf5f0 0x7ffbe00c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:55.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.329+0000 7ffbdd400640 1 -- 172.21.15.70:0/3339445557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd0009a70 con 0x7ffbe00d1410 2024-09-13T16:02:55.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.329+0000 7ffbdd400640 1 --2- 172.21.15.70:0/3339445557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffbe00d1410 0x7ffbe015da80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00c4a0 tx=0x7ffbcc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:55.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.329+0000 7ffbd6000640 1 -- 172.21.15.70:0/3339445557 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc005ce0 con 0x7ffbe00d1410 2024-09-13T16:02:55.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.329+0000 7ffbd6000640 1 -- 172.21.15.70:0/3339445557 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc005e40 con 0x7ffbe00d1410 2024-09-13T16:02:55.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.329+0000 7ffbd6000640 1 -- 172.21.15.70:0/3339445557 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc007270 con 0x7ffbe00d1410 2024-09-13T16:02:55.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.329+0000 7ffbdf200640 1 -- 172.21.15.70:0/3339445557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe015e570 con 0x7ffbe00d1410 2024-09-13T16:02:55.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.329+0000 7ffbdf200640 1 -- 172.21.15.70:0/3339445557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe01f3b80 con 0x7ffbe00d1410 2024-09-13T16:02:55.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.330+0000 7ffbdf200640 1 -- 172.21.15.70:0/3339445557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe01f39e0 con 0x7ffbe00d1410 2024-09-13T16:02:55.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.331+0000 7ffbd6000640 1 -- 172.21.15.70:0/3339445557 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffbcc007490 con 0x7ffbe00d1410 2024-09-13T16:02:55.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.332+0000 7ffbd6000640 1 --2- 172.21.15.70:0/3339445557 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ffbc006ac00 0x7ffbc006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:55.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.332+0000 7ffbd6000640 1 -- 172.21.15.70:0/3339445557 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5881+0+0 (secure 0 0 0) 0x7ffbcc088950 con 0x7ffbe00d1410 2024-09-13T16:02:55.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.332+0000 7ffbdde00640 1 --2- 172.21.15.70:0/3339445557 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ffbc006ac00 0x7ffbc006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:55.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.333+0000 7ffbdde00640 1 --2- 172.21.15.70:0/3339445557 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ffbc006ac00 0x7ffbc006d0c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0034000 tx=0x7ffbd002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:55.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.337+0000 7ffbd6000640 1 -- 172.21.15.70:0/3339445557 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ffbe01f39e0 con 0x7ffbe00d1410 2024-09-13T16:02:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:55.509+0000 7ffbdf200640 1 -- 172.21.15.70:0/3339445557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffbe01f39e0 con 0x7ffbe00d1410 2024-09-13T16:02:56.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.247+0000 7ffbd6000640 1 -- 172.21.15.70:0/3339445557 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 181+0+0 (secure 0 0 0) 0x7ffbe01f39e0 con 0x7ffbe00d1410 2024-09-13T16:02:56.248 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' removed 2024-09-13T16:02:56.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.250+0000 7ffbdf200640 1 -- 172.21.15.70:0/3339445557 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ffbc006ac00 msgr2=0x7ffbc006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:56.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.250+0000 7ffbdf200640 1 --2- 172.21.15.70:0/3339445557 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ffbc006ac00 0x7ffbc006d0c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0034000 tx=0x7ffbd002f000 comp rx=0 tx=0).stop 2024-09-13T16:02:56.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.250+0000 7ffbdf200640 1 -- 172.21.15.70:0/3339445557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffbe00d1410 msgr2=0x7ffbe015da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:56.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.250+0000 7ffbdf200640 1 --2- 172.21.15.70:0/3339445557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffbe00d1410 0x7ffbe015da80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00c4a0 tx=0x7ffbcc00c960 comp rx=0 tx=0).stop 2024-09-13T16:02:56.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.251+0000 7ffbdf200640 1 -- 172.21.15.70:0/3339445557 shutdown_connections 2024-09-13T16:02:56.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.251+0000 7ffbdf200640 1 --2- 172.21.15.70:0/3339445557 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffbe015c8d0 0x7ffbe01f5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:56.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.251+0000 7ffbdf200640 1 --2- 172.21.15.70:0/3339445557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffbe00d1410 0x7ffbe015da80 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:56.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.251+0000 7ffbdf200640 1 --2- 172.21.15.70:0/3339445557 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ffbc006ac00 0x7ffbc006d0c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.251+0000 7ffbdf200640 1 --2- 172.21.15.70:0/3339445557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe00cf5f0 0x7ffbe00c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.251+0000 7ffbdf200640 1 -- 172.21.15.70:0/3339445557 >> 172.21.15.70:0/3339445557 conn(0x7ffbe006a520 msgr2=0x7ffbe00c5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.251+0000 7ffbdf200640 1 -- 172.21.15.70:0/3339445557 shutdown_connections 2024-09-13T16:02:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.251+0000 7ffbdf200640 1 -- 172.21.15.70:0/3339445557 wait complete. 2024-09-13T16:02:56.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T16:02:56.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.428+0000 7f36fa000640 1 Processor -- start 2024-09-13T16:02:56.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.428+0000 7f36fa000640 1 -- start start 2024-09-13T16:02:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.429+0000 7f36fa000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f36f40cd9c0 0x7f36f40ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.429+0000 7f36fa000640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f40cf890 con 0x7f36f40cf420 2024-09-13T16:02:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.429+0000 7f36fa000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f40b5b70 con 0x7f36f415c8d0 2024-09-13T16:02:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.429+0000 7f36fa000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f40cde20 con 0x7f36f40cd9c0 2024-09-13T16:02:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.429+0000 7f36f9600640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f36f40cf420 0x7f36f40b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53462/0 (socket says 172.21.15.70:53462) 2024-09-13T16:02:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.429+0000 7f36f9600640 1 -- 172.21.15.70:0/1968754067 learned_addr learned my addr 172.21.15.70:0/1968754067 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.429+0000 7f36f3e00640 1 --2- 172.21.15.70:0/1968754067 >> v2:172.21.15.107:3300/0 conn(0x7f36f40cd9c0 0x7f36f40ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.430+0000 7f36f3400640 1 -- 172.21.15.70:0/1968754067 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889761079 0 0) 0x7f36ec001490 con 0x7f36f40cf420 2024-09-13T16:02:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.430+0000 7f36f3400640 1 -- 172.21.15.70:0/1968754067 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36dc003520 con 0x7f36f40cf420 2024-09-13T16:02:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.430+0000 7f36f3400640 1 -- 172.21.15.70:0/1968754067 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884873204 0 0) 0x7f36f40b5b70 con 0x7f36f415c8d0 2024-09-13T16:02:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.430+0000 7f36f3400640 1 -- 172.21.15.70:0/1968754067 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36ec001490 con 0x7f36f415c8d0 2024-09-13T16:02:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.430+0000 7f36f3e00640 1 -- 172.21.15.70:0/1968754067 >> v1:172.21.15.107:6789/0 conn(0x7f36f415c8d0 legacy=0x7f36f40d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.430+0000 7f36f3e00640 1 -- 172.21.15.70:0/1968754067 >> v1:172.21.15.70:6789/0 conn(0x7f36f40cf420 legacy=0x7f36f40b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.430+0000 7f36f3400640 1 -- 172.21.15.70:0/1968754067 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2436232144 0 0) 0x7f36dc003520 con 0x7f36f40cf420 2024-09-13T16:02:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.430+0000 7f36f3e00640 1 -- 172.21.15.70:0/1968754067 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f40d1bf0 con 0x7f36f40cd9c0 2024-09-13T16:02:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.431+0000 7f36f3e00640 1 --2- 172.21.15.70:0/1968754067 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36f40cd9c0 0x7f36f40ceee0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f36e00097a0 tx=0x7f36e002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=510ddd32863421d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.431+0000 7f36f3400640 1 -- 172.21.15.70:0/1968754067 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec001b80 con 0x7f36f40cd9c0 2024-09-13T16:02:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.431+0000 7f36f3400640 1 -- 172.21.15.70:0/1968754067 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e002ac50 con 0x7f36f40cd9c0 2024-09-13T16:02:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.431+0000 7f36f3400640 1 -- 172.21.15.70:0/1968754067 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e0032440 con 0x7f36f40cd9c0 2024-09-13T16:02:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.432+0000 7f36fa000640 1 -- 172.21.15.70:0/1968754067 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36f40cd9c0 msgr2=0x7f36f40ceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.432+0000 7f36fa000640 1 --2- 172.21.15.70:0/1968754067 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36f40cd9c0 0x7f36f40ceee0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f36e00097a0 tx=0x7f36e002a1c0 comp rx=0 tx=0).stop 2024-09-13T16:02:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.432+0000 7f36fa000640 1 -- 172.21.15.70:0/1968754067 shutdown_connections 2024-09-13T16:02:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.432+0000 7f36fa000640 1 --2- 172.21.15.70:0/1968754067 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36f40cd9c0 0x7f36f40ceee0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.432+0000 7f36fa000640 1 -- 172.21.15.70:0/1968754067 >> 172.21.15.70:0/1968754067 conn(0x7f36f406a520 msgr2=0x7f36f406a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.432+0000 7f36fa000640 1 -- 172.21.15.70:0/1968754067 shutdown_connections 2024-09-13T16:02:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.432+0000 7f36fa000640 1 -- 172.21.15.70:0/1968754067 wait complete. 2024-09-13T16:02:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.434+0000 7f36fa000640 1 Processor -- start 2024-09-13T16:02:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.434+0000 7f36fa000640 1 -- start start 2024-09-13T16:02:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.435+0000 7f36fa000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36f40cd9c0 0x7f36f40a9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.435+0000 7f36fa000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36f40cf420 0x7f36f40ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.435+0000 7f36fa000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36f415c8d0 0x7f36f41f1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.435+0000 7f36fa000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f40aa610 con 0x7f36f40cf420 2024-09-13T16:02:56.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.435+0000 7f36fa000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f40a9a90 con 0x7f36f40cd9c0 2024-09-13T16:02:56.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.435+0000 7f36fa000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f40a9d70 con 0x7f36f415c8d0 2024-09-13T16:02:56.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.435+0000 7f36f3e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36f40cf420 0x7f36f40ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:56.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.435+0000 7f36f3e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36f40cf420 0x7f36f40ab410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52072/0 (socket says 172.21.15.70:52072) 2024-09-13T16:02:56.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.435+0000 7f36f3e00640 1 -- 172.21.15.70:0/3879769576 learned_addr learned my addr 172.21.15.70:0/3879769576 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:56.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.435+0000 7f36f8c00640 1 --2- 172.21.15.70:0/3879769576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36f40cd9c0 0x7f36f40a9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:56.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.435+0000 7f36f9600640 1 --2- 172.21.15.70:0/3879769576 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36f415c8d0 0x7f36f41f1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:56.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.435+0000 7f36f3e00640 1 -- 172.21.15.70:0/3879769576 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36f415c8d0 msgr2=0x7f36f41f1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:56.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.435+0000 7f36f3e00640 1 --2- 172.21.15.70:0/3879769576 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36f415c8d0 0x7f36f41f1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:56.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.435+0000 7f36f3e00640 1 -- 172.21.15.70:0/3879769576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36f40cd9c0 msgr2=0x7f36f40a9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:56.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.435+0000 7f36f3e00640 1 --2- 172.21.15.70:0/3879769576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36f40cd9c0 0x7f36f40a9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:56.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.435+0000 7f36f3e00640 1 -- 172.21.15.70:0/3879769576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e0009400 con 0x7f36f40cf420 2024-09-13T16:02:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.436+0000 7f36f3e00640 1 --2- 172.21.15.70:0/3879769576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36f40cf420 0x7f36f40ab410 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f36e0035040 tx=0x7f36e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.436+0000 7f36f0c00640 1 -- 172.21.15.70:0/3879769576 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e0006e10 con 0x7f36f40cf420 2024-09-13T16:02:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.436+0000 7f36f0c00640 1 -- 172.21.15.70:0/3879769576 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e003b610 con 0x7f36f40cf420 2024-09-13T16:02:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.436+0000 7f36f0c00640 1 -- 172.21.15.70:0/3879769576 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e003b9a0 con 0x7f36f40cf420 2024-09-13T16:02:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.436+0000 7f36fa000640 1 -- 172.21.15.70:0/3879769576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f40aa050 con 0x7f36f40cf420 2024-09-13T16:02:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.436+0000 7f36fa000640 1 -- 172.21.15.70:0/3879769576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f40a9780 con 0x7f36f40cf420 2024-09-13T16:02:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.437+0000 7f36fa000640 1 -- 172.21.15.70:0/3879769576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f40ceee0 con 0x7f36f40cf420 2024-09-13T16:02:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.438+0000 7f36f0c00640 1 -- 172.21.15.70:0/3879769576 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f36e0039040 con 0x7f36f40cf420 2024-09-13T16:02:56.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.439+0000 7f36f0c00640 1 --2- 172.21.15.70:0/3879769576 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f36d406ac00 0x7f36d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:56.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.439+0000 7f36f0c00640 1 -- 172.21.15.70:0/3879769576 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5443+0+0 (secure 0 0 0) 0x7f36e00a9510 con 0x7f36f40cf420 2024-09-13T16:02:56.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.439+0000 7f36f8c00640 1 --2- 172.21.15.70:0/3879769576 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f36d406ac00 0x7f36d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:56.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.440+0000 7f36f8c00640 1 --2- 172.21.15.70:0/3879769576 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f36d406ac00 0x7f36d406d0c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f36e80011e0 tx=0x7f36e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:56.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.443+0000 7f36f0c00640 1 -- 172.21.15.70:0/3879769576 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f36e0074800 con 0x7f36f40cf420 2024-09-13T16:02:56.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:56.614+0000 7f36fa000640 1 -- 172.21.15.70:0/3879769576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f36f40b7d30 con 0x7f36f40cf420 2024-09-13T16:02:57.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.249+0000 7f36f0c00640 1 -- 172.21.15.70:0/3879769576 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7f36e0077e20 con 0x7f36f40cf420 2024-09-13T16:02:57.251 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' removed 2024-09-13T16:02:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.252+0000 7f36fa000640 1 -- 172.21.15.70:0/3879769576 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f36d406ac00 msgr2=0x7f36d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.252+0000 7f36fa000640 1 --2- 172.21.15.70:0/3879769576 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f36d406ac00 0x7f36d406d0c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f36e80011e0 tx=0x7f36e8009040 comp rx=0 tx=0).stop 2024-09-13T16:02:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.252+0000 7f36fa000640 1 -- 172.21.15.70:0/3879769576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36f40cf420 msgr2=0x7f36f40ab410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.252+0000 7f36fa000640 1 --2- 172.21.15.70:0/3879769576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36f40cf420 0x7f36f40ab410 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f36e0035040 tx=0x7f36e00046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.252+0000 7f36fa000640 1 -- 172.21.15.70:0/3879769576 shutdown_connections 2024-09-13T16:02:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.252+0000 7f36fa000640 1 --2- 172.21.15.70:0/3879769576 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36f415c8d0 0x7f36f41f1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.252+0000 7f36fa000640 1 --2- 172.21.15.70:0/3879769576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36f40cf420 0x7f36f40ab410 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.252+0000 7f36fa000640 1 --2- 172.21.15.70:0/3879769576 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f36d406ac00 0x7f36d406d0c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.252+0000 7f36fa000640 1 --2- 172.21.15.70:0/3879769576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36f40cd9c0 0x7f36f40a9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.252+0000 7f36fa000640 1 -- 172.21.15.70:0/3879769576 >> 172.21.15.70:0/3879769576 conn(0x7f36f406a520 msgr2=0x7f36f415ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.253+0000 7f36fa000640 1 -- 172.21.15.70:0/3879769576 shutdown_connections 2024-09-13T16:02:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.253+0000 7f36fa000640 1 -- 172.21.15.70:0/3879769576 wait complete. 2024-09-13T16:02:57.271 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T16:02:57.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.424+0000 7fb235a00640 1 Processor -- start 2024-09-13T16:02:57.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.424+0000 7fb235a00640 1 -- start start 2024-09-13T16:02:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.425+0000 7fb235a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb2300b1b00 0x7fb2300cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:57.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.425+0000 7fb235a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb2300cde50 0x7fb23015a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:57.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.425+0000 7fb235a00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23006bea0 con 0x7fb23015a520 2024-09-13T16:02:57.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.425+0000 7fb235a00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23006c180 con 0x7fb2300b1b00 2024-09-13T16:02:57.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.425+0000 7fb235a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23006c460 con 0x7fb2300cde50 2024-09-13T16:02:57.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.426+0000 7fb226000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb2300b1b00 0x7fb2300cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:57.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.426+0000 7fb22ea00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb23015a520 0x7fb23006b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53478/0 (socket says 172.21.15.70:53478) 2024-09-13T16:02:57.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.426+0000 7fb22ea00640 1 -- 172.21.15.70:0/4157963464 learned_addr learned my addr 172.21.15.70:0/4157963464 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:57.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.426+0000 7fb226000640 1 -- 172.21.15.70:0/4157963464 >> v2:172.21.15.107:3300/0 conn(0x7fb2300cde50 msgr2=0x7fb23015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:57.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.426+0000 7fb22f400640 1 --2- 172.21.15.70:0/4157963464 >> v2:172.21.15.107:3300/0 conn(0x7fb2300cde50 0x7fb23015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:57.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.426+0000 7fb226000640 1 --2- 172.21.15.70:0/4157963464 >> v2:172.21.15.107:3300/0 conn(0x7fb2300cde50 0x7fb23015a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.426+0000 7fb226000640 1 -- 172.21.15.70:0/4157963464 >> v1:172.21.15.70:6789/0 conn(0x7fb23015a520 legacy=0x7fb23006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:57.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.426+0000 7fb226000640 1 -- 172.21.15.70:0/4157963464 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23006c740 con 0x7fb2300b1b00 2024-09-13T16:02:57.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.426+0000 7fb22e000640 1 -- 172.21.15.70:0/4157963464 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928216275 0 0) 0x7fb23006bea0 con 0x7fb23015a520 2024-09-13T16:02:57.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.427+0000 7fb226000640 1 --2- 172.21.15.70:0/4157963464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2300b1b00 0x7fb2300cd910 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb2300cc5f0 tx=0x7fb21802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bdc87dba76317e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:57.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.427+0000 7fb22e000640 1 -- 172.21.15.70:0/4157963464 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218032440 con 0x7fb2300b1b00 2024-09-13T16:02:57.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.427+0000 7fb22e000640 1 -- 172.21.15.70:0/4157963464 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2180325a0 con 0x7fb2300b1b00 2024-09-13T16:02:57.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.427+0000 7fb22e000640 1 -- 172.21.15.70:0/4157963464 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218032930 con 0x7fb2300b1b00 2024-09-13T16:02:57.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.428+0000 7fb235a00640 1 -- 172.21.15.70:0/4157963464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2300b1b00 msgr2=0x7fb2300cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:57.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.428+0000 7fb235a00640 1 --2- 172.21.15.70:0/4157963464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2300b1b00 0x7fb2300cd910 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb2300cc5f0 tx=0x7fb21802a1a0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.428+0000 7fb235a00640 1 -- 172.21.15.70:0/4157963464 shutdown_connections 2024-09-13T16:02:57.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.428+0000 7fb235a00640 1 --2- 172.21.15.70:0/4157963464 >> v2:172.21.15.107:3300/0 conn(0x7fb2300cde50 0x7fb23015a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.428+0000 7fb235a00640 1 --2- 172.21.15.70:0/4157963464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2300b1b00 0x7fb2300cd910 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.428+0000 7fb235a00640 1 -- 172.21.15.70:0/4157963464 >> 172.21.15.70:0/4157963464 conn(0x7fb2300b0510 msgr2=0x7fb2300b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:57.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.428+0000 7fb235a00640 1 -- 172.21.15.70:0/4157963464 shutdown_connections 2024-09-13T16:02:57.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.428+0000 7fb235a00640 1 -- 172.21.15.70:0/4157963464 wait complete. 2024-09-13T16:02:57.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.430+0000 7fb235a00640 1 Processor -- start 2024-09-13T16:02:57.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.430+0000 7fb235a00640 1 -- start start 2024-09-13T16:02:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.431+0000 7fb235a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2300b1b00 0x7fb2300c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.431+0000 7fb235a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2300cde50 0x7fb2300ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.431+0000 7fb235a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb23015a520 0x7fb2301efac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.431+0000 7fb235a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2301f30b0 con 0x7fb2300b1b00 2024-09-13T16:02:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.431+0000 7fb235a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2301f0000 con 0x7fb2300cde50 2024-09-13T16:02:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.431+0000 7fb235a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2301f02a0 con 0x7fb23015a520 2024-09-13T16:02:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.431+0000 7fb22ea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2300b1b00 0x7fb2300c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:57.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.431+0000 7fb22ea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2300b1b00 0x7fb2300c4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52088/0 (socket says 172.21.15.70:52088) 2024-09-13T16:02:57.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.431+0000 7fb22ea00640 1 -- 172.21.15.70:0/3391387572 learned_addr learned my addr 172.21.15.70:0/3391387572 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:57.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.431+0000 7fb22f400640 1 --2- 172.21.15.70:0/3391387572 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb23015a520 0x7fb2301efac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:57.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.431+0000 7fb226000640 1 --2- 172.21.15.70:0/3391387572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2300cde50 0x7fb2300ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:57.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.431+0000 7fb22ea00640 1 -- 172.21.15.70:0/3391387572 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb23015a520 msgr2=0x7fb2301efac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:57.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.431+0000 7fb22ea00640 1 --2- 172.21.15.70:0/3391387572 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb23015a520 0x7fb2301efac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.431+0000 7fb22ea00640 1 -- 172.21.15.70:0/3391387572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2300cde50 msgr2=0x7fb2300ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:57.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.431+0000 7fb22ea00640 1 --2- 172.21.15.70:0/3391387572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2300cde50 0x7fb2300ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.431+0000 7fb22ea00640 1 -- 172.21.15.70:0/3391387572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb218009400 con 0x7fb2300b1b00 2024-09-13T16:02:57.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.432+0000 7fb22ea00640 1 --2- 172.21.15.70:0/3391387572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2300b1b00 0x7fb2300c4140 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb22000c430 tx=0x7fb22000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:57.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.432+0000 7fb227400640 1 -- 172.21.15.70:0/3391387572 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2200074e0 con 0x7fb2300b1b00 2024-09-13T16:02:57.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.432+0000 7fb227400640 1 -- 172.21.15.70:0/3391387572 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb220007660 con 0x7fb2300b1b00 2024-09-13T16:02:57.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.432+0000 7fb227400640 1 -- 172.21.15.70:0/3391387572 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb220004a20 con 0x7fb2300b1b00 2024-09-13T16:02:57.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.432+0000 7fb235a00640 1 -- 172.21.15.70:0/3391387572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2301f0580 con 0x7fb2300b1b00 2024-09-13T16:02:57.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.432+0000 7fb235a00640 1 -- 172.21.15.70:0/3391387572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2301f3300 con 0x7fb2300b1b00 2024-09-13T16:02:57.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.433+0000 7fb235a00640 1 -- 172.21.15.70:0/3391387572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2300cd910 con 0x7fb2300b1b00 2024-09-13T16:02:57.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.434+0000 7fb227400640 1 -- 172.21.15.70:0/3391387572 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb220004b80 con 0x7fb2300b1b00 2024-09-13T16:02:57.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.435+0000 7fb227400640 1 --2- 172.21.15.70:0/3391387572 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb20c06ac00 0x7fb20c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:57.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.435+0000 7fb227400640 1 -- 172.21.15.70:0/3391387572 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb220088f00 con 0x7fb2300b1b00 2024-09-13T16:02:57.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.435+0000 7fb226000640 1 --2- 172.21.15.70:0/3391387572 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb20c06ac00 0x7fb20c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:57.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.436+0000 7fb226000640 1 --2- 172.21.15.70:0/3391387572 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb20c06ac00 0x7fb20c06d0c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb218034000 tx=0x7fb21802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:57.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.439+0000 7fb227400640 1 -- 172.21.15.70:0/3391387572 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb220054370 con 0x7fb2300b1b00 2024-09-13T16:02:57.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.621+0000 7fb235a00640 1 -- 172.21.15.70:0/3391387572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb230156f60 con 0x7fb2300b1b00 2024-09-13T16:02:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.625+0000 7fb227400640 1 -- 172.21.15.70:0/3391387572 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb220057990 con 0x7fb2300b1b00 2024-09-13T16:02:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.628+0000 7fb235a00640 1 -- 172.21.15.70:0/3391387572 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb20c06ac00 msgr2=0x7fb20c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.628+0000 7fb235a00640 1 --2- 172.21.15.70:0/3391387572 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb20c06ac00 0x7fb20c06d0c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb218034000 tx=0x7fb21802e000 comp rx=0 tx=0).stop 2024-09-13T16:02:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.628+0000 7fb235a00640 1 -- 172.21.15.70:0/3391387572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2300b1b00 msgr2=0x7fb2300c4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.628+0000 7fb235a00640 1 --2- 172.21.15.70:0/3391387572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2300b1b00 0x7fb2300c4140 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb22000c430 tx=0x7fb22000c8f0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.628+0000 7fb235a00640 1 -- 172.21.15.70:0/3391387572 shutdown_connections 2024-09-13T16:02:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.628+0000 7fb235a00640 1 --2- 172.21.15.70:0/3391387572 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb23015a520 0x7fb2301efac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.628+0000 7fb235a00640 1 --2- 172.21.15.70:0/3391387572 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb20c06ac00 0x7fb20c06d0c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.628+0000 7fb235a00640 1 --2- 172.21.15.70:0/3391387572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2300cde50 0x7fb2300ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.628+0000 7fb235a00640 1 --2- 172.21.15.70:0/3391387572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2300b1b00 0x7fb2300c4140 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.628+0000 7fb235a00640 1 -- 172.21.15.70:0/3391387572 >> 172.21.15.70:0/3391387572 conn(0x7fb2300b0510 msgr2=0x7fb23006b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.628+0000 7fb235a00640 1 -- 172.21.15.70:0/3391387572 shutdown_connections 2024-09-13T16:02:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.628+0000 7fb235a00640 1 -- 172.21.15.70:0/3391387572 wait complete. 2024-09-13T16:02:57.645 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_cap_flush.TestCapFlush.test_replay_create' 2024-09-13T16:02:57.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.796+0000 7f7315c00640 1 Processor -- start 2024-09-13T16:02:57.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.796+0000 7f7315c00640 1 -- start start 2024-09-13T16:02:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.797+0000 7f7315c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f731015a5c0 0x7f73100b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.797+0000 7f7315c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73100cbac0 0x7f73100b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.797+0000 7f7315c00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73100cbfc0 con 0x7f73100afe10 2024-09-13T16:02:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.797+0000 7f7315c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73100cce20 con 0x7f731015a5c0 2024-09-13T16:02:57.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.797+0000 7f7315c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73100707a0 con 0x7f73100cbac0 2024-09-13T16:02:57.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.797+0000 7f7315200640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f73100afe10 0x7f731006f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53492/0 (socket says 172.21.15.70:53492) 2024-09-13T16:02:57.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.797+0000 7f7315200640 1 -- 172.21.15.70:0/1282102958 learned_addr learned my addr 172.21.15.70:0/1282102958 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:02:57.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.798+0000 7f730fe00640 1 --2- 172.21.15.70:0/1282102958 >> v2:172.21.15.107:3300/0 conn(0x7f731015a5c0 0x7f73100b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.798+0000 7f730f400640 1 --2- 172.21.15.70:0/1282102958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73100cbac0 0x7f73100b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.798+0000 7f730ea00640 1 -- 172.21.15.70:0/1282102958 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2250948196 0 0) 0x7f73100cbfc0 con 0x7f73100afe10 2024-09-13T16:02:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.798+0000 7f730ea00640 1 -- 172.21.15.70:0/1282102958 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72f4003520 con 0x7f73100afe10 2024-09-13T16:02:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.798+0000 7f730ea00640 1 -- 172.21.15.70:0/1282102958 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3729750729 0 0) 0x7f72f4003520 con 0x7f73100afe10 2024-09-13T16:02:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.798+0000 7f730ea00640 1 -- 172.21.15.70:0/1282102958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73100cbac0 msgr2=0x7f73100b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.798+0000 7f730ea00640 1 --2- 172.21.15.70:0/1282102958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73100cbac0 0x7f73100b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.798+0000 7f730ea00640 1 -- 172.21.15.70:0/1282102958 >> v2:172.21.15.107:3300/0 conn(0x7f731015a5c0 msgr2=0x7f73100b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.798+0000 7f730ea00640 1 --2- 172.21.15.70:0/1282102958 >> v2:172.21.15.107:3300/0 conn(0x7f731015a5c0 0x7f73100b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.798+0000 7f730ea00640 1 -- 172.21.15.70:0/1282102958 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7310070a80 con 0x7f73100afe10 2024-09-13T16:02:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.798+0000 7f730ea00640 1 -- 172.21.15.70:0/1282102958 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f73080019f0 con 0x7f73100afe10 2024-09-13T16:02:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.798+0000 7f730ea00640 1 -- 172.21.15.70:0/1282102958 >> v1:172.21.15.70:6789/0 conn(0x7f73100afe10 legacy=0x7f731006f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.798+0000 7f730ea00640 1 --2- 172.21.15.70:0/1282102958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72f4003970 0x7f72f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.798+0000 7f730ea00640 1 --2- 172.21.15.70:0/1282102958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f40047c0 0x7f72f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.798+0000 7f730ea00640 1 --2- 172.21.15.70:0/1282102958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73100cbac0 0x7f72f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.798+0000 7f730ea00640 1 -- 172.21.15.70:0/1282102958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73100cce20 con 0x7f72f4003970 2024-09-13T16:02:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.798+0000 7f730ea00640 1 -- 172.21.15.70:0/1282102958 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73100707a0 con 0x7f72f40047c0 2024-09-13T16:02:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.798+0000 7f730ea00640 1 -- 172.21.15.70:0/1282102958 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f400b980 con 0x7f73100cbac0 2024-09-13T16:02:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.799+0000 7f730fe00640 1 --2- 172.21.15.70:0/1282102958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72f4003970 0x7f72f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.799+0000 7f7315200640 1 --2- 172.21.15.70:0/1282102958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73100cbac0 0x7f72f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.799+0000 7f730f400640 1 --2- 172.21.15.70:0/1282102958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f40047c0 0x7f72f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.799+0000 7f730fe00640 1 -- 172.21.15.70:0/1282102958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73100cbac0 msgr2=0x7f72f4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.799+0000 7f730fe00640 1 --2- 172.21.15.70:0/1282102958 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73100cbac0 0x7f72f4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.799+0000 7f730fe00640 1 -- 172.21.15.70:0/1282102958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f40047c0 msgr2=0x7f72f4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.799+0000 7f730fe00640 1 --2- 172.21.15.70:0/1282102958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f40047c0 0x7f72f4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.799+0000 7f730fe00640 1 -- 172.21.15.70:0/1282102958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f4003520 con 0x7f72f4003970 2024-09-13T16:02:57.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.800+0000 7f730fe00640 1 --2- 172.21.15.70:0/1282102958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72f4003970 0x7f72f4003d90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7300009ac0 tx=0x7f72f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43a076c0a95d366 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:57.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.800+0000 7f730ea00640 1 -- 172.21.15.70:0/1282102958 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300031400 con 0x7f72f4003970 2024-09-13T16:02:57.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.800+0000 7f730ea00640 1 -- 172.21.15.70:0/1282102958 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730002d050 con 0x7f72f4003970 2024-09-13T16:02:57.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.800+0000 7f730ea00640 1 -- 172.21.15.70:0/1282102958 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300031780 con 0x7f72f4003970 2024-09-13T16:02:57.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.801+0000 7f7315c00640 1 -- 172.21.15.70:0/1282102958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72f4003970 msgr2=0x7f72f4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:57.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.801+0000 7f7315c00640 1 --2- 172.21.15.70:0/1282102958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72f4003970 0x7f72f4003d90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7300009ac0 tx=0x7f72f40057f0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.801+0000 7f7315200640 1 -- 172.21.15.70:0/1282102958 reap_dead start 2024-09-13T16:02:57.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.801+0000 7f7315c00640 1 -- 172.21.15.70:0/1282102958 shutdown_connections 2024-09-13T16:02:57.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.801+0000 7f7315c00640 1 -- 172.21.15.70:0/1282102958 >> 172.21.15.70:0/1282102958 conn(0x7f73100ae310 msgr2=0x7f73100ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:57.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.801+0000 7f7315c00640 1 -- 172.21.15.70:0/1282102958 shutdown_connections 2024-09-13T16:02:57.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.801+0000 7f7315c00640 1 -- 172.21.15.70:0/1282102958 wait complete. 2024-09-13T16:02:57.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.803+0000 7f7315c00640 1 Processor -- start 2024-09-13T16:02:57.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.803+0000 7f7315c00640 1 -- start start 2024-09-13T16:02:57.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.803+0000 7f7315c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4003970 0x7f7310148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:57.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.804+0000 7f7315c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7310149030 0x7f73100b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:57.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.804+0000 7f7315c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7310153550 0x7f731006c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.804+0000 7f7315c00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7310148d90 con 0x7f7310153550 2024-09-13T16:02:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.804+0000 7f7315c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73100b3760 con 0x7f72f4003970 2024-09-13T16:02:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.804+0000 7f7315c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7310152790 con 0x7f7310149030 2024-09-13T16:02:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.804+0000 7f7315200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7310153550 0x7f731006c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.804+0000 7f7315200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7310153550 0x7f731006c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52116/0 (socket says 172.21.15.70:52116) 2024-09-13T16:02:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.804+0000 7f7315200640 1 -- 172.21.15.70:0/3334803950 learned_addr learned my addr 172.21.15.70:0/3334803950 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:02:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.804+0000 7f7315200640 1 -- 172.21.15.70:0/3334803950 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7310149030 msgr2=0x7f73100b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.804+0000 7f7315200640 1 --2- 172.21.15.70:0/3334803950 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7310149030 0x7f73100b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.804+0000 7f7315200640 1 -- 172.21.15.70:0/3334803950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4003970 msgr2=0x7f7310148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.804+0000 7f730fe00640 1 --2- 172.21.15.70:0/3334803950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4003970 0x7f7310148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.804+0000 7f7315200640 1 --2- 172.21.15.70:0/3334803950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4003970 0x7f7310148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.804+0000 7f7315200640 1 -- 172.21.15.70:0/3334803950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7310152a70 con 0x7f7310153550 2024-09-13T16:02:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.804+0000 7f730fe00640 1 --2- 172.21.15.70:0/3334803950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4003970 0x7f7310148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:57.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.804+0000 7f7315200640 1 --2- 172.21.15.70:0/3334803950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7310153550 0x7f731006c830 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f73100738f0 tx=0x7f7308007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:57.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.805+0000 7f7307e00640 1 -- 172.21.15.70:0/3334803950 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730800ac20 con 0x7f7310153550 2024-09-13T16:02:57.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.805+0000 7f7307e00640 1 -- 172.21.15.70:0/3334803950 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730800adc0 con 0x7f7310153550 2024-09-13T16:02:57.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.805+0000 7f7307e00640 1 -- 172.21.15.70:0/3334803950 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7308013630 con 0x7f7310153550 2024-09-13T16:02:57.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.805+0000 7f7315c00640 1 -- 172.21.15.70:0/3334803950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7310152d50 con 0x7f7310153550 2024-09-13T16:02:57.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.805+0000 7f7315c00640 1 -- 172.21.15.70:0/3334803950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73100b3370 con 0x7f7310153550 2024-09-13T16:02:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.806+0000 7f7315c00640 1 -- 172.21.15.70:0/3334803950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7310067360 con 0x7f7310153550 2024-09-13T16:02:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.807+0000 7f7307e00640 1 -- 172.21.15.70:0/3334803950 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7308013790 con 0x7f7310153550 2024-09-13T16:02:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.808+0000 7f7307e00640 1 --2- 172.21.15.70:0/3334803950 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f72f006ac00 0x7f72f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.808+0000 7f7307e00640 1 -- 172.21.15.70:0/3334803950 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7308089870 con 0x7f7310153550 2024-09-13T16:02:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.808+0000 7f730fe00640 1 --2- 172.21.15.70:0/3334803950 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f72f006ac00 0x7f72f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.808+0000 7f730fe00640 1 --2- 172.21.15.70:0/3334803950 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f72f006ac00 0x7f72f006d0c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7300033000 tx=0x7f7300008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:57.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:57.812+0000 7f7307e00640 1 -- 172.21.15.70:0/3334803950 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7308054c50 con 0x7f7310153550 2024-09-13T16:02:58.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:58.045+0000 7f7315c00640 1 -- 172.21.15.70:0/3334803950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_cap_flush.TestCapFlush.test_replay_create"]} v 0) v1 -- 0x7f7310153270 con 0x7f7310153550 2024-09-13T16:02:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:58.257+0000 7f7307e00640 1 -- 172.21.15.70:0/3334803950 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_cap_flush.TestCapFlush.test_replay_create"]}]=0 v111) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7310153270 con 0x7f7310153550 2024-09-13T16:02:58.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:58.259+0000 7f7315c00640 1 -- 172.21.15.70:0/3334803950 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f72f006ac00 msgr2=0x7f72f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:58.259+0000 7f7315c00640 1 --2- 172.21.15.70:0/3334803950 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f72f006ac00 0x7f72f006d0c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7300033000 tx=0x7f7300008030 comp rx=0 tx=0).stop 2024-09-13T16:02:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:58.259+0000 7f7315c00640 1 -- 172.21.15.70:0/3334803950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7310153550 msgr2=0x7f731006c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:58.259+0000 7f7315c00640 1 --2- 172.21.15.70:0/3334803950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7310153550 0x7f731006c830 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f73100738f0 tx=0x7f7308007bd0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:58.259+0000 7f7315c00640 1 -- 172.21.15.70:0/3334803950 shutdown_connections 2024-09-13T16:02:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:58.259+0000 7f7315c00640 1 --2- 172.21.15.70:0/3334803950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7310153550 0x7f731006c830 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:58.259+0000 7f7315c00640 1 --2- 172.21.15.70:0/3334803950 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7310149030 0x7f73100b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:58.259+0000 7f7315c00640 1 --2- 172.21.15.70:0/3334803950 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f72f006ac00 0x7f72f006d0c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:58.259+0000 7f7315c00640 1 --2- 172.21.15.70:0/3334803950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4003970 0x7f7310148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:58.259+0000 7f7315c00640 1 -- 172.21.15.70:0/3334803950 >> 172.21.15.70:0/3334803950 conn(0x7f73100ae310 msgr2=0x7f73100ca910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:58.259+0000 7f7315c00640 1 -- 172.21.15.70:0/3334803950 shutdown_connections 2024-09-13T16:02:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:02:58.259+0000 7f7315c00640 1 -- 172.21.15.70:0/3334803950 wait complete. 2024-09-13T16:02:58.276 INFO:tasks.cephfs_test_runner:MDS starts to handle client caps when it enters clientreplay stage. ... ok 2024-09-13T16:02:58.276 INFO:tasks.cephfs_test_runner: 2024-09-13T16:02:58.277 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-13T16:02:58.277 INFO:tasks.cephfs_test_runner:Ran 1 test in 67.260s 2024-09-13T16:02:58.277 INFO:tasks.cephfs_test_runner: 2024-09-13T16:02:58.277 INFO:tasks.cephfs_test_runner:OK 2024-09-13T16:02:58.277 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-13T16:02:58.287 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T16:02:58.308 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T16:02:58.308 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:02:58.308 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:02:58.344 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T16:02:58.344 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-13T16:02:58.344 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:02:58.420 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T16:02:58.420 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:02:58.420 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:02:58.461 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T16:02:58.461 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-13T16:02:58.461 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:02:58.539 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T16:02:58.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:58.540 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-13T16:02:58.575 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T16:02:58.575 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T16:02:58.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:58.576 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T16:02:58.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:58.673 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T16:02:58.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:58.877 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2024-09-13T16:02:59.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:59.194 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-13T16:02:59.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:59.230 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2024-09-13T16:02:59.330 INFO:teuthology.orchestra.run.smithi070.stderr:Cannot find device "ceph-brx" 2024-09-13T16:02:59.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:02:59.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:59.333 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-09-13T16:02:59.373 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T16:02:59.373 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T16:02:59.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:59.374 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T16:02:59.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:59.474 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T16:02:59.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:02:59.782 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-09-13T16:03:00.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:03:00.079 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-09-13T16:03:00.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:03:00.115 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-09-13T16:03:00.215 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-09-13T16:03:00.217 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:03:00.218 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T16:03:00.228 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T16:03:00.229 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T16:03:00.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.380+0000 7faed7e00640 1 Processor -- start 2024-09-13T16:03:00.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.381+0000 7faed7e00640 1 -- start start 2024-09-13T16:03:00.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.382+0000 7faed7e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faed8071560 0x7faed80ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:00.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.382+0000 7faed7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faed806f4b0 0x7faed80b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:00.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.382+0000 7faed7e00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed80cd850 con 0x7faed8159480 2024-09-13T16:03:00.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.382+0000 7faed7e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed80cd570 con 0x7faed8071560 2024-09-13T16:03:00.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.382+0000 7faed7e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed80b1740 con 0x7faed806f4b0 2024-09-13T16:03:00.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.382+0000 7faed6a00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7faed8159480 0x7faed8070e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50708/0 (socket says 172.21.15.70:50708) 2024-09-13T16:03:00.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.382+0000 7faed6a00640 1 -- 172.21.15.70:0/3621703623 learned_addr learned my addr 172.21.15.70:0/3621703623 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:03:00.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.383+0000 7faed7400640 1 --2- 172.21.15.70:0/3621703623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faed806f4b0 0x7faed80b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:00.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.383+0000 7faece000640 1 --2- 172.21.15.70:0/3621703623 >> v2:172.21.15.107:3300/0 conn(0x7faed8071560 0x7faed80ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:00.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.383+0000 7faed6000640 1 -- 172.21.15.70:0/3621703623 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 214596655 0 0) 0x7faed80cd850 con 0x7faed8159480 2024-09-13T16:03:00.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.383+0000 7faed6000640 1 -- 172.21.15.70:0/3621703623 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faebc003520 con 0x7faed8159480 2024-09-13T16:03:00.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.383+0000 7faed6000640 1 -- 172.21.15.70:0/3621703623 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 663985874 0 0) 0x7faebc003520 con 0x7faed8159480 2024-09-13T16:03:00.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.383+0000 7faed7400640 1 -- 172.21.15.70:0/3621703623 >> v2:172.21.15.107:3300/0 conn(0x7faed8071560 msgr2=0x7faed80ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:00.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.383+0000 7faed7400640 1 --2- 172.21.15.70:0/3621703623 >> v2:172.21.15.107:3300/0 conn(0x7faed8071560 0x7faed80ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.383+0000 7faed7400640 1 -- 172.21.15.70:0/3621703623 >> v1:172.21.15.70:6789/0 conn(0x7faed8159480 legacy=0x7faed8070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:00.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.383+0000 7faed7400640 1 -- 172.21.15.70:0/3621703623 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed80b1a20 con 0x7faed806f4b0 2024-09-13T16:03:00.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.383+0000 7faece000640 1 --2- 172.21.15.70:0/3621703623 >> v2:172.21.15.107:3300/0 conn(0x7faed8071560 0x7faed80ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:03:00.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.384+0000 7faed7400640 1 --2- 172.21.15.70:0/3621703623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faed806f4b0 0x7faed80b2220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faed0009d90 tx=0x7faed002a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7abf50c661a4b308 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:00.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.384+0000 7faed6000640 1 -- 172.21.15.70:0/3621703623 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8001670 con 0x7faed806f4b0 2024-09-13T16:03:00.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.384+0000 7faed6000640 1 -- 172.21.15.70:0/3621703623 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed002d050 con 0x7faed806f4b0 2024-09-13T16:03:00.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.384+0000 7faed6000640 1 -- 172.21.15.70:0/3621703623 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0007760 con 0x7faed806f4b0 2024-09-13T16:03:00.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.385+0000 7faed7e00640 1 -- 172.21.15.70:0/3621703623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faed806f4b0 msgr2=0x7faed80b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:00.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.385+0000 7faed7e00640 1 --2- 172.21.15.70:0/3621703623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faed806f4b0 0x7faed80b2220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faed0009d90 tx=0x7faed002a560 comp rx=0 tx=0).stop 2024-09-13T16:03:00.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.385+0000 7faed7e00640 1 -- 172.21.15.70:0/3621703623 shutdown_connections 2024-09-13T16:03:00.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.385+0000 7faed7e00640 1 --2- 172.21.15.70:0/3621703623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faed806f4b0 0x7faed80b2220 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.385+0000 7faed7e00640 1 --2- 172.21.15.70:0/3621703623 >> v2:172.21.15.107:3300/0 conn(0x7faed8071560 0x7faed80ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.385+0000 7faed7e00640 1 -- 172.21.15.70:0/3621703623 >> 172.21.15.70:0/3621703623 conn(0x7faed80ae310 msgr2=0x7faed80ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:00.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.385+0000 7faed7e00640 1 -- 172.21.15.70:0/3621703623 shutdown_connections 2024-09-13T16:03:00.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.385+0000 7faed7e00640 1 -- 172.21.15.70:0/3621703623 wait complete. 2024-09-13T16:03:00.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.387+0000 7faed7e00640 1 Processor -- start 2024-09-13T16:03:00.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.387+0000 7faed7e00640 1 -- start start 2024-09-13T16:03:00.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.388+0000 7faed7e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed806f4b0 0x7faed815c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.388+0000 7faed7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faed8071560 0x7faed80ac280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.388+0000 7faed7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faed8159480 0x7faed8144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.388+0000 7faed7e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed80a8590 con 0x7faed806f4b0 2024-09-13T16:03:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.388+0000 7faed7e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed80a8870 con 0x7faed8159480 2024-09-13T16:03:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.388+0000 7faed7e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed80a8b50 con 0x7faed8071560 2024-09-13T16:03:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.388+0000 7faed6a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed806f4b0 0x7faed815c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.388+0000 7faed6a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed806f4b0 0x7faed815c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49098/0 (socket says 172.21.15.70:49098) 2024-09-13T16:03:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.388+0000 7faed6a00640 1 -- 172.21.15.70:0/2905658546 learned_addr learned my addr 172.21.15.70:0/2905658546 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.388+0000 7faece000640 1 --2- 172.21.15.70:0/2905658546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faed8071560 0x7faed80ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.388+0000 7faed7400640 1 --2- 172.21.15.70:0/2905658546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faed8159480 0x7faed8144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.388+0000 7faed6a00640 1 -- 172.21.15.70:0/2905658546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faed8071560 msgr2=0x7faed80ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.388+0000 7faed6a00640 1 --2- 172.21.15.70:0/2905658546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faed8071560 0x7faed80ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.388+0000 7faed6a00640 1 -- 172.21.15.70:0/2905658546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faed8159480 msgr2=0x7faed8144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.388+0000 7faed6a00640 1 --2- 172.21.15.70:0/2905658546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faed8159480 0x7faed8144650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.388+0000 7faed6a00640 1 -- 172.21.15.70:0/2905658546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec0009400 con 0x7faed806f4b0 2024-09-13T16:03:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.389+0000 7faed6a00640 1 --2- 172.21.15.70:0/2905658546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed806f4b0 0x7faed815c340 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7faec80011e0 tx=0x7faec800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.389+0000 7faecf400640 1 -- 172.21.15.70:0/2905658546 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8005ad0 con 0x7faed806f4b0 2024-09-13T16:03:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.389+0000 7faecf400640 1 -- 172.21.15.70:0/2905658546 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec8005c50 con 0x7faed806f4b0 2024-09-13T16:03:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.389+0000 7faed7e00640 1 -- 172.21.15.70:0/2905658546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed0009a70 con 0x7faed806f4b0 2024-09-13T16:03:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.389+0000 7faecf400640 1 -- 172.21.15.70:0/2905658546 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8007070 con 0x7faed806f4b0 2024-09-13T16:03:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.389+0000 7faed7e00640 1 -- 172.21.15.70:0/2905658546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed80acd90 con 0x7faed806f4b0 2024-09-13T16:03:00.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.390+0000 7faed7e00640 1 -- 172.21.15.70:0/2905658546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed8067360 con 0x7faed806f4b0 2024-09-13T16:03:00.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.391+0000 7faecf400640 1 -- 172.21.15.70:0/2905658546 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faec80071d0 con 0x7faed806f4b0 2024-09-13T16:03:00.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.392+0000 7faecf400640 1 --2- 172.21.15.70:0/2905658546 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7faeb406ac00 0x7faeb406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:00.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.392+0000 7faecf400640 1 -- 172.21.15.70:0/2905658546 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7faec8088700 con 0x7faed806f4b0 2024-09-13T16:03:00.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.392+0000 7faece000640 1 --2- 172.21.15.70:0/2905658546 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7faeb406ac00 0x7faeb406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:00.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.393+0000 7faece000640 1 --2- 172.21.15.70:0/2905658546 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7faeb406ac00 0x7faeb406d0c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faed814ba20 tx=0x7faec0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:00.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.397+0000 7faecf400640 1 -- 172.21.15.70:0/2905658546 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faec8053c20 con 0x7faed806f4b0 2024-09-13T16:03:00.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.563+0000 7faed7e00640 1 -- 172.21.15.70:0/2905658546 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faed80ce280 con 0x7faeb406ac00 2024-09-13T16:03:00.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.565+0000 7faecf400640 1 -- 172.21.15.70:0/2905658546 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50399 (secure 0 0 0) 0x7faec0009920 con 0x7faeb406ac00 2024-09-13T16:03:00.567 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:03:00.568 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-13T16:03:00.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.568+0000 7faed7e00640 1 -- 172.21.15.70:0/2905658546 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7faeb406ac00 msgr2=0x7faeb406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:00.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.568+0000 7faed7e00640 1 --2- 172.21.15.70:0/2905658546 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7faeb406ac00 0x7faeb406d0c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faed814ba20 tx=0x7faec0009190 comp rx=0 tx=0).stop 2024-09-13T16:03:00.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.568+0000 7faed7e00640 1 -- 172.21.15.70:0/2905658546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed806f4b0 msgr2=0x7faed815c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:00.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.568+0000 7faed7e00640 1 --2- 172.21.15.70:0/2905658546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed806f4b0 0x7faed815c340 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7faec80011e0 tx=0x7faec800cbe0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.568+0000 7faed7e00640 1 -- 172.21.15.70:0/2905658546 shutdown_connections 2024-09-13T16:03:00.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.568+0000 7faed7e00640 1 --2- 172.21.15.70:0/2905658546 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7faeb406ac00 0x7faeb406d0c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.568+0000 7faed7e00640 1 --2- 172.21.15.70:0/2905658546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faed8159480 0x7faed8144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.568+0000 7faed7e00640 1 --2- 172.21.15.70:0/2905658546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faed8071560 0x7faed80ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.568+0000 7faed7e00640 1 --2- 172.21.15.70:0/2905658546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed806f4b0 0x7faed815c340 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.568+0000 7faed7e00640 1 -- 172.21.15.70:0/2905658546 >> 172.21.15.70:0/2905658546 conn(0x7faed80ae310 msgr2=0x7faed80af320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:00.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.568+0000 7faed7e00640 1 -- 172.21.15.70:0/2905658546 shutdown_connections 2024-09-13T16:03:00.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.568+0000 7faed7e00640 1 -- 172.21.15.70:0/2905658546 wait complete. 2024-09-13T16:03:00.585 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-09-13T16:03:00.037699+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236944,"kb_used_data":4404,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737776,"statfs":{"total":773094113280,"available":772851482624,"internally_reserved":0,"allocated":4509696,"data_stored":2504461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18166,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-86,"num_read_kb":-88,"num_write":-76,"num_write_kb":-44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001483"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T16:02:41.193278+0000","last_change":"2024-09-13T16:01:07.580186+0000","last_active":"2024-09-13T16:02:41.193278+0000","last_peered":"2024-09-13T16:02:41.193278+0000","last_clean":"2024-09-13T16:02:41.193278+0000","last_became_active":"2024-09-13T16:01:07.579877+0000","last_became_peered":"2024-09-13T16:01:07.579877+0000","last_unstale":"2024-09-13T16:02:41.193278+0000","last_undegraded":"2024-09-13T16:02:41.193278+0000","last_fullsized":"2024-09-13T16:02:41.193278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_clean_scrub_stamp":"2024-09-13T16:01:06.070807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:40.645649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":754593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.621},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.72999999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.79400000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.81200000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.68400000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.753},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.78100000000000003}]},{"osd":3,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.82599999999999996}]},{"osd":1,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.1230000000000002,"5min":5.1230000000000002,"15min":5.1230000000000002},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.752}]},{"osd":3,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.0750000000000002,"5min":5.0750000000000002,"15min":5.0750000000000002},"last":0.876},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.79100000000000004}]},{"osd":4,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.627},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.56399999999999995}]},{"osd":6,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.77700000000000002}]},{"osd":7,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.84099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":158072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.77000000000000002}]},{"osd":5,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.89000000000000001}]},{"osd":6,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.875}]},{"osd":7,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.85899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":442368,"data_stored":181525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.378},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":1.0309999999999999}]},{"osd":5,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.91600000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.0009999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.93500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":401408,"data_stored":158038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.374},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46400000000000002}]},{"osd":1,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.49099999999999999}]},{"osd":3,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.93799999999999994}]},{"osd":5,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.872},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.83999999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.80900000000000005}]},{"osd":7,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.85099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":430080,"data_stored":175358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.58799999999999997}]},{"osd":5,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.623}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":987136,"data_stored":747317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.37}]},{"osd":2,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.434},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.503}]},{"osd":4,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.78200000000000003}]},{"osd":5,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.83699999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.79800000000000004}]},{"osd":7,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.875},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.748}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:03:00.587 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T16:03:00.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.737+0000 7f91d8600640 1 Processor -- start 2024-09-13T16:03:00.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.737+0000 7f91d8600640 1 -- start start 2024-09-13T16:03:00.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.739+0000 7f91d8600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f91d00b1b00 0x7f91d00cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:00.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.739+0000 7f91d8600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91d00cde50 0x7f91d015a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:00.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.739+0000 7f91d8600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d006bea0 con 0x7f91d015a520 2024-09-13T16:03:00.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.739+0000 7f91d8600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d006c180 con 0x7f91d00b1b00 2024-09-13T16:03:00.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.739+0000 7f91d8600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d006c460 con 0x7f91d00cde50 2024-09-13T16:03:00.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.739+0000 7f91d5c00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f91d015a520 0x7f91d006b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50712/0 (socket says 172.21.15.70:50712) 2024-09-13T16:03:00.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.739+0000 7f91d5c00640 1 -- 172.21.15.70:0/1775117028 learned_addr learned my addr 172.21.15.70:0/1775117028 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:03:00.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.739+0000 7f91d5200640 1 --2- 172.21.15.70:0/1775117028 >> v2:172.21.15.107:3300/0 conn(0x7f91d00b1b00 0x7f91d00cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:00.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.739+0000 7f91d6600640 1 --2- 172.21.15.70:0/1775117028 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91d00cde50 0x7f91d015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:00.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.739+0000 7f91cfe00640 1 -- 172.21.15.70:0/1775117028 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555280459 0 0) 0x7f91d006bea0 con 0x7f91d015a520 2024-09-13T16:03:00.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.739+0000 7f91d6600640 1 -- 172.21.15.70:0/1775117028 >> v2:172.21.15.107:3300/0 conn(0x7f91d00b1b00 msgr2=0x7f91d00cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:00.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.739+0000 7f91d6600640 1 --2- 172.21.15.70:0/1775117028 >> v2:172.21.15.107:3300/0 conn(0x7f91d00b1b00 0x7f91d00cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.739+0000 7f91d6600640 1 -- 172.21.15.70:0/1775117028 >> v1:172.21.15.70:6789/0 conn(0x7f91d015a520 legacy=0x7f91d006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:00.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.739+0000 7f91d6600640 1 -- 172.21.15.70:0/1775117028 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d006c740 con 0x7f91d00cde50 2024-09-13T16:03:00.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.740+0000 7f91d6600640 1 --2- 172.21.15.70:0/1775117028 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91d00cde50 0x7f91d015a900 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009d90 tx=0x7f91c802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6104ca3f7ee2a09e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:00.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.741+0000 7f91cfe00640 1 -- 172.21.15.70:0/1775117028 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c8007740 con 0x7f91d00cde50 2024-09-13T16:03:00.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.741+0000 7f91cfe00640 1 -- 172.21.15.70:0/1775117028 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c802d050 con 0x7f91d00cde50 2024-09-13T16:03:00.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.741+0000 7f91cfe00640 1 -- 172.21.15.70:0/1775117028 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c8007ac0 con 0x7f91d00cde50 2024-09-13T16:03:00.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.741+0000 7f91d8600640 1 -- 172.21.15.70:0/1775117028 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91d00cde50 msgr2=0x7f91d015a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:00.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.741+0000 7f91d8600640 1 --2- 172.21.15.70:0/1775117028 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91d00cde50 0x7f91d015a900 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009d90 tx=0x7f91c802a660 comp rx=0 tx=0).stop 2024-09-13T16:03:00.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.741+0000 7f91d8600640 1 -- 172.21.15.70:0/1775117028 shutdown_connections 2024-09-13T16:03:00.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.741+0000 7f91d8600640 1 --2- 172.21.15.70:0/1775117028 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91d00cde50 0x7f91d015a900 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.741+0000 7f91d8600640 1 --2- 172.21.15.70:0/1775117028 >> v2:172.21.15.107:3300/0 conn(0x7f91d00b1b00 0x7f91d00cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.741+0000 7f91d8600640 1 -- 172.21.15.70:0/1775117028 >> 172.21.15.70:0/1775117028 conn(0x7f91d00b0510 msgr2=0x7f91d00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:00.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.741+0000 7f91d8600640 1 -- 172.21.15.70:0/1775117028 shutdown_connections 2024-09-13T16:03:00.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.741+0000 7f91d8600640 1 -- 172.21.15.70:0/1775117028 wait complete. 2024-09-13T16:03:00.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.743+0000 7f91d8600640 1 Processor -- start 2024-09-13T16:03:00.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.743+0000 7f91d8600640 1 -- start start 2024-09-13T16:03:00.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.744+0000 7f91d8600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91d00b1b00 0x7f91d01f0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.744+0000 7f91d8600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91d00cde50 0x7f91d00afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.744+0000 7f91d8600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91d015a520 0x7f91d01ece70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.744+0000 7f91d8600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d01f0e40 con 0x7f91d00b1b00 2024-09-13T16:03:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.744+0000 7f91d8600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d00a8800 con 0x7f91d00cde50 2024-09-13T16:03:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.744+0000 7f91d8600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d00a8ae0 con 0x7f91d015a520 2024-09-13T16:03:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.744+0000 7f91d5c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91d00b1b00 0x7f91d01f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.744+0000 7f91d5c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91d00b1b00 0x7f91d01f0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49112/0 (socket says 172.21.15.70:49112) 2024-09-13T16:03:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.744+0000 7f91d5c00640 1 -- 172.21.15.70:0/638565671 learned_addr learned my addr 172.21.15.70:0/638565671 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.744+0000 7f91d5200640 1 --2- 172.21.15.70:0/638565671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91d00cde50 0x7f91d00afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.744+0000 7f91d6600640 1 --2- 172.21.15.70:0/638565671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91d015a520 0x7f91d01ece70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.745+0000 7f91d5c00640 1 -- 172.21.15.70:0/638565671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91d015a520 msgr2=0x7f91d01ece70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.745+0000 7f91d5c00640 1 --2- 172.21.15.70:0/638565671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91d015a520 0x7f91d01ece70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.745+0000 7f91d5c00640 1 -- 172.21.15.70:0/638565671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91d00cde50 msgr2=0x7f91d00afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.745+0000 7f91d5c00640 1 --2- 172.21.15.70:0/638565671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91d00cde50 0x7f91d00afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.745+0000 7f91d5c00640 1 -- 172.21.15.70:0/638565671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c8009a70 con 0x7f91d00b1b00 2024-09-13T16:03:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.745+0000 7f91d5c00640 1 --2- 172.21.15.70:0/638565671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91d00b1b00 0x7f91d01f0900 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f91c400c430 tx=0x7f91c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.745+0000 7f91cd600640 1 -- 172.21.15.70:0/638565671 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c40074e0 con 0x7f91d00b1b00 2024-09-13T16:03:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.745+0000 7f91cd600640 1 -- 172.21.15.70:0/638565671 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c4007660 con 0x7f91d00b1b00 2024-09-13T16:03:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.745+0000 7f91cd600640 1 -- 172.21.15.70:0/638565671 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4004a20 con 0x7f91d00b1b00 2024-09-13T16:03:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.745+0000 7f91d8600640 1 -- 172.21.15.70:0/638565671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d00a8dc0 con 0x7f91d00b1b00 2024-09-13T16:03:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.745+0000 7f91d8600640 1 -- 172.21.15.70:0/638565671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d00a9380 con 0x7f91d00b1b00 2024-09-13T16:03:00.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.746+0000 7f91d8600640 1 -- 172.21.15.70:0/638565671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d00cd270 con 0x7f91d00b1b00 2024-09-13T16:03:00.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.747+0000 7f91cd600640 1 -- 172.21.15.70:0/638565671 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f91c4004b80 con 0x7f91d00b1b00 2024-09-13T16:03:00.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.749+0000 7f91cd600640 1 --2- 172.21.15.70:0/638565671 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f91b006ac00 0x7f91b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:00.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.749+0000 7f91cd600640 1 -- 172.21.15.70:0/638565671 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f91c4088e90 con 0x7f91d00b1b00 2024-09-13T16:03:00.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.749+0000 7f91d5200640 1 --2- 172.21.15.70:0/638565671 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f91b006ac00 0x7f91b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:00.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.749+0000 7f91d5200640 1 --2- 172.21.15.70:0/638565671 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f91b006ac00 0x7f91b006d0c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f91d00ada20 tx=0x7f91bc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:00.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.753+0000 7f91cd600640 1 -- 172.21.15.70:0/638565671 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f91c4054320 con 0x7f91d00b1b00 2024-09-13T16:03:00.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.919+0000 7f91d8600640 1 -- 172.21.15.70:0/638565671 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91d006cf40 con 0x7f91b006ac00 2024-09-13T16:03:00.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.921+0000 7f91cd600640 1 -- 172.21.15.70:0/638565671 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50399 (secure 0 0 0) 0x7f91bc011a30 con 0x7f91b006ac00 2024-09-13T16:03:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:03:00.923 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-13T16:03:00.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.923+0000 7f91d8600640 1 -- 172.21.15.70:0/638565671 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f91b006ac00 msgr2=0x7f91b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:00.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.923+0000 7f91d8600640 1 --2- 172.21.15.70:0/638565671 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f91b006ac00 0x7f91b006d0c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f91d00ada20 tx=0x7f91bc009190 comp rx=0 tx=0).stop 2024-09-13T16:03:00.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.923+0000 7f91d8600640 1 -- 172.21.15.70:0/638565671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91d00b1b00 msgr2=0x7f91d01f0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:00.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.923+0000 7f91d8600640 1 --2- 172.21.15.70:0/638565671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91d00b1b00 0x7f91d01f0900 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f91c400c430 tx=0x7f91c400c8f0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.924+0000 7f91d8600640 1 -- 172.21.15.70:0/638565671 shutdown_connections 2024-09-13T16:03:00.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.924+0000 7f91d8600640 1 --2- 172.21.15.70:0/638565671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91d015a520 0x7f91d01ece70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.924+0000 7f91d8600640 1 --2- 172.21.15.70:0/638565671 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f91b006ac00 0x7f91b006d0c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.924+0000 7f91d8600640 1 --2- 172.21.15.70:0/638565671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91d00cde50 0x7f91d00afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.924+0000 7f91d8600640 1 --2- 172.21.15.70:0/638565671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91d00b1b00 0x7f91d01f0900 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.924+0000 7f91d8600640 1 -- 172.21.15.70:0/638565671 >> 172.21.15.70:0/638565671 conn(0x7f91d00b0510 msgr2=0x7f91d00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:00.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.924+0000 7f91d8600640 1 -- 172.21.15.70:0/638565671 shutdown_connections 2024-09-13T16:03:00.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:00.924+0000 7f91d8600640 1 -- 172.21.15.70:0/638565671 wait complete. 2024-09-13T16:03:00.941 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-09-13T16:03:00.037699+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236944,"kb_used_data":4404,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737776,"statfs":{"total":773094113280,"available":772851482624,"internally_reserved":0,"allocated":4509696,"data_stored":2504461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18166,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-86,"num_read_kb":-88,"num_write":-76,"num_write_kb":-44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001483"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T16:02:41.193278+0000","last_change":"2024-09-13T16:01:07.580186+0000","last_active":"2024-09-13T16:02:41.193278+0000","last_peered":"2024-09-13T16:02:41.193278+0000","last_clean":"2024-09-13T16:02:41.193278+0000","last_became_active":"2024-09-13T16:01:07.579877+0000","last_became_peered":"2024-09-13T16:01:07.579877+0000","last_unstale":"2024-09-13T16:02:41.193278+0000","last_undegraded":"2024-09-13T16:02:41.193278+0000","last_fullsized":"2024-09-13T16:02:41.193278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_clean_scrub_stamp":"2024-09-13T16:01:06.070807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:40.645649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":754593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.621},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.72999999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.79400000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.81200000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.68400000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.753},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.78100000000000003}]},{"osd":3,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.82599999999999996}]},{"osd":1,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.1230000000000002,"5min":5.1230000000000002,"15min":5.1230000000000002},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.752}]},{"osd":3,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.0750000000000002,"5min":5.0750000000000002,"15min":5.0750000000000002},"last":0.876},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.79100000000000004}]},{"osd":4,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.627},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.56399999999999995}]},{"osd":6,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.77700000000000002}]},{"osd":7,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.84099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":158072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.77000000000000002}]},{"osd":5,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.89000000000000001}]},{"osd":6,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.875}]},{"osd":7,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.85899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":442368,"data_stored":181525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.378},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":1.0309999999999999}]},{"osd":5,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.91600000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.0009999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.93500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":401408,"data_stored":158038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.374},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46400000000000002}]},{"osd":1,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.49099999999999999}]},{"osd":3,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.93799999999999994}]},{"osd":5,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.872},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.83999999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.80900000000000005}]},{"osd":7,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.85099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":430080,"data_stored":175358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.58799999999999997}]},{"osd":5,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.623}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":987136,"data_stored":747317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.37}]},{"osd":2,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.434},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.503}]},{"osd":4,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.78200000000000003}]},{"osd":5,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.83699999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.79800000000000004}]},{"osd":7,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.875},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.748}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:03:00.942 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T16:03:00.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T16:03:01.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.094+0000 7f00c4a00640 1 Processor -- start 2024-09-13T16:03:01.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.094+0000 7f00c4a00640 1 -- start start 2024-09-13T16:03:01.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.096+0000 7f00c4a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f00c00b40c0 0x7f00c015a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.096+0000 7f00c4a00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f00c00cbac0 0x7f00c015aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.096+0000 7f00c4a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c00cbfc0 con 0x7f00c015a5c0 2024-09-13T16:03:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.096+0000 7f00c4a00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c00cce20 con 0x7f00c00cbac0 2024-09-13T16:03:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.096+0000 7f00c4a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c00707a0 con 0x7f00c00b40c0 2024-09-13T16:03:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.096+0000 7f00bfe00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f00c00cbac0 0x7f00c015aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.096+0000 7f00bfe00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f00c00cbac0 0x7f00c015aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49114/0 (socket says 172.21.15.70:49114) 2024-09-13T16:03:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.096+0000 7f00bfe00640 1 -- 172.21.15.70:0/2643901877 learned_addr learned my addr 172.21.15.70:0/2643901877 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.096+0000 7f00b6a00640 1 --2- 172.21.15.70:0/2643901877 >> v2:172.21.15.107:3300/0 conn(0x7f00c00b40c0 0x7f00c015a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.096+0000 7f00bfe00640 1 -- 172.21.15.70:0/2643901877 >> v2:172.21.15.107:3300/0 conn(0x7f00c00b40c0 msgr2=0x7f00c015a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.096+0000 7f00bfe00640 1 --2- 172.21.15.70:0/2643901877 >> v2:172.21.15.107:3300/0 conn(0x7f00c00b40c0 0x7f00c015a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.096+0000 7f00bfe00640 1 -- 172.21.15.70:0/2643901877 >> v1:172.21.15.107:6789/0 conn(0x7f00c015a5c0 legacy=0x7f00c00b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.096+0000 7f00bfe00640 1 -- 172.21.15.70:0/2643901877 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c0070a80 con 0x7f00c00cbac0 2024-09-13T16:03:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.097+0000 7f00bfe00640 1 --2- 172.21.15.70:0/2643901877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00c00cbac0 0x7f00c015aee0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f00c0061c10 tx=0x7f00b802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c939b424b1f4e48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.098+0000 7f00bea00640 1 -- 172.21.15.70:0/2643901877 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8031600 con 0x7f00c00cbac0 2024-09-13T16:03:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.098+0000 7f00bea00640 1 -- 172.21.15.70:0/2643901877 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b802d050 con 0x7f00c00cbac0 2024-09-13T16:03:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.098+0000 7f00bea00640 1 -- 172.21.15.70:0/2643901877 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8031980 con 0x7f00c00cbac0 2024-09-13T16:03:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.098+0000 7f00c4a00640 1 -- 172.21.15.70:0/2643901877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00c00cbac0 msgr2=0x7f00c015aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.098+0000 7f00c4a00640 1 --2- 172.21.15.70:0/2643901877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00c00cbac0 0x7f00c015aee0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f00c0061c10 tx=0x7f00b802a660 comp rx=0 tx=0).stop 2024-09-13T16:03:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.098+0000 7f00c4a00640 1 -- 172.21.15.70:0/2643901877 shutdown_connections 2024-09-13T16:03:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.098+0000 7f00c4a00640 1 --2- 172.21.15.70:0/2643901877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00c00cbac0 0x7f00c015aee0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.098+0000 7f00c4a00640 1 --2- 172.21.15.70:0/2643901877 >> v2:172.21.15.107:3300/0 conn(0x7f00c00b40c0 0x7f00c015a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.098+0000 7f00c4a00640 1 -- 172.21.15.70:0/2643901877 >> 172.21.15.70:0/2643901877 conn(0x7f00c00ae310 msgr2=0x7f00c00ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.098+0000 7f00c4a00640 1 -- 172.21.15.70:0/2643901877 shutdown_connections 2024-09-13T16:03:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.098+0000 7f00c4a00640 1 -- 172.21.15.70:0/2643901877 wait complete. 2024-09-13T16:03:01.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.100+0000 7f00c4a00640 1 Processor -- start 2024-09-13T16:03:01.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.100+0000 7f00c4a00640 1 -- start start 2024-09-13T16:03:01.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.101+0000 7f00c4a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f00c00b40c0 0x7f00c0144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.101+0000 7f00c4a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00c00cbac0 0x7f00c00aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.101+0000 7f00c4a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00c015a5c0 0x7f00c01ef560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.101+0000 7f00c4a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c01efaa0 con 0x7f00c00cbac0 2024-09-13T16:03:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.101+0000 7f00c4a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c01447e0 con 0x7f00c015a5c0 2024-09-13T16:03:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.101+0000 7f00c4a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c00ab600 con 0x7f00c00b40c0 2024-09-13T16:03:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.101+0000 7f00b6a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00c00cbac0 0x7f00c00aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.101+0000 7f00b6a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00c00cbac0 0x7f00c00aaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49124/0 (socket says 172.21.15.70:49124) 2024-09-13T16:03:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.101+0000 7f00b6a00640 1 -- 172.21.15.70:0/3388290106 learned_addr learned my addr 172.21.15.70:0/3388290106 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.101+0000 7f00bfe00640 1 --2- 172.21.15.70:0/3388290106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00c015a5c0 0x7f00c01ef560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.101+0000 7f00bf400640 1 --2- 172.21.15.70:0/3388290106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f00c00b40c0 0x7f00c0144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.102+0000 7f00b6a00640 1 -- 172.21.15.70:0/3388290106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f00c00b40c0 msgr2=0x7f00c0144cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.102+0000 7f00b6a00640 1 --2- 172.21.15.70:0/3388290106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f00c00b40c0 0x7f00c0144cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.102+0000 7f00b6a00640 1 -- 172.21.15.70:0/3388290106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00c015a5c0 msgr2=0x7f00c01ef560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.102+0000 7f00b6a00640 1 --2- 172.21.15.70:0/3388290106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00c015a5c0 0x7f00c01ef560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.102+0000 7f00b6a00640 1 -- 172.21.15.70:0/3388290106 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b8009b30 con 0x7f00c00cbac0 2024-09-13T16:03:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.102+0000 7f00b6a00640 1 --2- 172.21.15.70:0/3388290106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00c00cbac0 0x7f00c00aaf00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f00a800d800 tx=0x7f00a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:01.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.102+0000 7f00b7e00640 1 -- 172.21.15.70:0/3388290106 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a800b6c0 con 0x7f00c00cbac0 2024-09-13T16:03:01.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.102+0000 7f00b7e00640 1 -- 172.21.15.70:0/3388290106 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a800b820 con 0x7f00c00cbac0 2024-09-13T16:03:01.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.102+0000 7f00c4a00640 1 -- 172.21.15.70:0/3388290106 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c00ab8e0 con 0x7f00c00cbac0 2024-09-13T16:03:01.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.102+0000 7f00b7e00640 1 -- 172.21.15.70:0/3388290106 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a800bbb0 con 0x7f00c00cbac0 2024-09-13T16:03:01.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.102+0000 7f00c4a00640 1 -- 172.21.15.70:0/3388290106 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c00abea0 con 0x7f00c00cbac0 2024-09-13T16:03:01.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.103+0000 7f00c4a00640 1 -- 172.21.15.70:0/3388290106 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c0067360 con 0x7f00c00cbac0 2024-09-13T16:03:01.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.104+0000 7f00b7e00640 1 -- 172.21.15.70:0/3388290106 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f00a800bd10 con 0x7f00c00cbac0 2024-09-13T16:03:01.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.105+0000 7f00b7e00640 1 --2- 172.21.15.70:0/3388290106 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f009c06ac00 0x7f009c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:01.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.105+0000 7f00b7e00640 1 -- 172.21.15.70:0/3388290106 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f00a80894f0 con 0x7f00c00cbac0 2024-09-13T16:03:01.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.105+0000 7f00bf400640 1 --2- 172.21.15.70:0/3388290106 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f009c06ac00 0x7f009c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:01.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.106+0000 7f00bf400640 1 --2- 172.21.15.70:0/3388290106 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f009c06ac00 0x7f009c06d0c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f00b0006fd0 tx=0x7f00b0009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:01.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.109+0000 7f00b7e00640 1 -- 172.21.15.70:0/3388290106 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f00a8054a10 con 0x7f00c00cbac0 2024-09-13T16:03:01.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.275+0000 7f00c4a00640 1 -- 172.21.15.70:0/3388290106 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00c0071280 con 0x7f009c06ac00 2024-09-13T16:03:01.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.277+0000 7f00b7e00640 1 -- 172.21.15.70:0/3388290106 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50399 (secure 0 0 0) 0x7f00b0009550 con 0x7f009c06ac00 2024-09-13T16:03:01.279 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:03:01.279 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-13T16:03:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.280+0000 7f00c4a00640 1 -- 172.21.15.70:0/3388290106 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f009c06ac00 msgr2=0x7f009c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.280+0000 7f00c4a00640 1 --2- 172.21.15.70:0/3388290106 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f009c06ac00 0x7f009c06d0c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f00b0006fd0 tx=0x7f00b0009060 comp rx=0 tx=0).stop 2024-09-13T16:03:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.280+0000 7f00c4a00640 1 -- 172.21.15.70:0/3388290106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00c00cbac0 msgr2=0x7f00c00aaf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.280+0000 7f00c4a00640 1 --2- 172.21.15.70:0/3388290106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00c00cbac0 0x7f00c00aaf00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f00a800d800 tx=0x7f00a800dcc0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.280+0000 7f00c4a00640 1 -- 172.21.15.70:0/3388290106 shutdown_connections 2024-09-13T16:03:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.280+0000 7f00c4a00640 1 --2- 172.21.15.70:0/3388290106 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f009c06ac00 0x7f009c06d0c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.280+0000 7f00c4a00640 1 --2- 172.21.15.70:0/3388290106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00c015a5c0 0x7f00c01ef560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.280+0000 7f00c4a00640 1 --2- 172.21.15.70:0/3388290106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00c00cbac0 0x7f00c00aaf00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.280+0000 7f00c4a00640 1 --2- 172.21.15.70:0/3388290106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f00c00b40c0 0x7f00c0144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.280+0000 7f00c4a00640 1 -- 172.21.15.70:0/3388290106 >> 172.21.15.70:0/3388290106 conn(0x7f00c00ae310 msgr2=0x7f00c006cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.280+0000 7f00c4a00640 1 -- 172.21.15.70:0/3388290106 shutdown_connections 2024-09-13T16:03:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.280+0000 7f00c4a00640 1 -- 172.21.15.70:0/3388290106 wait complete. 2024-09-13T16:03:01.297 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-09-13T16:03:00.037699+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236944,"kb_used_data":4404,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737776,"statfs":{"total":773094113280,"available":772851482624,"internally_reserved":0,"allocated":4509696,"data_stored":2504461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18166,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-86,"num_read_kb":-88,"num_write":-76,"num_write_kb":-44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001483"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T16:02:41.193278+0000","last_change":"2024-09-13T16:01:07.580186+0000","last_active":"2024-09-13T16:02:41.193278+0000","last_peered":"2024-09-13T16:02:41.193278+0000","last_clean":"2024-09-13T16:02:41.193278+0000","last_became_active":"2024-09-13T16:01:07.579877+0000","last_became_peered":"2024-09-13T16:01:07.579877+0000","last_unstale":"2024-09-13T16:02:41.193278+0000","last_undegraded":"2024-09-13T16:02:41.193278+0000","last_fullsized":"2024-09-13T16:02:41.193278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_clean_scrub_stamp":"2024-09-13T16:01:06.070807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:40.645649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":754593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.621},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.72999999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.79400000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.81200000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.68400000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.753},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.78100000000000003}]},{"osd":3,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.82599999999999996}]},{"osd":1,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.1230000000000002,"5min":5.1230000000000002,"15min":5.1230000000000002},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.752}]},{"osd":3,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.0750000000000002,"5min":5.0750000000000002,"15min":5.0750000000000002},"last":0.876},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.79100000000000004}]},{"osd":4,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.627},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.56399999999999995}]},{"osd":6,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.77700000000000002}]},{"osd":7,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.84099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":158072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.77000000000000002}]},{"osd":5,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.89000000000000001}]},{"osd":6,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.875}]},{"osd":7,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.85899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":442368,"data_stored":181525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.378},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":1.0309999999999999}]},{"osd":5,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.91600000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.0009999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.93500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":401408,"data_stored":158038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.374},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46400000000000002}]},{"osd":1,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.49099999999999999}]},{"osd":3,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.93799999999999994}]},{"osd":5,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.872},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.83999999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.80900000000000005}]},{"osd":7,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.85099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":430080,"data_stored":175358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.58799999999999997}]},{"osd":5,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.623}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":987136,"data_stored":747317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.37}]},{"osd":2,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.434},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.503}]},{"osd":4,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.78200000000000003}]},{"osd":5,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.83699999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.79800000000000004}]},{"osd":7,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.875},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.748}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:03:01.298 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:03:01.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.452+0000 7f4105400640 1 Processor -- start 2024-09-13T16:03:01.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.452+0000 7f4105400640 1 -- start start 2024-09-13T16:03:01.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.454+0000 7f4105400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f41000b1b00 0x7f41000cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:01.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.454+0000 7f4105400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f41000cde50 0x7f410015a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.454+0000 7f4105400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410006bea0 con 0x7f410015a520 2024-09-13T16:03:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.454+0000 7f4105400640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410006c180 con 0x7f41000cde50 2024-09-13T16:03:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.454+0000 7f4105400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410006c460 con 0x7f41000b1b00 2024-09-13T16:03:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.454+0000 7f40ff200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f41000cde50 0x7f410015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.454+0000 7f40ff200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f41000cde50 0x7f410015a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49138/0 (socket says 172.21.15.70:49138) 2024-09-13T16:03:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.454+0000 7f40ff200640 1 -- 172.21.15.70:0/2984328241 learned_addr learned my addr 172.21.15.70:0/2984328241 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.454+0000 7f40fde00640 1 --2- 172.21.15.70:0/2984328241 >> v2:172.21.15.107:3300/0 conn(0x7f41000b1b00 0x7f41000cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.454+0000 7f40ff200640 1 -- 172.21.15.70:0/2984328241 >> v2:172.21.15.107:3300/0 conn(0x7f41000b1b00 msgr2=0x7f41000cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.454+0000 7f40ff200640 1 --2- 172.21.15.70:0/2984328241 >> v2:172.21.15.107:3300/0 conn(0x7f41000b1b00 0x7f41000cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.454+0000 7f40ff200640 1 -- 172.21.15.70:0/2984328241 >> v1:172.21.15.107:6789/0 conn(0x7f410015a520 legacy=0x7f410006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.454+0000 7f40ff200640 1 -- 172.21.15.70:0/2984328241 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410006c740 con 0x7f41000cde50 2024-09-13T16:03:01.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.455+0000 7f40ff200640 1 --2- 172.21.15.70:0/2984328241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41000cde50 0x7f410015a900 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f410006bdd0 tx=0x7f40f802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4461e587dcfdbc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:01.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.456+0000 7f40fd400640 1 -- 172.21.15.70:0/2984328241 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f8031600 con 0x7f41000cde50 2024-09-13T16:03:01.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.456+0000 7f40fd400640 1 -- 172.21.15.70:0/2984328241 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f802d050 con 0x7f41000cde50 2024-09-13T16:03:01.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.456+0000 7f40fd400640 1 -- 172.21.15.70:0/2984328241 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f8031980 con 0x7f41000cde50 2024-09-13T16:03:01.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.456+0000 7f4105400640 1 -- 172.21.15.70:0/2984328241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41000cde50 msgr2=0x7f410015a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:01.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.456+0000 7f4105400640 1 --2- 172.21.15.70:0/2984328241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41000cde50 0x7f410015a900 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f410006bdd0 tx=0x7f40f802a730 comp rx=0 tx=0).stop 2024-09-13T16:03:01.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.456+0000 7f4105400640 1 -- 172.21.15.70:0/2984328241 shutdown_connections 2024-09-13T16:03:01.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.456+0000 7f4105400640 1 --2- 172.21.15.70:0/2984328241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41000cde50 0x7f410015a900 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.456+0000 7f4105400640 1 --2- 172.21.15.70:0/2984328241 >> v2:172.21.15.107:3300/0 conn(0x7f41000b1b00 0x7f41000cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.456+0000 7f4105400640 1 -- 172.21.15.70:0/2984328241 >> 172.21.15.70:0/2984328241 conn(0x7f41000b0510 msgr2=0x7f41000b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:01.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.456+0000 7f4105400640 1 -- 172.21.15.70:0/2984328241 shutdown_connections 2024-09-13T16:03:01.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.457+0000 7f4105400640 1 -- 172.21.15.70:0/2984328241 wait complete. 2024-09-13T16:03:01.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.458+0000 7f4105400640 1 Processor -- start 2024-09-13T16:03:01.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.459+0000 7f4105400640 1 -- start start 2024-09-13T16:03:01.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.459+0000 7f4105400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41000b1b00 0x7f4100155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:01.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.459+0000 7f4105400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41000cde50 0x7f4100155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:01.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.459+0000 7f4105400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f410015a520 0x7f41001589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.460+0000 7f4105400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41001e4010 con 0x7f41000b1b00 2024-09-13T16:03:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.460+0000 7f4105400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4100155870 con 0x7f41000cde50 2024-09-13T16:03:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.460+0000 7f4105400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41001563c0 con 0x7f410015a520 2024-09-13T16:03:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.460+0000 7f40fe800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41000b1b00 0x7f4100155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.460+0000 7f40fe800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41000b1b00 0x7f4100155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49144/0 (socket says 172.21.15.70:49144) 2024-09-13T16:03:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.460+0000 7f40fe800640 1 -- 172.21.15.70:0/2119258456 learned_addr learned my addr 172.21.15.70:0/2119258456 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.460+0000 7f40fde00640 1 --2- 172.21.15.70:0/2119258456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41000cde50 0x7f4100155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.460+0000 7f40ff200640 1 --2- 172.21.15.70:0/2119258456 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f410015a520 0x7f41001589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.460+0000 7f40fe800640 1 -- 172.21.15.70:0/2119258456 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f410015a520 msgr2=0x7f41001589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.460+0000 7f40fe800640 1 --2- 172.21.15.70:0/2119258456 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f410015a520 0x7f41001589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.460+0000 7f40fe800640 1 -- 172.21.15.70:0/2119258456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41000cde50 msgr2=0x7f4100155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:01.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.460+0000 7f40fe800640 1 --2- 172.21.15.70:0/2119258456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41000cde50 0x7f4100155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.460+0000 7f40fe800640 1 -- 172.21.15.70:0/2119258456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f8009b30 con 0x7f41000b1b00 2024-09-13T16:03:01.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.461+0000 7f40fe800640 1 --2- 172.21.15.70:0/2119258456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41000b1b00 0x7f4100155330 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f40f000c400 tx=0x7f40f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:01.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.461+0000 7f40f6a00640 1 -- 172.21.15.70:0/2119258456 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f00052d0 con 0x7f41000b1b00 2024-09-13T16:03:01.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.461+0000 7f40f6a00640 1 -- 172.21.15.70:0/2119258456 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f0005430 con 0x7f41000b1b00 2024-09-13T16:03:01.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.461+0000 7f40f6a00640 1 -- 172.21.15.70:0/2119258456 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f0003830 con 0x7f41000b1b00 2024-09-13T16:03:01.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.461+0000 7f4105400640 1 -- 172.21.15.70:0/2119258456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41001566a0 con 0x7f41000b1b00 2024-09-13T16:03:01.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.461+0000 7f4105400640 1 -- 172.21.15.70:0/2119258456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4100156c60 con 0x7f41000b1b00 2024-09-13T16:03:01.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.462+0000 7f4105400640 1 -- 172.21.15.70:0/2119258456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41000cd910 con 0x7f41000b1b00 2024-09-13T16:03:01.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.464+0000 7f40f6a00640 1 -- 172.21.15.70:0/2119258456 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f40f0003990 con 0x7f41000b1b00 2024-09-13T16:03:01.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.465+0000 7f40f6a00640 1 --2- 172.21.15.70:0/2119258456 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f40e006ac00 0x7f40e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:01.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.465+0000 7f40f6a00640 1 -- 172.21.15.70:0/2119258456 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f40f0088620 con 0x7f41000b1b00 2024-09-13T16:03:01.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.465+0000 7f40fde00640 1 --2- 172.21.15.70:0/2119258456 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f40e006ac00 0x7f40e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:01.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.466+0000 7f40fde00640 1 --2- 172.21.15.70:0/2119258456 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f40e006ac00 0x7f40e006d0c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f41000ae9a0 tx=0x7f40ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:01.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.469+0000 7f40f6a00640 1 -- 172.21.15.70:0/2119258456 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f40f0053ac0 con 0x7f41000b1b00 2024-09-13T16:03:01.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.646+0000 7f4105400640 1 -- 172.21.15.70:0/2119258456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f410006a6c0 con 0x7f41000b1b00 2024-09-13T16:03:01.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.647+0000 7f40f6a00640 1 -- 172.21.15.70:0/2119258456 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+13082 (secure 0 0 0) 0x7f40f0017090 con 0x7f41000b1b00 2024-09-13T16:03:01.648 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:03:01.648 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":38,"fsid":"f906ab4b-6171-41ec-a825-cd0f700d3930","created":"2024-09-13T16:00:53.369886+0000","modified":"2024-09-13T16:02:57.245793+0000","last_up_change":"2024-09-13T16:01:05.046482+0000","last_in_change":"2024-09-13T16:00:56.225049+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:01:06.070694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8dec6c32-1d39-4787-b3df-55ce88a5c1cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6823","nonce":1697557929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6827","nonce":1697557929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6831","nonce":1697557929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1697557929},{"type":"v1","addr":"172.21.15.70:6829","nonce":1697557929}]},"public_addr":"172.21.15.70:6823/1697557929","cluster_addr":"172.21.15.70:6827/1697557929","heartbeat_back_addr":"172.21.15.70:6831/1697557929","heartbeat_front_addr":"172.21.15.70:6829/1697557929","state":["exists","up"]},{"osd":1,"uuid":"050c6d8a-a187-49cb-866a-0067bb72db0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6817","nonce":523483066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6819","nonce":523483066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6825","nonce":523483066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":523483066},{"type":"v1","addr":"172.21.15.70:6822","nonce":523483066}]},"public_addr":"172.21.15.70:6817/523483066","cluster_addr":"172.21.15.70:6819/523483066","heartbeat_back_addr":"172.21.15.70:6825/523483066","heartbeat_front_addr":"172.21.15.70:6822/523483066","state":["exists","up"]},{"osd":2,"uuid":"880e9f9f-e7eb-4dd3-8323-f9b71c6f78c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6801","nonce":313203511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6803","nonce":313203511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6807","nonce":313203511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":313203511},{"type":"v1","addr":"172.21.15.70:6805","nonce":313203511}]},"public_addr":"172.21.15.70:6801/313203511","cluster_addr":"172.21.15.70:6803/313203511","heartbeat_back_addr":"172.21.15.70:6807/313203511","heartbeat_front_addr":"172.21.15.70:6805/313203511","state":["exists","up"]},{"osd":3,"uuid":"aed25332-b55f-46b9-9f74-2d313b8a41cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6809","nonce":4231595789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6811","nonce":4231595789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6815","nonce":4231595789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4231595789},{"type":"v1","addr":"172.21.15.70:6813","nonce":4231595789}]},"public_addr":"172.21.15.70:6809/4231595789","cluster_addr":"172.21.15.70:6811/4231595789","heartbeat_back_addr":"172.21.15.70:6815/4231595789","heartbeat_front_addr":"172.21.15.70:6813/4231595789","state":["exists","up"]},{"osd":4,"uuid":"e877320e-4e3f-4f62-af07-4331b6a0a2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6801","nonce":679436451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6803","nonce":679436451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6807","nonce":679436451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":679436451},{"type":"v1","addr":"172.21.15.107:6805","nonce":679436451}]},"public_addr":"172.21.15.107:6801/679436451","cluster_addr":"172.21.15.107:6803/679436451","heartbeat_back_addr":"172.21.15.107:6807/679436451","heartbeat_front_addr":"172.21.15.107:6805/679436451","state":["exists","up"]},{"osd":5,"uuid":"9d3bca4f-e5dc-454d-be9a-e98f963ca7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6811","nonce":951062155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6813","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6815","nonce":951062155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6821","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6824","nonce":951062155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6817","nonce":951062155},{"type":"v1","addr":"172.21.15.107:6819","nonce":951062155}]},"public_addr":"172.21.15.107:6811/951062155","cluster_addr":"172.21.15.107:6815/951062155","heartbeat_back_addr":"172.21.15.107:6824/951062155","heartbeat_front_addr":"172.21.15.107:6819/951062155","state":["exists","up"]},{"osd":6,"uuid":"d48b87d8-4488-4713-952b-26d2fe528433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6825","nonce":3873935546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6827","nonce":3873935546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6831","nonce":3873935546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3873935546},{"type":"v1","addr":"172.21.15.107:6829","nonce":3873935546}]},"public_addr":"172.21.15.107:6825/3873935546","cluster_addr":"172.21.15.107:6827/3873935546","heartbeat_back_addr":"172.21.15.107:6831/3873935546","heartbeat_front_addr":"172.21.15.107:6829/3873935546","state":["exists","up"]},{"osd":7,"uuid":"97f8a857-5960-41a4-851f-c018456211e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6810","nonce":2642179308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6814","nonce":2642179308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6823","nonce":2642179308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2642179308},{"type":"v1","addr":"172.21.15.107:6818","nonce":2642179308}]},"public_addr":"172.21.15.107:6810/2642179308","cluster_addr":"172.21.15.107:6814/2642179308","heartbeat_back_addr":"172.21.15.107:6823/2642179308","heartbeat_front_addr":"172.21.15.107:6818/2642179308","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.606815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.593233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.417461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.542979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.491351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.875811+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.842574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:01:01.603289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6835/2709979655":"2024-09-14T16:02:54.131103+0000","172.21.15.107:6833/2709979655":"2024-09-14T16:02:54.131103+0000","172.21.15.70:6837/3554365995":"2024-09-14T16:02:41.167987+0000","172.21.15.70:6835/3554365995":"2024-09-14T16:02:41.167987+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:03:01.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.649+0000 7f4105400640 1 -- 172.21.15.70:0/2119258456 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f40e006ac00 msgr2=0x7f40e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:01.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.649+0000 7f4105400640 1 --2- 172.21.15.70:0/2119258456 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f40e006ac00 0x7f40e006d0c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f41000ae9a0 tx=0x7f40ec008040 comp rx=0 tx=0).stop 2024-09-13T16:03:01.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.649+0000 7f4105400640 1 -- 172.21.15.70:0/2119258456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41000b1b00 msgr2=0x7f4100155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:01.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.649+0000 7f4105400640 1 --2- 172.21.15.70:0/2119258456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41000b1b00 0x7f4100155330 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f40f000c400 tx=0x7f40f000c8c0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.649+0000 7f4105400640 1 -- 172.21.15.70:0/2119258456 shutdown_connections 2024-09-13T16:03:01.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.649+0000 7f4105400640 1 --2- 172.21.15.70:0/2119258456 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f410015a520 0x7f41001589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.649+0000 7f4105400640 1 --2- 172.21.15.70:0/2119258456 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f40e006ac00 0x7f40e006d0c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.649+0000 7f4105400640 1 --2- 172.21.15.70:0/2119258456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41000cde50 0x7f4100155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.649+0000 7f4105400640 1 --2- 172.21.15.70:0/2119258456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41000b1b00 0x7f4100155330 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:01.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.649+0000 7f4105400640 1 -- 172.21.15.70:0/2119258456 >> 172.21.15.70:0/2119258456 conn(0x7f41000b0510 msgr2=0x7f41000ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:01.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.649+0000 7f4105400640 1 -- 172.21.15.70:0/2119258456 shutdown_connections 2024-09-13T16:03:01.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:01.649+0000 7f4105400640 1 -- 172.21.15.70:0/2119258456 wait complete. 2024-09-13T16:03:02.668 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T16:03:02.668 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T16:03:02.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.826+0000 7fd3f9600640 1 Processor -- start 2024-09-13T16:03:02.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.826+0000 7fd3f9600640 1 -- start start 2024-09-13T16:03:02.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.827+0000 7fd3f9600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd3f40cdf80 0x7fd3f40b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:02.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.827+0000 7fd3f9600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f4151a20 con 0x7fd3f415b770 2024-09-13T16:03:02.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.827+0000 7fd3f9600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f40cc430 con 0x7fd3f406cd60 2024-09-13T16:03:02.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.827+0000 7fd3f9600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f40b1bb0 con 0x7fd3f40cdf80 2024-09-13T16:03:02.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.827+0000 7fd3f2000640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd3f415b770 0x7fd3f40cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50728/0 (socket says 172.21.15.70:50728) 2024-09-13T16:03:02.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.827+0000 7fd3f2000640 1 -- 172.21.15.70:0/1315681732 learned_addr learned my addr 172.21.15.70:0/1315681732 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:03:02.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.828+0000 7fd3f3400640 1 --2- 172.21.15.70:0/1315681732 >> v2:172.21.15.107:3300/0 conn(0x7fd3f40cdf80 0x7fd3f40b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:02.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.828+0000 7fd3f1600640 1 -- 172.21.15.70:0/1315681732 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117324634 0 0) 0x7fd3f4151a20 con 0x7fd3f415b770 2024-09-13T16:03:02.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.828+0000 7fd3f1600640 1 -- 172.21.15.70:0/1315681732 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3d8003520 con 0x7fd3f415b770 2024-09-13T16:03:02.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.828+0000 7fd3f1600640 1 -- 172.21.15.70:0/1315681732 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463539807 0 0) 0x7fd3f40cc430 con 0x7fd3f406cd60 2024-09-13T16:03:02.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.828+0000 7fd3f1600640 1 -- 172.21.15.70:0/1315681732 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3f4151a20 con 0x7fd3f406cd60 2024-09-13T16:03:02.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.828+0000 7fd3f3400640 1 -- 172.21.15.70:0/1315681732 >> v1:172.21.15.107:6789/0 conn(0x7fd3f406cd60 legacy=0x7fd3f40cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:02.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.828+0000 7fd3f3400640 1 -- 172.21.15.70:0/1315681732 >> v1:172.21.15.70:6789/0 conn(0x7fd3f415b770 legacy=0x7fd3f40cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:02.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.828+0000 7fd3f3400640 1 -- 172.21.15.70:0/1315681732 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f40b1e70 con 0x7fd3f40cdf80 2024-09-13T16:03:02.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.829+0000 7fd3f3400640 1 --2- 172.21.15.70:0/1315681732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3f40cdf80 0x7fd3f40b2950 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009d90 tx=0x7fd3ec02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3b6018c756b13d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:02.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.829+0000 7fd3f1600640 1 -- 172.21.15.70:0/1315681732 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec007740 con 0x7fd3f40cdf80 2024-09-13T16:03:02.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.829+0000 7fd3f1600640 1 -- 172.21.15.70:0/1315681732 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ec02d050 con 0x7fd3f40cdf80 2024-09-13T16:03:02.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.830+0000 7fd3f1600640 1 -- 172.21.15.70:0/1315681732 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec007aa0 con 0x7fd3f40cdf80 2024-09-13T16:03:02.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.830+0000 7fd3f9600640 1 -- 172.21.15.70:0/1315681732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3f40cdf80 msgr2=0x7fd3f40b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:02.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.830+0000 7fd3f9600640 1 --2- 172.21.15.70:0/1315681732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3f40cdf80 0x7fd3f40b2950 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009d90 tx=0x7fd3ec02a6f0 comp rx=0 tx=0).stop 2024-09-13T16:03:02.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.830+0000 7fd3f9600640 1 -- 172.21.15.70:0/1315681732 shutdown_connections 2024-09-13T16:03:02.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.830+0000 7fd3f9600640 1 --2- 172.21.15.70:0/1315681732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3f40cdf80 0x7fd3f40b2950 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:02.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.830+0000 7fd3f9600640 1 -- 172.21.15.70:0/1315681732 >> 172.21.15.70:0/1315681732 conn(0x7fd3f40b0510 msgr2=0x7fd3f40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:02.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.830+0000 7fd3f9600640 1 -- 172.21.15.70:0/1315681732 shutdown_connections 2024-09-13T16:03:02.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.830+0000 7fd3f9600640 1 -- 172.21.15.70:0/1315681732 wait complete. 2024-09-13T16:03:02.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.832+0000 7fd3f9600640 1 Processor -- start 2024-09-13T16:03:02.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.832+0000 7fd3f9600640 1 -- start start 2024-09-13T16:03:02.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.833+0000 7fd3f9600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3f406cd60 0x7fd3f41470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:02.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.833+0000 7fd3f9600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3f40cdf80 0x7fd3f414ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:02.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.833+0000 7fd3f9600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3f415b770 0x7fd3f4154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:02.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.833+0000 7fd3f9600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4146c10 con 0x7fd3f415b770 2024-09-13T16:03:02.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.833+0000 7fd3f9600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4145d20 con 0x7fd3f40cdf80 2024-09-13T16:03:02.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.833+0000 7fd3f9600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4146000 con 0x7fd3f406cd60 2024-09-13T16:03:02.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.833+0000 7fd3f3400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3f415b770 0x7fd3f4154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:02.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.833+0000 7fd3f3400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3f415b770 0x7fd3f4154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49146/0 (socket says 172.21.15.70:49146) 2024-09-13T16:03:02.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.833+0000 7fd3f3400640 1 -- 172.21.15.70:0/3752004828 learned_addr learned my addr 172.21.15.70:0/3752004828 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:02.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.833+0000 7fd3f2a00640 1 --2- 172.21.15.70:0/3752004828 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3f406cd60 0x7fd3f41470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:02.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.833+0000 7fd3f2000640 1 --2- 172.21.15.70:0/3752004828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3f40cdf80 0x7fd3f414ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:02.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.833+0000 7fd3f3400640 1 -- 172.21.15.70:0/3752004828 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3f406cd60 msgr2=0x7fd3f41470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:02.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.833+0000 7fd3f3400640 1 --2- 172.21.15.70:0/3752004828 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3f406cd60 0x7fd3f41470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:02.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.833+0000 7fd3f3400640 1 -- 172.21.15.70:0/3752004828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3f40cdf80 msgr2=0x7fd3f414ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:02.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.833+0000 7fd3f3400640 1 --2- 172.21.15.70:0/3752004828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3f40cdf80 0x7fd3f414ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:02.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.833+0000 7fd3f3400640 1 -- 172.21.15.70:0/3752004828 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ec009a70 con 0x7fd3f415b770 2024-09-13T16:03:02.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.833+0000 7fd3f2000640 1 --2- 172.21.15.70:0/3752004828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3f40cdf80 0x7fd3f414ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:03:02.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.834+0000 7fd3f3400640 1 --2- 172.21.15.70:0/3752004828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3f415b770 0x7fd3f4154690 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009eb0 tx=0x7fd3ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:02.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.834+0000 7fd3eaa00640 1 -- 172.21.15.70:0/3752004828 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec03c830 con 0x7fd3f415b770 2024-09-13T16:03:02.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.834+0000 7fd3eaa00640 1 -- 172.21.15.70:0/3752004828 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ec03c9b0 con 0x7fd3f415b770 2024-09-13T16:03:02.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.834+0000 7fd3eaa00640 1 -- 172.21.15.70:0/3752004828 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec03cd60 con 0x7fd3f415b770 2024-09-13T16:03:02.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.834+0000 7fd3f9600640 1 -- 172.21.15.70:0/3752004828 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f41462e0 con 0x7fd3f415b770 2024-09-13T16:03:02.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.834+0000 7fd3f9600640 1 -- 172.21.15.70:0/3752004828 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f41468a0 con 0x7fd3f415b770 2024-09-13T16:03:02.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.835+0000 7fd3f9600640 1 -- 172.21.15.70:0/3752004828 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd3f40b3a70 con 0x7fd3f415b770 2024-09-13T16:03:02.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.836+0000 7fd3eaa00640 1 -- 172.21.15.70:0/3752004828 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd3ec031400 con 0x7fd3f415b770 2024-09-13T16:03:02.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.837+0000 7fd3eaa00640 1 --2- 172.21.15.70:0/3752004828 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd3d406ac00 0x7fd3d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:02.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.837+0000 7fd3eaa00640 1 -- 172.21.15.70:0/3752004828 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd3ec0aa9a0 con 0x7fd3f415b770 2024-09-13T16:03:02.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.837+0000 7fd3eaa00640 1 --2- 172.21.15.70:0/3752004828 >> [v2:172.21.15.70:6821/1697557929,v1:172.21.15.70:6823/1697557929] conn(0x7fd3d4070b00 0x7fd3d4072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:02.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.837+0000 7fd3f2a00640 1 --2- 172.21.15.70:0/3752004828 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd3d406ac00 0x7fd3d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:02.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.837+0000 7fd3eaa00640 1 -- 172.21.15.70:0/3752004828 --> [v2:172.21.15.70:6821/1697557929,v1:172.21.15.70:6823/1697557929] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd3d40735d0 con 0x7fd3d4070b00 2024-09-13T16:03:02.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.837+0000 7fd3eaa00640 1 -- 172.21.15.70:0/3752004828 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3ec0af2a0 con 0x7fd3f415b770 2024-09-13T16:03:02.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.837+0000 7fd3f2000640 1 --2- 172.21.15.70:0/3752004828 >> [v2:172.21.15.70:6821/1697557929,v1:172.21.15.70:6823/1697557929] conn(0x7fd3d4070b00 0x7fd3d4072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:02.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.838+0000 7fd3f2a00640 1 --2- 172.21.15.70:0/3752004828 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd3d406ac00 0x7fd3d406d0c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4007fd0 tx=0x7fd3e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:02.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.838+0000 7fd3f2000640 1 --2- 172.21.15.70:0/3752004828 >> [v2:172.21.15.70:6821/1697557929,v1:172.21.15.70:6823/1697557929] conn(0x7fd3d4070b00 0x7fd3d4072f20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:02.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.838+0000 7fd3eaa00640 1 -- 172.21.15.70:0/3752004828 <== osd.0 v2:172.21.15.70:6821/1697557929 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd3d40735d0 con 0x7fd3d4070b00 2024-09-13T16:03:02.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.851+0000 7fd3f9600640 1 -- 172.21.15.70:0/3752004828 --> [v2:172.21.15.70:6821/1697557929,v1:172.21.15.70:6823/1697557929] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd3f40b2430 con 0x7fd3d4070b00 2024-09-13T16:03:02.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.851+0000 7fd3eaa00640 1 -- 172.21.15.70:0/3752004828 <== osd.0 v2:172.21.15.70:6821/1697557929 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd3e0001960 con 0x7fd3d4070b00 2024-09-13T16:03:02.852 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-13T16:03:02.853 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T16:03:02.853 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-13T16:03:02.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.851+0000 7fd3f9600640 1 -- 172.21.15.70:0/3752004828 >> [v2:172.21.15.70:6821/1697557929,v1:172.21.15.70:6823/1697557929] conn(0x7fd3d4070b00 msgr2=0x7fd3d4072f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:02.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.851+0000 7fd3f9600640 1 --2- 172.21.15.70:0/3752004828 >> [v2:172.21.15.70:6821/1697557929,v1:172.21.15.70:6823/1697557929] conn(0x7fd3d4070b00 0x7fd3d4072f20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:02.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.852+0000 7fd3f9600640 1 -- 172.21.15.70:0/3752004828 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd3d406ac00 msgr2=0x7fd3d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:02.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.852+0000 7fd3f9600640 1 --2- 172.21.15.70:0/3752004828 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd3d406ac00 0x7fd3d406d0c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4007fd0 tx=0x7fd3e4009040 comp rx=0 tx=0).stop 2024-09-13T16:03:02.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.852+0000 7fd3f9600640 1 -- 172.21.15.70:0/3752004828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3f415b770 msgr2=0x7fd3f4154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:02.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.852+0000 7fd3f9600640 1 --2- 172.21.15.70:0/3752004828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3f415b770 0x7fd3f4154690 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009eb0 tx=0x7fd3ec004a40 comp rx=0 tx=0).stop 2024-09-13T16:03:02.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.852+0000 7fd3f3400640 1 -- 172.21.15.70:0/3752004828 reap_dead start 2024-09-13T16:03:02.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.852+0000 7fd3f9600640 1 -- 172.21.15.70:0/3752004828 shutdown_connections 2024-09-13T16:03:02.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.852+0000 7fd3f9600640 1 -- 172.21.15.70:0/3752004828 >> 172.21.15.70:0/3752004828 conn(0x7fd3f40b0510 msgr2=0x7fd3f4151c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:02.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.852+0000 7fd3f9600640 1 -- 172.21.15.70:0/3752004828 shutdown_connections 2024-09-13T16:03:02.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:02.852+0000 7fd3f9600640 1 -- 172.21.15.70:0/3752004828 wait complete. 2024-09-13T16:03:02.867 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T16:03:03.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.019+0000 7f8e49000640 1 Processor -- start 2024-09-13T16:03:03.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.019+0000 7f8e49000640 1 -- start start 2024-09-13T16:03:03.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.020+0000 7f8e49000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8e44153b20 0x7f8e440b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.020+0000 7f8e49000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8e4406f660 0x7f8e4406fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.020+0000 7f8e49000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e44153f00 con 0x7f8e44159a80 2024-09-13T16:03:03.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.020+0000 7f8e49000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e440ce600 con 0x7f8e44153b20 2024-09-13T16:03:03.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.020+0000 7f8e49000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e44070f90 con 0x7f8e4406f660 2024-09-13T16:03:03.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.021+0000 7f8e42800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8e4406f660 0x7f8e4406fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.021+0000 7f8e42800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8e4406f660 0x7f8e4406fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.70:45332/0 (socket says 172.21.15.70:45332) 2024-09-13T16:03:03.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.021+0000 7f8e39400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f8e44159a80 0x7f8e440b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.70:43162/0 (socket says 172.21.15.70:43162) 2024-09-13T16:03:03.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.021+0000 7f8e42800640 1 -- 172.21.15.70:0/3430312715 learned_addr learned my addr 172.21.15.70:0/3430312715 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:03.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.021+0000 7f8e41e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8e44153b20 0x7f8e440b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.021+0000 7f8e42800640 1 -- 172.21.15.70:0/3430312715 >> v2:172.21.15.107:3300/0 conn(0x7f8e44153b20 msgr2=0x7f8e440b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:03.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.021+0000 7f8e42800640 1 --2- 172.21.15.70:0/3430312715 >> v2:172.21.15.107:3300/0 conn(0x7f8e44153b20 0x7f8e440b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.021+0000 7f8e42800640 1 -- 172.21.15.70:0/3430312715 >> v1:172.21.15.107:6789/0 conn(0x7f8e44159a80 legacy=0x7f8e440b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.021+0000 7f8e42800640 1 -- 172.21.15.70:0/3430312715 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e440b1a40 con 0x7f8e4406f660 2024-09-13T16:03:03.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.022+0000 7f8e42800640 1 --2- 172.21.15.70:0/3430312715 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8e4406f660 0x7f8e4406fad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009e50 tx=0x7f8e3c02a730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c61c0adf9db7d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:03.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.023+0000 7f8e41400640 1 -- 172.21.15.70:0/3430312715 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c031600 con 0x7f8e4406f660 2024-09-13T16:03:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.023+0000 7f8e41400640 1 -- 172.21.15.70:0/3430312715 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c02d050 con 0x7f8e4406f660 2024-09-13T16:03:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.023+0000 7f8e41400640 1 -- 172.21.15.70:0/3430312715 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c031980 con 0x7f8e4406f660 2024-09-13T16:03:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.023+0000 7f8e49000640 1 -- 172.21.15.70:0/3430312715 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8e4406f660 msgr2=0x7f8e4406fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.023+0000 7f8e49000640 1 --2- 172.21.15.70:0/3430312715 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8e4406f660 0x7f8e4406fad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009e50 tx=0x7f8e3c02a730 comp rx=0 tx=0).stop 2024-09-13T16:03:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.023+0000 7f8e49000640 1 -- 172.21.15.70:0/3430312715 shutdown_connections 2024-09-13T16:03:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.023+0000 7f8e49000640 1 --2- 172.21.15.70:0/3430312715 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8e4406f660 0x7f8e4406fad0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.023+0000 7f8e49000640 1 --2- 172.21.15.70:0/3430312715 >> v2:172.21.15.107:3300/0 conn(0x7f8e44153b20 0x7f8e440b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.023+0000 7f8e49000640 1 -- 172.21.15.70:0/3430312715 >> 172.21.15.70:0/3430312715 conn(0x7f8e440b0510 msgr2=0x7f8e440b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.023+0000 7f8e49000640 1 -- 172.21.15.70:0/3430312715 shutdown_connections 2024-09-13T16:03:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.023+0000 7f8e49000640 1 -- 172.21.15.70:0/3430312715 wait complete. 2024-09-13T16:03:03.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.025+0000 7f8e49000640 1 Processor -- start 2024-09-13T16:03:03.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.025+0000 7f8e49000640 1 -- start start 2024-09-13T16:03:03.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.026+0000 7f8e49000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e4406f660 0x7f8e441470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.026+0000 7f8e49000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e44153b20 0x7f8e4415b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.026+0000 7f8e49000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8e44159a80 0x7f8e44154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.026+0000 7f8e49000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e441f20a0 con 0x7f8e44153b20 2024-09-13T16:03:03.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.026+0000 7f8e49000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e441475f0 con 0x7f8e4406f660 2024-09-13T16:03:03.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.026+0000 7f8e49000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e441f5aa0 con 0x7f8e44159a80 2024-09-13T16:03:03.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.026+0000 7f8e39400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e44153b20 0x7f8e4415b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.026+0000 7f8e39400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e44153b20 0x7f8e4415b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49148/0 (socket says 172.21.15.70:49148) 2024-09-13T16:03:03.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.026+0000 7f8e39400640 1 -- 172.21.15.70:0/338462829 learned_addr learned my addr 172.21.15.70:0/338462829 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:03.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.026+0000 7f8e42800640 1 --2- 172.21.15.70:0/338462829 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8e44159a80 0x7f8e44154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.026+0000 7f8e41e00640 1 --2- 172.21.15.70:0/338462829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e4406f660 0x7f8e441470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.027+0000 7f8e39400640 1 -- 172.21.15.70:0/338462829 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8e44159a80 msgr2=0x7f8e44154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.027+0000 7f8e39400640 1 --2- 172.21.15.70:0/338462829 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8e44159a80 0x7f8e44154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.027+0000 7f8e39400640 1 -- 172.21.15.70:0/338462829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e4406f660 msgr2=0x7f8e441470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.027+0000 7f8e39400640 1 --2- 172.21.15.70:0/338462829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e4406f660 0x7f8e441470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.027+0000 7f8e39400640 1 -- 172.21.15.70:0/338462829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c009b30 con 0x7f8e44153b20 2024-09-13T16:03:03.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.027+0000 7f8e39400640 1 --2- 172.21.15.70:0/338462829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e44153b20 0x7f8e4415b1c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00c4d0 tx=0x7f8e2c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:03.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.027+0000 7f8e3aa00640 1 -- 172.21.15.70:0/338462829 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c007480 con 0x7f8e44153b20 2024-09-13T16:03:03.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.027+0000 7f8e3aa00640 1 -- 172.21.15.70:0/338462829 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c0075e0 con 0x7f8e44153b20 2024-09-13T16:03:03.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.027+0000 7f8e3aa00640 1 -- 172.21.15.70:0/338462829 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c0049e0 con 0x7f8e44153b20 2024-09-13T16:03:03.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.027+0000 7f8e49000640 1 -- 172.21.15.70:0/338462829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e441f5d80 con 0x7f8e44153b20 2024-09-13T16:03:03.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.028+0000 7f8e49000640 1 -- 172.21.15.70:0/338462829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e441f6340 con 0x7f8e44153b20 2024-09-13T16:03:03.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.029+0000 7f8e49000640 1 -- 172.21.15.70:0/338462829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e440b3990 con 0x7f8e44153b20 2024-09-13T16:03:03.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.029+0000 7f8e3aa00640 1 -- 172.21.15.70:0/338462829 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8e2c004b40 con 0x7f8e44153b20 2024-09-13T16:03:03.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.030+0000 7f8e3aa00640 1 --2- 172.21.15.70:0/338462829 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f8e2006ac00 0x7f8e2006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.030+0000 7f8e3aa00640 1 -- 172.21.15.70:0/338462829 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8e2c088240 con 0x7f8e44153b20 2024-09-13T16:03:03.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.031+0000 7f8e41e00640 1 --2- 172.21.15.70:0/338462829 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f8e2006ac00 0x7f8e2006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.031+0000 7f8e41e00640 1 --2- 172.21.15.70:0/338462829 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f8e2006ac00 0x7f8e2006d0c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009aa0 tx=0x7f8e34009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:03.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.034+0000 7f8e3aa00640 1 -- 172.21.15.70:0/338462829 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8e2c0536d0 con 0x7f8e44153b20 2024-09-13T16:03:03.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.202+0000 7f8e49000640 1 -- 172.21.15.70:0/338462829 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e4415a7b0 con 0x7f8e2006ac00 2024-09-13T16:03:03.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.203+0000 7f8e3aa00640 1 -- 172.21.15.70:0/338462829 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8e34011a00 con 0x7f8e2006ac00 2024-09-13T16:03:03.204 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T16:03:03.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.205+0000 7f8e49000640 1 -- 172.21.15.70:0/338462829 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f8e2006ac00 msgr2=0x7f8e2006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.205+0000 7f8e49000640 1 --2- 172.21.15.70:0/338462829 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f8e2006ac00 0x7f8e2006d0c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009aa0 tx=0x7f8e34009190 comp rx=0 tx=0).stop 2024-09-13T16:03:03.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.205+0000 7f8e49000640 1 -- 172.21.15.70:0/338462829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e44153b20 msgr2=0x7f8e4415b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.205+0000 7f8e49000640 1 --2- 172.21.15.70:0/338462829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e44153b20 0x7f8e4415b1c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00c4d0 tx=0x7f8e2c00c990 comp rx=0 tx=0).stop 2024-09-13T16:03:03.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.205+0000 7f8e49000640 1 -- 172.21.15.70:0/338462829 shutdown_connections 2024-09-13T16:03:03.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.205+0000 7f8e49000640 1 --2- 172.21.15.70:0/338462829 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8e44159a80 0x7f8e44154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.205+0000 7f8e49000640 1 --2- 172.21.15.70:0/338462829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e44153b20 0x7f8e4415b1c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.205+0000 7f8e49000640 1 --2- 172.21.15.70:0/338462829 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f8e2006ac00 0x7f8e2006d0c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.205+0000 7f8e49000640 1 --2- 172.21.15.70:0/338462829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e4406f660 0x7f8e441470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.205+0000 7f8e49000640 1 -- 172.21.15.70:0/338462829 >> 172.21.15.70:0/338462829 conn(0x7f8e440b0510 msgr2=0x7f8e440b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:03.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.206+0000 7f8e49000640 1 -- 172.21.15.70:0/338462829 shutdown_connections 2024-09-13T16:03:03.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.206+0000 7f8e49000640 1 -- 172.21.15.70:0/338462829 wait complete. 2024-09-13T16:03:03.222 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T16:03:03.223 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T16:03:03.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.377+0000 7f7fcce00640 1 Processor -- start 2024-09-13T16:03:03.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.377+0000 7f7fcce00640 1 -- start start 2024-09-13T16:03:03.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.378+0000 7f7fcce00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7fc81592f0 0x7f7fc80b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.378+0000 7f7fcce00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7fc80adeb0 0x7f7fc80704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.378+0000 7f7fcce00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc8070030 con 0x7f7fc81596d0 2024-09-13T16:03:03.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.378+0000 7f7fcce00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc8071110 con 0x7f7fc81592f0 2024-09-13T16:03:03.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.378+0000 7f7fcce00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc80b1d50 con 0x7f7fc80adeb0 2024-09-13T16:03:03.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.378+0000 7f7fc5e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7fc81592f0 0x7f7fc80b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.378+0000 7f7fc6800640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f7fc81596d0 0x7f7fc8070a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50744/0 (socket says 172.21.15.70:50744) 2024-09-13T16:03:03.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.378+0000 7f7fc6800640 1 -- 172.21.15.70:0/1866764897 learned_addr learned my addr 172.21.15.70:0/1866764897 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:03:03.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.379+0000 7f7fc5400640 1 --2- 172.21.15.70:0/1866764897 >> v2:172.21.15.107:3300/0 conn(0x7f7fc80adeb0 0x7f7fc80704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.379+0000 7f7fc5e00640 1 -- 172.21.15.70:0/1866764897 >> v2:172.21.15.107:3300/0 conn(0x7f7fc80adeb0 msgr2=0x7f7fc80704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:03.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.379+0000 7f7fc5e00640 1 --2- 172.21.15.70:0/1866764897 >> v2:172.21.15.107:3300/0 conn(0x7f7fc80adeb0 0x7f7fc80704c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.379+0000 7f7fc5e00640 1 -- 172.21.15.70:0/1866764897 >> v1:172.21.15.70:6789/0 conn(0x7f7fc81596d0 legacy=0x7f7fc8070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.379+0000 7f7fc5e00640 1 -- 172.21.15.70:0/1866764897 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc8071870 con 0x7f7fc81592f0 2024-09-13T16:03:03.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.379+0000 7f7fc4a00640 1 -- 172.21.15.70:0/1866764897 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932761637 0 0) 0x7f7fc8070030 con 0x7f7fc81596d0 2024-09-13T16:03:03.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.380+0000 7f7fc5e00640 1 --2- 172.21.15.70:0/1866764897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fc81592f0 0x7f7fc80b1810 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80b1420 tx=0x7f7fb802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b1cda595a1dec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:03.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.380+0000 7f7fc4a00640 1 -- 172.21.15.70:0/1866764897 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8032440 con 0x7f7fc81592f0 2024-09-13T16:03:03.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.380+0000 7f7fc4a00640 1 -- 172.21.15.70:0/1866764897 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb80325a0 con 0x7f7fc81592f0 2024-09-13T16:03:03.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.380+0000 7f7fc4a00640 1 -- 172.21.15.70:0/1866764897 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8032930 con 0x7f7fc81592f0 2024-09-13T16:03:03.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.381+0000 7f7fcce00640 1 -- 172.21.15.70:0/1866764897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fc81592f0 msgr2=0x7f7fc80b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.381+0000 7f7fcce00640 1 --2- 172.21.15.70:0/1866764897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fc81592f0 0x7f7fc80b1810 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80b1420 tx=0x7f7fb802a1a0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.381+0000 7f7fcce00640 1 -- 172.21.15.70:0/1866764897 shutdown_connections 2024-09-13T16:03:03.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.381+0000 7f7fcce00640 1 --2- 172.21.15.70:0/1866764897 >> v2:172.21.15.107:3300/0 conn(0x7f7fc80adeb0 0x7f7fc80704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.381+0000 7f7fcce00640 1 --2- 172.21.15.70:0/1866764897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fc81592f0 0x7f7fc80b1810 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.381+0000 7f7fcce00640 1 -- 172.21.15.70:0/1866764897 >> 172.21.15.70:0/1866764897 conn(0x7f7fc80b0510 msgr2=0x7f7fc80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:03.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.381+0000 7f7fcce00640 1 -- 172.21.15.70:0/1866764897 shutdown_connections 2024-09-13T16:03:03.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.381+0000 7f7fcce00640 1 -- 172.21.15.70:0/1866764897 wait complete. 2024-09-13T16:03:03.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.382+0000 7f7fcce00640 1 Processor -- start 2024-09-13T16:03:03.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.383+0000 7f7fcce00640 1 -- start start 2024-09-13T16:03:03.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.383+0000 7f7fcce00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fc80adeb0 0x7f7fc81538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.383+0000 7f7fcce00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fc81592f0 0x7f7fc80acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.383+0000 7f7fcce00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fc81596d0 0x7f7fc80ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.383+0000 7f7fcce00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc8147a00 con 0x7f7fc80adeb0 2024-09-13T16:03:03.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.383+0000 7f7fcce00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc8153de0 con 0x7f7fc81596d0 2024-09-13T16:03:03.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.383+0000 7f7fcce00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc8150aa0 con 0x7f7fc81592f0 2024-09-13T16:03:03.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.384+0000 7f7fc5e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fc80adeb0 0x7f7fc81538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.384+0000 7f7fc5e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fc80adeb0 0x7f7fc81538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49166/0 (socket says 172.21.15.70:49166) 2024-09-13T16:03:03.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.384+0000 7f7fc5e00640 1 -- 172.21.15.70:0/2037644954 learned_addr learned my addr 172.21.15.70:0/2037644954 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:03.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.384+0000 7f7fc5e00640 1 -- 172.21.15.70:0/2037644954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fc81592f0 msgr2=0x7f7fc80acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.384+0000 7f7fc5e00640 1 --2- 172.21.15.70:0/2037644954 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fc81592f0 0x7f7fc80acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.384+0000 7f7fc5e00640 1 -- 172.21.15.70:0/2037644954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fc81596d0 msgr2=0x7f7fc80ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.384+0000 7f7fc5e00640 1 --2- 172.21.15.70:0/2037644954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fc81596d0 0x7f7fc80ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.384+0000 7f7fc5e00640 1 -- 172.21.15.70:0/2037644954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb8009400 con 0x7f7fc80adeb0 2024-09-13T16:03:03.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.384+0000 7f7fc5e00640 1 --2- 172.21.15.70:0/2037644954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fc80adeb0 0x7f7fc81538a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8000c00 tx=0x7f7fb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:03.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.385+0000 7f7fbe000640 1 -- 172.21.15.70:0/2037644954 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8032440 con 0x7f7fc80adeb0 2024-09-13T16:03:03.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.385+0000 7f7fbe000640 1 -- 172.21.15.70:0/2037644954 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb8030ba0 con 0x7f7fc80adeb0 2024-09-13T16:03:03.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.385+0000 7f7fcce00640 1 -- 172.21.15.70:0/2037644954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc8150d80 con 0x7f7fc80adeb0 2024-09-13T16:03:03.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.385+0000 7f7fbe000640 1 -- 172.21.15.70:0/2037644954 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8006e10 con 0x7f7fc80adeb0 2024-09-13T16:03:03.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.385+0000 7f7fcce00640 1 -- 172.21.15.70:0/2037644954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc815b030 con 0x7f7fc80adeb0 2024-09-13T16:03:03.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.386+0000 7f7fcce00640 1 -- 172.21.15.70:0/2037644954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7fc815aeb0 con 0x7f7fc80adeb0 2024-09-13T16:03:03.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.387+0000 7f7fbe000640 1 -- 172.21.15.70:0/2037644954 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7fb8039040 con 0x7f7fc80adeb0 2024-09-13T16:03:03.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.388+0000 7f7fbe000640 1 --2- 172.21.15.70:0/2037644954 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7fa806ac00 0x7f7fa806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.388+0000 7f7fbe000640 1 -- 172.21.15.70:0/2037644954 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7fb80a9d20 con 0x7f7fc80adeb0 2024-09-13T16:03:03.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.388+0000 7f7fc5400640 1 --2- 172.21.15.70:0/2037644954 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7fa806ac00 0x7f7fa806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.388+0000 7f7fbe000640 1 --2- 172.21.15.70:0/2037644954 >> [v2:172.21.15.70:6816/523483066,v1:172.21.15.70:6817/523483066] conn(0x7f7fa8070b00 0x7f7fa8072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.388+0000 7f7fbe000640 1 -- 172.21.15.70:0/2037644954 --> [v2:172.21.15.70:6816/523483066,v1:172.21.15.70:6817/523483066] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7fa80735d0 con 0x7f7fa8070b00 2024-09-13T16:03:03.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.388+0000 7f7fbe000640 1 -- 172.21.15.70:0/2037644954 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fb80af070 con 0x7f7fc80adeb0 2024-09-13T16:03:03.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.388+0000 7f7fc6800640 1 --2- 172.21.15.70:0/2037644954 >> [v2:172.21.15.70:6816/523483066,v1:172.21.15.70:6817/523483066] conn(0x7f7fa8070b00 0x7f7fa8072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.389+0000 7f7fc5400640 1 --2- 172.21.15.70:0/2037644954 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7fa806ac00 0x7f7fa806d0c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80add30 tx=0x7f7fb4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:03.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.389+0000 7f7fc6800640 1 --2- 172.21.15.70:0/2037644954 >> [v2:172.21.15.70:6816/523483066,v1:172.21.15.70:6817/523483066] conn(0x7f7fa8070b00 0x7f7fa8072f20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:03.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.389+0000 7f7fbe000640 1 -- 172.21.15.70:0/2037644954 <== osd.1 v2:172.21.15.70:6816/523483066 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7fa80735d0 con 0x7f7fa8070b00 2024-09-13T16:03:03.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.402+0000 7f7fcce00640 1 -- 172.21.15.70:0/2037644954 --> [v2:172.21.15.70:6816/523483066,v1:172.21.15.70:6817/523483066] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7fc806fcc0 con 0x7f7fa8070b00 2024-09-13T16:03:03.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.402+0000 7f7fbe000640 1 -- 172.21.15.70:0/2037644954 <== osd.1 v2:172.21.15.70:6816/523483066 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7fc0001e90 con 0x7f7fa8070b00 2024-09-13T16:03:03.403 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-13T16:03:03.404 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T16:03:03.404 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-13T16:03:03.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.402+0000 7f7fcce00640 1 -- 172.21.15.70:0/2037644954 >> [v2:172.21.15.70:6816/523483066,v1:172.21.15.70:6817/523483066] conn(0x7f7fa8070b00 msgr2=0x7f7fa8072f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.403+0000 7f7fcce00640 1 --2- 172.21.15.70:0/2037644954 >> [v2:172.21.15.70:6816/523483066,v1:172.21.15.70:6817/523483066] conn(0x7f7fa8070b00 0x7f7fa8072f20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.403+0000 7f7fcce00640 1 -- 172.21.15.70:0/2037644954 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7fa806ac00 msgr2=0x7f7fa806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.403+0000 7f7fcce00640 1 --2- 172.21.15.70:0/2037644954 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f7fa806ac00 0x7f7fa806d0c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80add30 tx=0x7f7fb4008040 comp rx=0 tx=0).stop 2024-09-13T16:03:03.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.403+0000 7f7fcce00640 1 -- 172.21.15.70:0/2037644954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fc80adeb0 msgr2=0x7f7fc81538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.403+0000 7f7fcce00640 1 --2- 172.21.15.70:0/2037644954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fc80adeb0 0x7f7fc81538a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8000c00 tx=0x7f7fb80046c0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.403+0000 7f7fc6800640 1 -- 172.21.15.70:0/2037644954 reap_dead start 2024-09-13T16:03:03.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.403+0000 7f7fcce00640 1 -- 172.21.15.70:0/2037644954 shutdown_connections 2024-09-13T16:03:03.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.403+0000 7f7fcce00640 1 -- 172.21.15.70:0/2037644954 >> 172.21.15.70:0/2037644954 conn(0x7f7fc80b0510 msgr2=0x7f7fc80ca9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:03.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.403+0000 7f7fcce00640 1 -- 172.21.15.70:0/2037644954 shutdown_connections 2024-09-13T16:03:03.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.403+0000 7f7fcce00640 1 -- 172.21.15.70:0/2037644954 wait complete. 2024-09-13T16:03:03.419 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T16:03:03.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.569+0000 7fd5e9600640 1 Processor -- start 2024-09-13T16:03:03.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.569+0000 7fd5e9600640 1 -- start start 2024-09-13T16:03:03.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.570+0000 7fd5e9600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd5e40b1e40 0x7fd5e4159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.570+0000 7fd5e9600640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd5e40b32d0 0x7fd5e4070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.570+0000 7fd5e9600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e415a430 con 0x7fd5e40b2220 2024-09-13T16:03:03.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.570+0000 7fd5e9600640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e41598b0 con 0x7fd5e40b32d0 2024-09-13T16:03:03.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.570+0000 7fd5e9600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e4159b90 con 0x7fd5e40b1e40 2024-09-13T16:03:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.571+0000 7fd5e3400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd5e40b32d0 0x7fd5e4070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.571+0000 7fd5e3400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd5e40b32d0 0x7fd5e4070720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49172/0 (socket says 172.21.15.70:49172) 2024-09-13T16:03:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.571+0000 7fd5e3400640 1 -- 172.21.15.70:0/2369737599 learned_addr learned my addr 172.21.15.70:0/2369737599 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.571+0000 7fd5e2a00640 1 --2- 172.21.15.70:0/2369737599 >> v2:172.21.15.107:3300/0 conn(0x7fd5e40b1e40 0x7fd5e4159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.571+0000 7fd5e3400640 1 -- 172.21.15.70:0/2369737599 >> v2:172.21.15.107:3300/0 conn(0x7fd5e40b1e40 msgr2=0x7fd5e4159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.571+0000 7fd5e3400640 1 --2- 172.21.15.70:0/2369737599 >> v2:172.21.15.107:3300/0 conn(0x7fd5e40b1e40 0x7fd5e4159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.571+0000 7fd5e3400640 1 -- 172.21.15.70:0/2369737599 >> v1:172.21.15.70:6789/0 conn(0x7fd5e40b2220 legacy=0x7fd5e40b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.571+0000 7fd5e3400640 1 -- 172.21.15.70:0/2369737599 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e4159e70 con 0x7fd5e40b32d0 2024-09-13T16:03:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.571+0000 7fd5e1600640 1 -- 172.21.15.70:0/2369737599 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142661734 0 0) 0x7fd5e415a430 con 0x7fd5e40b2220 2024-09-13T16:03:03.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.572+0000 7fd5e3400640 1 --2- 172.21.15.70:0/2369737599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e40b32d0 0x7fd5e4070720 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd5e406daf0 tx=0x7fd5dc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f9181c2957a02e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.572+0000 7fd5e1600640 1 -- 172.21.15.70:0/2369737599 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc031600 con 0x7fd5e40b32d0 2024-09-13T16:03:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.573+0000 7fd5e1600640 1 -- 172.21.15.70:0/2369737599 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5dc02d050 con 0x7fd5e40b32d0 2024-09-13T16:03:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.573+0000 7fd5e1600640 1 -- 172.21.15.70:0/2369737599 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc031980 con 0x7fd5e40b32d0 2024-09-13T16:03:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.573+0000 7fd5e9600640 1 -- 172.21.15.70:0/2369737599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e40b32d0 msgr2=0x7fd5e4070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.573+0000 7fd5e9600640 1 --2- 172.21.15.70:0/2369737599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e40b32d0 0x7fd5e4070720 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd5e406daf0 tx=0x7fd5dc02a6a0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.573+0000 7fd5e9600640 1 -- 172.21.15.70:0/2369737599 shutdown_connections 2024-09-13T16:03:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.573+0000 7fd5e9600640 1 --2- 172.21.15.70:0/2369737599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e40b32d0 0x7fd5e4070720 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.573+0000 7fd5e9600640 1 --2- 172.21.15.70:0/2369737599 >> v2:172.21.15.107:3300/0 conn(0x7fd5e40b1e40 0x7fd5e4159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.573+0000 7fd5e9600640 1 -- 172.21.15.70:0/2369737599 >> 172.21.15.70:0/2369737599 conn(0x7fd5e40b0510 msgr2=0x7fd5e40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.573+0000 7fd5e9600640 1 -- 172.21.15.70:0/2369737599 shutdown_connections 2024-09-13T16:03:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.573+0000 7fd5e9600640 1 -- 172.21.15.70:0/2369737599 wait complete. 2024-09-13T16:03:03.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.575+0000 7fd5e9600640 1 Processor -- start 2024-09-13T16:03:03.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.575+0000 7fd5e9600640 1 -- start start 2024-09-13T16:03:03.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.576+0000 7fd5e9600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5e40b1e40 0x7fd5e415bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.576+0000 7fd5e9600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5e40b2220 0x7fd5e4140810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.576+0000 7fd5e9600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e40b32d0 0x7fd5e4140d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.576+0000 7fd5e9600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e415b8e0 con 0x7fd5e40b32d0 2024-09-13T16:03:03.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.576+0000 7fd5e9600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e415c240 con 0x7fd5e40b2220 2024-09-13T16:03:03.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.576+0000 7fd5e9600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e415ac60 con 0x7fd5e40b1e40 2024-09-13T16:03:03.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.576+0000 7fd5e3400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e40b32d0 0x7fd5e4140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.576+0000 7fd5e3400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e40b32d0 0x7fd5e4140d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49176/0 (socket says 172.21.15.70:49176) 2024-09-13T16:03:03.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.576+0000 7fd5e3400640 1 -- 172.21.15.70:0/3896337302 learned_addr learned my addr 172.21.15.70:0/3896337302 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:03.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.576+0000 7fd5e2a00640 1 --2- 172.21.15.70:0/3896337302 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5e40b1e40 0x7fd5e415bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.576+0000 7fd5e2000640 1 --2- 172.21.15.70:0/3896337302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5e40b2220 0x7fd5e4140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.576+0000 7fd5e3400640 1 -- 172.21.15.70:0/3896337302 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5e40b1e40 msgr2=0x7fd5e415bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.576+0000 7fd5e3400640 1 --2- 172.21.15.70:0/3896337302 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5e40b1e40 0x7fd5e415bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.576+0000 7fd5e3400640 1 -- 172.21.15.70:0/3896337302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5e40b2220 msgr2=0x7fd5e4140810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.576+0000 7fd5e3400640 1 --2- 172.21.15.70:0/3896337302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5e40b2220 0x7fd5e4140810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.576+0000 7fd5e3400640 1 -- 172.21.15.70:0/3896337302 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc009b30 con 0x7fd5e40b32d0 2024-09-13T16:03:03.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.577+0000 7fd5e3400640 1 --2- 172.21.15.70:0/3896337302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e40b32d0 0x7fd5e4140d50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009f40 tx=0x7fd5dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:03.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.577+0000 7fd5daa00640 1 -- 172.21.15.70:0/3896337302 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc03b810 con 0x7fd5e40b32d0 2024-09-13T16:03:03.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.577+0000 7fd5daa00640 1 -- 172.21.15.70:0/3896337302 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5dc03b990 con 0x7fd5e40b32d0 2024-09-13T16:03:03.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.577+0000 7fd5e9600640 1 -- 172.21.15.70:0/3896337302 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e415af40 con 0x7fd5e40b32d0 2024-09-13T16:03:03.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.577+0000 7fd5daa00640 1 -- 172.21.15.70:0/3896337302 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc03bd40 con 0x7fd5e40b32d0 2024-09-13T16:03:03.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.577+0000 7fd5e9600640 1 -- 172.21.15.70:0/3896337302 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e415b500 con 0x7fd5e40b32d0 2024-09-13T16:03:03.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.578+0000 7fd5e9600640 1 -- 172.21.15.70:0/3896337302 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e415ba20 con 0x7fd5e40b32d0 2024-09-13T16:03:03.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.579+0000 7fd5daa00640 1 -- 172.21.15.70:0/3896337302 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd5dc03a3a0 con 0x7fd5e40b32d0 2024-09-13T16:03:03.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.580+0000 7fd5daa00640 1 --2- 172.21.15.70:0/3896337302 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd5c406ac00 0x7fd5c406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.580+0000 7fd5daa00640 1 -- 172.21.15.70:0/3896337302 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd5dc0a9960 con 0x7fd5e40b32d0 2024-09-13T16:03:03.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.580+0000 7fd5e2a00640 1 --2- 172.21.15.70:0/3896337302 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd5c406ac00 0x7fd5c406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.581+0000 7fd5e2a00640 1 --2- 172.21.15.70:0/3896337302 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd5c406ac00 0x7fd5c406d0c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4006fd0 tx=0x7fd5d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:03.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.584+0000 7fd5daa00640 1 -- 172.21.15.70:0/3896337302 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd5e415ba20 con 0x7fd5e40b32d0 2024-09-13T16:03:03.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.757+0000 7fd5e9600640 1 -- 172.21.15.70:0/3896337302 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5e40b2690 con 0x7fd5c406ac00 2024-09-13T16:03:03.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.757+0000 7fd5daa00640 1 -- 172.21.15.70:0/3896337302 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd5d4004020 con 0x7fd5c406ac00 2024-09-13T16:03:03.758 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T16:03:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.759+0000 7fd5e9600640 1 -- 172.21.15.70:0/3896337302 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd5c406ac00 msgr2=0x7fd5c406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.759+0000 7fd5e9600640 1 --2- 172.21.15.70:0/3896337302 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd5c406ac00 0x7fd5c406d0c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4006fd0 tx=0x7fd5d4008040 comp rx=0 tx=0).stop 2024-09-13T16:03:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.759+0000 7fd5e9600640 1 -- 172.21.15.70:0/3896337302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e40b32d0 msgr2=0x7fd5e4140d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.759+0000 7fd5e9600640 1 --2- 172.21.15.70:0/3896337302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e40b32d0 0x7fd5e4140d50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009f40 tx=0x7fd5dc004a40 comp rx=0 tx=0).stop 2024-09-13T16:03:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.759+0000 7fd5e9600640 1 -- 172.21.15.70:0/3896337302 shutdown_connections 2024-09-13T16:03:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.759+0000 7fd5e9600640 1 --2- 172.21.15.70:0/3896337302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e40b32d0 0x7fd5e4140d50 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.759+0000 7fd5e9600640 1 --2- 172.21.15.70:0/3896337302 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd5c406ac00 0x7fd5c406d0c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.759+0000 7fd5e9600640 1 --2- 172.21.15.70:0/3896337302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5e40b2220 0x7fd5e4140810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.759+0000 7fd5e9600640 1 --2- 172.21.15.70:0/3896337302 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5e40b1e40 0x7fd5e415bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.759+0000 7fd5e9600640 1 -- 172.21.15.70:0/3896337302 >> 172.21.15.70:0/3896337302 conn(0x7fd5e40b0510 msgr2=0x7fd5e40ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:03.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.760+0000 7fd5e9600640 1 -- 172.21.15.70:0/3896337302 shutdown_connections 2024-09-13T16:03:03.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.760+0000 7fd5e9600640 1 -- 172.21.15.70:0/3896337302 wait complete. 2024-09-13T16:03:03.776 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T16:03:03.776 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T16:03:03.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.931+0000 7f1c23200640 1 Processor -- start 2024-09-13T16:03:03.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.931+0000 7f1c23200640 1 -- start start 2024-09-13T16:03:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.932+0000 7f1c23200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1c1c06cd60 0x7f1c1c0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.932+0000 7f1c23200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1c1c0cd870 0x7f1c1c0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.932+0000 7f1c23200640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1c151a20 con 0x7f1c1c15b770 2024-09-13T16:03:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.932+0000 7f1c23200640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c0cc430 con 0x7f1c1c06cd60 2024-09-13T16:03:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.932+0000 7f1c23200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c0b1bb0 con 0x7f1c1c0cd870 2024-09-13T16:03:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.932+0000 7f1c1be00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1c1c06cd60 0x7f1c1c0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.933+0000 7f1c1be00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1c1c06cd60 0x7f1c1c0b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49186/0 (socket says 172.21.15.70:49186) 2024-09-13T16:03:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.933+0000 7f1c1be00640 1 -- 172.21.15.70:0/2346214860 learned_addr learned my addr 172.21.15.70:0/2346214860 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.933+0000 7f1c13e00640 1 --1- 172.21.15.70:0/2346214860 >> v1:172.21.15.70:6789/0 conn(0x7f1c1c15b770 0x7f1c1c0cbbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50758/0 (socket says 172.21.15.70:50758) 2024-09-13T16:03:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.933+0000 7f1c21200640 1 --2- 172.21.15.70:0/2346214860 >> v2:172.21.15.107:3300/0 conn(0x7f1c1c0cd870 0x7f1c1c0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.933+0000 7f1c1be00640 1 -- 172.21.15.70:0/2346214860 >> v2:172.21.15.107:3300/0 conn(0x7f1c1c0cd870 msgr2=0x7f1c1c0cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.933+0000 7f1c1be00640 1 --2- 172.21.15.70:0/2346214860 >> v2:172.21.15.107:3300/0 conn(0x7f1c1c0cd870 0x7f1c1c0cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.933+0000 7f1c1be00640 1 -- 172.21.15.70:0/2346214860 >> v1:172.21.15.70:6789/0 conn(0x7f1c1c15b770 legacy=0x7f1c1c0cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.933+0000 7f1c1be00640 1 -- 172.21.15.70:0/2346214860 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c0b1e70 con 0x7f1c1c06cd60 2024-09-13T16:03:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.933+0000 7f1c1b400640 1 -- 172.21.15.70:0/2346214860 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030777381 0 0) 0x7f1c1c151a20 con 0x7f1c1c15b770 2024-09-13T16:03:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.933+0000 7f1c21200640 1 --2- 172.21.15.70:0/2346214860 >> v2:172.21.15.107:3300/0 conn(0x7f1c1c0cd870 0x7f1c1c0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:03:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.934+0000 7f1c1be00640 1 --2- 172.21.15.70:0/2346214860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c1c06cd60 0x7f1c1c0b2950 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c158690 tx=0x7f1c0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eefa0f370a37f0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.934+0000 7f1c1b400640 1 -- 172.21.15.70:0/2346214860 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c032440 con 0x7f1c1c06cd60 2024-09-13T16:03:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.934+0000 7f1c1b400640 1 -- 172.21.15.70:0/2346214860 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c0325a0 con 0x7f1c1c06cd60 2024-09-13T16:03:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.934+0000 7f1c1b400640 1 -- 172.21.15.70:0/2346214860 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c032930 con 0x7f1c1c06cd60 2024-09-13T16:03:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.935+0000 7f1c23200640 1 -- 172.21.15.70:0/2346214860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c1c06cd60 msgr2=0x7f1c1c0b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.935+0000 7f1c23200640 1 --2- 172.21.15.70:0/2346214860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c1c06cd60 0x7f1c1c0b2950 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c158690 tx=0x7f1c0c02a270 comp rx=0 tx=0).stop 2024-09-13T16:03:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.935+0000 7f1c23200640 1 -- 172.21.15.70:0/2346214860 shutdown_connections 2024-09-13T16:03:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.935+0000 7f1c23200640 1 --2- 172.21.15.70:0/2346214860 >> v2:172.21.15.107:3300/0 conn(0x7f1c1c0cd870 0x7f1c1c0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.935+0000 7f1c23200640 1 --2- 172.21.15.70:0/2346214860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c1c06cd60 0x7f1c1c0b2950 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.935+0000 7f1c23200640 1 -- 172.21.15.70:0/2346214860 >> 172.21.15.70:0/2346214860 conn(0x7f1c1c0b0510 msgr2=0x7f1c1c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.935+0000 7f1c23200640 1 -- 172.21.15.70:0/2346214860 shutdown_connections 2024-09-13T16:03:03.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.935+0000 7f1c23200640 1 -- 172.21.15.70:0/2346214860 wait complete. 2024-09-13T16:03:03.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.936+0000 7f1c23200640 1 Processor -- start 2024-09-13T16:03:03.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.937+0000 7f1c23200640 1 -- start start 2024-09-13T16:03:03.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.937+0000 7f1c23200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c1c06cd60 0x7f1c1c0ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.937+0000 7f1c23200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c1c0cd870 0x7f1c1c1491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.937+0000 7f1c23200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c1c15b770 0x7f1c1c0af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.937+0000 7f1c23200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0acf30 con 0x7f1c1c06cd60 2024-09-13T16:03:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.937+0000 7f1c23200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c1f2950 con 0x7f1c1c15b770 2024-09-13T16:03:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.937+0000 7f1c23200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c1f2c30 con 0x7f1c1c0cd870 2024-09-13T16:03:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.938+0000 7f1c1be00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c1c06cd60 0x7f1c1c0ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.938+0000 7f1c1be00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c1c06cd60 0x7f1c1c0ad350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49194/0 (socket says 172.21.15.70:49194) 2024-09-13T16:03:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.938+0000 7f1c1be00640 1 -- 172.21.15.70:0/1970136366 learned_addr learned my addr 172.21.15.70:0/1970136366 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.938+0000 7f1c13e00640 1 --2- 172.21.15.70:0/1970136366 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c1c0cd870 0x7f1c1c1491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.938+0000 7f1c21200640 1 --2- 172.21.15.70:0/1970136366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c1c15b770 0x7f1c1c0af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.938+0000 7f1c1be00640 1 -- 172.21.15.70:0/1970136366 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c1c0cd870 msgr2=0x7f1c1c1491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.938+0000 7f1c1be00640 1 --2- 172.21.15.70:0/1970136366 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1c1c0cd870 0x7f1c1c1491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.938+0000 7f1c1be00640 1 -- 172.21.15.70:0/1970136366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c1c15b770 msgr2=0x7f1c1c0af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.938+0000 7f1c1be00640 1 --2- 172.21.15.70:0/1970136366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c1c15b770 0x7f1c1c0af5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.938+0000 7f1c1be00640 1 -- 172.21.15.70:0/1970136366 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c0094d0 con 0x7f1c1c06cd60 2024-09-13T16:03:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.938+0000 7f1c1be00640 1 --2- 172.21.15.70:0/1970136366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c1c06cd60 0x7f1c1c0ad350 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c000c00 tx=0x7f1c0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.939+0000 7f1c18c00640 1 -- 172.21.15.70:0/1970136366 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c032440 con 0x7f1c1c06cd60 2024-09-13T16:03:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.939+0000 7f1c18c00640 1 -- 172.21.15.70:0/1970136366 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c004030 con 0x7f1c1c06cd60 2024-09-13T16:03:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.939+0000 7f1c18c00640 1 -- 172.21.15.70:0/1970136366 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c0043c0 con 0x7f1c1c06cd60 2024-09-13T16:03:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.939+0000 7f1c23200640 1 -- 172.21.15.70:0/1970136366 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1c0ac870 con 0x7f1c1c06cd60 2024-09-13T16:03:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.939+0000 7f1c23200640 1 -- 172.21.15.70:0/1970136366 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c0ad890 con 0x7f1c1c06cd60 2024-09-13T16:03:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.940+0000 7f1c23200640 1 -- 172.21.15.70:0/1970136366 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c1c0ce1c0 con 0x7f1c1c06cd60 2024-09-13T16:03:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.941+0000 7f1c18c00640 1 -- 172.21.15.70:0/1970136366 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1c0c039050 con 0x7f1c1c06cd60 2024-09-13T16:03:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.941+0000 7f1c18c00640 1 --2- 172.21.15.70:0/1970136366 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f1bf806ac00 0x7f1bf806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.942+0000 7f1c18c00640 1 -- 172.21.15.70:0/1970136366 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1c0c0a9730 con 0x7f1c1c06cd60 2024-09-13T16:03:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.942+0000 7f1c13e00640 1 --2- 172.21.15.70:0/1970136366 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f1bf806ac00 0x7f1bf806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.942+0000 7f1c18c00640 1 --2- 172.21.15.70:0/1970136366 >> [v2:172.21.15.70:6800/313203511,v1:172.21.15.70:6801/313203511] conn(0x7f1bf8070b00 0x7f1bf8072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.942+0000 7f1c18c00640 1 -- 172.21.15.70:0/1970136366 --> [v2:172.21.15.70:6800/313203511,v1:172.21.15.70:6801/313203511] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1bf80735d0 con 0x7f1bf8070b00 2024-09-13T16:03:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.942+0000 7f1c18c00640 1 -- 172.21.15.70:0/1970136366 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c0c0abdf0 con 0x7f1c1c06cd60 2024-09-13T16:03:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.942+0000 7f1c21200640 1 --2- 172.21.15.70:0/1970136366 >> [v2:172.21.15.70:6800/313203511,v1:172.21.15.70:6801/313203511] conn(0x7f1bf8070b00 0x7f1bf8072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.942+0000 7f1c13e00640 1 --2- 172.21.15.70:0/1970136366 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f1bf806ac00 0x7f1bf806d0c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1c04007fd0 tx=0x7f1c04007c20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.943+0000 7f1c21200640 1 --2- 172.21.15.70:0/1970136366 >> [v2:172.21.15.70:6800/313203511,v1:172.21.15.70:6801/313203511] conn(0x7f1bf8070b00 0x7f1bf8072f20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.943+0000 7f1c18c00640 1 -- 172.21.15.70:0/1970136366 <== osd.2 v2:172.21.15.70:6800/313203511 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1bf80735d0 con 0x7f1bf8070b00 2024-09-13T16:03:03.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.956+0000 7f1c23200640 1 -- 172.21.15.70:0/1970136366 --> [v2:172.21.15.70:6800/313203511,v1:172.21.15.70:6801/313203511] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1c1c0b2430 con 0x7f1bf8070b00 2024-09-13T16:03:03.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.956+0000 7f1c18c00640 1 -- 172.21.15.70:0/1970136366 <== osd.2 v2:172.21.15.70:6800/313203511 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1c14009bd0 con 0x7f1bf8070b00 2024-09-13T16:03:03.957 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-13T16:03:03.958 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T16:03:03.958 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-13T16:03:03.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.956+0000 7f1c23200640 1 -- 172.21.15.70:0/1970136366 >> [v2:172.21.15.70:6800/313203511,v1:172.21.15.70:6801/313203511] conn(0x7f1bf8070b00 msgr2=0x7f1bf8072f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.956+0000 7f1c23200640 1 --2- 172.21.15.70:0/1970136366 >> [v2:172.21.15.70:6800/313203511,v1:172.21.15.70:6801/313203511] conn(0x7f1bf8070b00 0x7f1bf8072f20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.957+0000 7f1c23200640 1 -- 172.21.15.70:0/1970136366 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f1bf806ac00 msgr2=0x7f1bf806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.957+0000 7f1c23200640 1 --2- 172.21.15.70:0/1970136366 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f1bf806ac00 0x7f1bf806d0c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1c04007fd0 tx=0x7f1c04007c20 comp rx=0 tx=0).stop 2024-09-13T16:03:03.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.957+0000 7f1c23200640 1 -- 172.21.15.70:0/1970136366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c1c06cd60 msgr2=0x7f1c1c0ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:03.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.957+0000 7f1c23200640 1 --2- 172.21.15.70:0/1970136366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c1c06cd60 0x7f1c1c0ad350 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c000c00 tx=0x7f1c0c0046c0 comp rx=0 tx=0).stop 2024-09-13T16:03:03.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.957+0000 7f1c21200640 1 -- 172.21.15.70:0/1970136366 reap_dead start 2024-09-13T16:03:03.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.957+0000 7f1c23200640 1 -- 172.21.15.70:0/1970136366 shutdown_connections 2024-09-13T16:03:03.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.957+0000 7f1c23200640 1 -- 172.21.15.70:0/1970136366 >> 172.21.15.70:0/1970136366 conn(0x7f1c1c0b0510 msgr2=0x7f1c1c0b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:03.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.957+0000 7f1c23200640 1 -- 172.21.15.70:0/1970136366 shutdown_connections 2024-09-13T16:03:03.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:03.957+0000 7f1c23200640 1 -- 172.21.15.70:0/1970136366 wait complete. 2024-09-13T16:03:03.973 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T16:03:04.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.126+0000 7f5641600640 1 Processor -- start 2024-09-13T16:03:04.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.126+0000 7f5641600640 1 -- start start 2024-09-13T16:03:04.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.127+0000 7f5641600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f563c0b40c0 0x7f563c15a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.127+0000 7f5641600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563c0cbfc0 con 0x7f563c15a5c0 2024-09-13T16:03:04.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.127+0000 7f5641600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563c0707a0 con 0x7f563c0cbac0 2024-09-13T16:03:04.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.127+0000 7f5641600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0cce20 con 0x7f563c0b40c0 2024-09-13T16:03:04.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.127+0000 7f563be00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f563c15a5c0 0x7f563c0b39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50772/0 (socket says 172.21.15.70:50772) 2024-09-13T16:03:04.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.127+0000 7f563be00640 1 -- 172.21.15.70:0/1360624285 learned_addr learned my addr 172.21.15.70:0/1360624285 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:03:04.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.128+0000 7f5633e00640 1 --2- 172.21.15.70:0/1360624285 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f563c0b40c0 0x7f563c15a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.128+0000 7f563b400640 1 -- 172.21.15.70:0/1360624285 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827843293 0 0) 0x7f563c0cbfc0 con 0x7f563c15a5c0 2024-09-13T16:03:04.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.128+0000 7f563b400640 1 -- 172.21.15.70:0/1360624285 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5620003520 con 0x7f563c15a5c0 2024-09-13T16:03:04.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.128+0000 7f563b400640 1 -- 172.21.15.70:0/1360624285 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000219696 0 0) 0x7f563c0707a0 con 0x7f563c0cbac0 2024-09-13T16:03:04.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.128+0000 7f563b400640 1 -- 172.21.15.70:0/1360624285 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f563c0cbfc0 con 0x7f563c0cbac0 2024-09-13T16:03:04.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.128+0000 7f5633e00640 1 -- 172.21.15.70:0/1360624285 >> v1:172.21.15.107:6789/0 conn(0x7f563c0cbac0 legacy=0x7f563c15aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.128+0000 7f5633e00640 1 -- 172.21.15.70:0/1360624285 >> v1:172.21.15.70:6789/0 conn(0x7f563c15a5c0 legacy=0x7f563c0b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.128+0000 7f5633e00640 1 -- 172.21.15.70:0/1360624285 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c070a80 con 0x7f563c0b40c0 2024-09-13T16:03:04.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.129+0000 7f5633e00640 1 --2- 172.21.15.70:0/1360624285 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f563c0b40c0 0x7f563c15a9a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5624009800 tx=0x7f562402a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25fa32308201fdc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:04.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.129+0000 7f563b400640 1 -- 172.21.15.70:0/1360624285 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624032440 con 0x7f563c0b40c0 2024-09-13T16:03:04.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.129+0000 7f563b400640 1 -- 172.21.15.70:0/1360624285 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56240325a0 con 0x7f563c0b40c0 2024-09-13T16:03:04.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.129+0000 7f563b400640 1 -- 172.21.15.70:0/1360624285 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624032930 con 0x7f563c0b40c0 2024-09-13T16:03:04.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.130+0000 7f5641600640 1 -- 172.21.15.70:0/1360624285 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f563c0b40c0 msgr2=0x7f563c15a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.130+0000 7f5641600640 1 --2- 172.21.15.70:0/1360624285 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f563c0b40c0 0x7f563c15a9a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5624009800 tx=0x7f562402a230 comp rx=0 tx=0).stop 2024-09-13T16:03:04.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.130+0000 7f5641600640 1 -- 172.21.15.70:0/1360624285 shutdown_connections 2024-09-13T16:03:04.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.130+0000 7f5641600640 1 --2- 172.21.15.70:0/1360624285 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f563c0b40c0 0x7f563c15a9a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.130+0000 7f5641600640 1 -- 172.21.15.70:0/1360624285 >> 172.21.15.70:0/1360624285 conn(0x7f563c0ae310 msgr2=0x7f563c0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:04.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.130+0000 7f5641600640 1 -- 172.21.15.70:0/1360624285 shutdown_connections 2024-09-13T16:03:04.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.130+0000 7f5641600640 1 -- 172.21.15.70:0/1360624285 wait complete. 2024-09-13T16:03:04.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.132+0000 7f5641600640 1 Processor -- start 2024-09-13T16:03:04.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.132+0000 7f5641600640 1 -- start start 2024-09-13T16:03:04.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.133+0000 7f5641600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f563c0b40c0 0x7f563c151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.133+0000 7f5641600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f563c0cbac0 0x7f563c1e3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.133+0000 7f5641600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f563c15a5c0 0x7f563c0af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.133+0000 7f5641600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c1e6b70 con 0x7f563c0b40c0 2024-09-13T16:03:04.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.133+0000 7f5641600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c15be40 con 0x7f563c15a5c0 2024-09-13T16:03:04.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.133+0000 7f5641600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c1e62d0 con 0x7f563c0cbac0 2024-09-13T16:03:04.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.133+0000 7f563be00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f563c0b40c0 0x7f563c151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.133+0000 7f563be00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f563c0b40c0 0x7f563c151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49206/0 (socket says 172.21.15.70:49206) 2024-09-13T16:03:04.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.133+0000 7f563be00640 1 -- 172.21.15.70:0/1594723669 learned_addr learned my addr 172.21.15.70:0/1594723669 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:04.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.133+0000 7f5633e00640 1 --2- 172.21.15.70:0/1594723669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f563c0cbac0 0x7f563c1e3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.133+0000 7f5640c00640 1 --2- 172.21.15.70:0/1594723669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f563c15a5c0 0x7f563c0af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.133+0000 7f563be00640 1 -- 172.21.15.70:0/1594723669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f563c0cbac0 msgr2=0x7f563c1e3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.133+0000 7f563be00640 1 --2- 172.21.15.70:0/1594723669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f563c0cbac0 0x7f563c1e3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.133+0000 7f563be00640 1 -- 172.21.15.70:0/1594723669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f563c15a5c0 msgr2=0x7f563c0af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.133+0000 7f563be00640 1 --2- 172.21.15.70:0/1594723669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f563c15a5c0 0x7f563c0af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.133+0000 7f563be00640 1 -- 172.21.15.70:0/1594723669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5624009400 con 0x7f563c0b40c0 2024-09-13T16:03:04.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.133+0000 7f5640c00640 1 --2- 172.21.15.70:0/1594723669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f563c15a5c0 0x7f563c0af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:03:04.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.134+0000 7f563be00640 1 --2- 172.21.15.70:0/1594723669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f563c0b40c0 0x7f563c151100 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f562c00c500 tx=0x7f562c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:04.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.134+0000 7f5638c00640 1 -- 172.21.15.70:0/1594723669 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c005ce0 con 0x7f563c0b40c0 2024-09-13T16:03:04.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.134+0000 7f5638c00640 1 -- 172.21.15.70:0/1594723669 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562c005e40 con 0x7f563c0b40c0 2024-09-13T16:03:04.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.134+0000 7f5641600640 1 -- 172.21.15.70:0/1594723669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563c1e65b0 con 0x7f563c0b40c0 2024-09-13T16:03:04.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.134+0000 7f5638c00640 1 -- 172.21.15.70:0/1594723669 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c0072f0 con 0x7f563c0b40c0 2024-09-13T16:03:04.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.134+0000 7f5641600640 1 -- 172.21.15.70:0/1594723669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563c151640 con 0x7f563c0b40c0 2024-09-13T16:03:04.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.135+0000 7f5641600640 1 -- 172.21.15.70:0/1594723669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563c067360 con 0x7f563c0b40c0 2024-09-13T16:03:04.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.136+0000 7f5638c00640 1 -- 172.21.15.70:0/1594723669 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f562c007450 con 0x7f563c0b40c0 2024-09-13T16:03:04.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.137+0000 7f5638c00640 1 --2- 172.21.15.70:0/1594723669 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f561806ac00 0x7f561806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.137+0000 7f5638c00640 1 -- 172.21.15.70:0/1594723669 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f562c088620 con 0x7f563c0b40c0 2024-09-13T16:03:04.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.137+0000 7f5633e00640 1 --2- 172.21.15.70:0/1594723669 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f561806ac00 0x7f561806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.138+0000 7f5633e00640 1 --2- 172.21.15.70:0/1594723669 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f561806ac00 0x7f561806d0c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5624034000 tx=0x7f562402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:04.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.141+0000 7f5638c00640 1 -- 172.21.15.70:0/1594723669 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f562c053b40 con 0x7f563c0b40c0 2024-09-13T16:03:04.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.311+0000 7f5641600640 1 -- 172.21.15.70:0/1594723669 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f563c071280 con 0x7f561806ac00 2024-09-13T16:03:04.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.311+0000 7f5638c00640 1 -- 172.21.15.70:0/1594723669 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5624032890 con 0x7f561806ac00 2024-09-13T16:03:04.312 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T16:03:04.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.313+0000 7f5641600640 1 -- 172.21.15.70:0/1594723669 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f561806ac00 msgr2=0x7f561806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.313+0000 7f5641600640 1 --2- 172.21.15.70:0/1594723669 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f561806ac00 0x7f561806d0c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5624034000 tx=0x7f562402e000 comp rx=0 tx=0).stop 2024-09-13T16:03:04.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.313+0000 7f5641600640 1 -- 172.21.15.70:0/1594723669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f563c0b40c0 msgr2=0x7f563c151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.313+0000 7f5641600640 1 --2- 172.21.15.70:0/1594723669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f563c0b40c0 0x7f563c151100 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f562c00c500 tx=0x7f562c00c9c0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.313+0000 7f5641600640 1 -- 172.21.15.70:0/1594723669 shutdown_connections 2024-09-13T16:03:04.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.313+0000 7f5641600640 1 --2- 172.21.15.70:0/1594723669 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f561806ac00 0x7f561806d0c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.313+0000 7f5641600640 1 --2- 172.21.15.70:0/1594723669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f563c15a5c0 0x7f563c0af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.313+0000 7f5641600640 1 --2- 172.21.15.70:0/1594723669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f563c0cbac0 0x7f563c1e3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.313+0000 7f5641600640 1 --2- 172.21.15.70:0/1594723669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f563c0b40c0 0x7f563c151100 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.313+0000 7f5641600640 1 -- 172.21.15.70:0/1594723669 >> 172.21.15.70:0/1594723669 conn(0x7f563c0ae310 msgr2=0x7f563c06b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:04.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.313+0000 7f5641600640 1 -- 172.21.15.70:0/1594723669 shutdown_connections 2024-09-13T16:03:04.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.313+0000 7f5641600640 1 -- 172.21.15.70:0/1594723669 wait complete. 2024-09-13T16:03:04.330 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T16:03:04.330 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T16:03:04.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.485+0000 7f747e800640 1 Processor -- start 2024-09-13T16:03:04.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.485+0000 7f747e800640 1 -- start start 2024-09-13T16:03:04.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.486+0000 7f747e800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f747806cd60 0x7f74780b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.486+0000 7f747e800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f74780cd870 0x7f74780cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.486+0000 7f747e800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7478151a20 con 0x7f747815b770 2024-09-13T16:03:04.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.486+0000 7f747e800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74780cc430 con 0x7f74780cd870 2024-09-13T16:03:04.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.486+0000 7f747e800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74780b1bb0 con 0x7f747806cd60 2024-09-13T16:03:04.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.486+0000 7f7477e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f74780cd870 0x7f74780cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.486+0000 7f7477e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f74780cd870 0x7f74780cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49210/0 (socket says 172.21.15.70:49210) 2024-09-13T16:03:04.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.486+0000 7f7477e00640 1 -- 172.21.15.70:0/1962063480 learned_addr learned my addr 172.21.15.70:0/1962063480 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:04.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.487+0000 7f7477400640 1 --2- 172.21.15.70:0/1962063480 >> v2:172.21.15.107:3300/0 conn(0x7f747806cd60 0x7f74780b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.487+0000 7f7477e00640 1 -- 172.21.15.70:0/1962063480 >> v2:172.21.15.107:3300/0 conn(0x7f747806cd60 msgr2=0x7f74780b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:04.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.487+0000 7f7477e00640 1 --2- 172.21.15.70:0/1962063480 >> v2:172.21.15.107:3300/0 conn(0x7f747806cd60 0x7f74780b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.487+0000 7f7477e00640 1 -- 172.21.15.70:0/1962063480 >> v1:172.21.15.107:6789/0 conn(0x7f747815b770 legacy=0x7f74780cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.487+0000 7f7477e00640 1 -- 172.21.15.70:0/1962063480 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74780b1e70 con 0x7f74780cd870 2024-09-13T16:03:04.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.488+0000 7f7477e00640 1 --2- 172.21.15.70:0/1962063480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74780cd870 0x7f74780cdc80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f74780b15b0 tx=0x7f747002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8efe74a38ede86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:04.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.488+0000 7f7476000640 1 -- 172.21.15.70:0/1962063480 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470031600 con 0x7f74780cd870 2024-09-13T16:03:04.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.488+0000 7f7476000640 1 -- 172.21.15.70:0/1962063480 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747002d050 con 0x7f74780cd870 2024-09-13T16:03:04.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.488+0000 7f7476000640 1 -- 172.21.15.70:0/1962063480 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470031980 con 0x7f74780cd870 2024-09-13T16:03:04.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.488+0000 7f747e800640 1 -- 172.21.15.70:0/1962063480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74780cd870 msgr2=0x7f74780cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.488+0000 7f747e800640 1 --2- 172.21.15.70:0/1962063480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74780cd870 0x7f74780cdc80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f74780b15b0 tx=0x7f747002a730 comp rx=0 tx=0).stop 2024-09-13T16:03:04.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.489+0000 7f747e800640 1 -- 172.21.15.70:0/1962063480 shutdown_connections 2024-09-13T16:03:04.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.489+0000 7f747e800640 1 --2- 172.21.15.70:0/1962063480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74780cd870 0x7f74780cdc80 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.489+0000 7f747e800640 1 --2- 172.21.15.70:0/1962063480 >> v2:172.21.15.107:3300/0 conn(0x7f747806cd60 0x7f74780b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.489+0000 7f747e800640 1 -- 172.21.15.70:0/1962063480 >> 172.21.15.70:0/1962063480 conn(0x7f74780b0510 msgr2=0x7f74780b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:04.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.489+0000 7f747e800640 1 -- 172.21.15.70:0/1962063480 shutdown_connections 2024-09-13T16:03:04.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.489+0000 7f747e800640 1 -- 172.21.15.70:0/1962063480 wait complete. 2024-09-13T16:03:04.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.490+0000 7f747e800640 1 Processor -- start 2024-09-13T16:03:04.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.490+0000 7f747e800640 1 -- start start 2024-09-13T16:03:04.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.491+0000 7f747e800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f747806cd60 0x7f747814d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.491+0000 7f747e800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74780cd870 0x7f747813df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.491+0000 7f747e800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f747815b770 0x7f74780aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.491+0000 7f747e800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747814e800 con 0x7f747815b770 2024-09-13T16:03:04.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.491+0000 7f747e800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747814ec20 con 0x7f74780cd870 2024-09-13T16:03:04.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.491+0000 7f747e800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747814db80 con 0x7f747806cd60 2024-09-13T16:03:04.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.491+0000 7f7477e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f747815b770 0x7f74780aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.492+0000 7f7477e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f747815b770 0x7f74780aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49218/0 (socket says 172.21.15.70:49218) 2024-09-13T16:03:04.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.492+0000 7f7477e00640 1 -- 172.21.15.70:0/3662946043 learned_addr learned my addr 172.21.15.70:0/3662946043 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:04.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.492+0000 7f7477400640 1 --2- 172.21.15.70:0/3662946043 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f747806cd60 0x7f747814d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.492+0000 7f7476a00640 1 --2- 172.21.15.70:0/3662946043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74780cd870 0x7f747813df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.492+0000 7f7477e00640 1 -- 172.21.15.70:0/3662946043 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f747806cd60 msgr2=0x7f747814d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.492+0000 7f7477e00640 1 --2- 172.21.15.70:0/3662946043 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f747806cd60 0x7f747814d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.492+0000 7f7477e00640 1 -- 172.21.15.70:0/3662946043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74780cd870 msgr2=0x7f747813df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.492+0000 7f7477e00640 1 --2- 172.21.15.70:0/3662946043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74780cd870 0x7f747813df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.492+0000 7f7477e00640 1 -- 172.21.15.70:0/3662946043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7470009b30 con 0x7f747815b770 2024-09-13T16:03:04.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.492+0000 7f7477e00640 1 --2- 172.21.15.70:0/3662946043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f747815b770 0x7f74780aed90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7470009f40 tx=0x7f7470004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:04.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.492+0000 7f746f400640 1 -- 172.21.15.70:0/3662946043 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747003b810 con 0x7f747815b770 2024-09-13T16:03:04.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.493+0000 7f746f400640 1 -- 172.21.15.70:0/3662946043 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747003b970 con 0x7f747815b770 2024-09-13T16:03:04.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.493+0000 7f746f400640 1 -- 172.21.15.70:0/3662946043 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747003bd20 con 0x7f747815b770 2024-09-13T16:03:04.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.493+0000 7f747e800640 1 -- 172.21.15.70:0/3662946043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747814de60 con 0x7f747815b770 2024-09-13T16:03:04.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.493+0000 7f747e800640 1 -- 172.21.15.70:0/3662946043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747814e420 con 0x7f747815b770 2024-09-13T16:03:04.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.494+0000 7f747e800640 1 -- 172.21.15.70:0/3662946043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f74780ce1c0 con 0x7f747815b770 2024-09-13T16:03:04.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.495+0000 7f746f400640 1 -- 172.21.15.70:0/3662946043 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f747003a3a0 con 0x7f747815b770 2024-09-13T16:03:04.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.495+0000 7f746f400640 1 --2- 172.21.15.70:0/3662946043 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f745806ac00 0x7f745806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.496+0000 7f746f400640 1 -- 172.21.15.70:0/3662946043 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f74700a9aa0 con 0x7f747815b770 2024-09-13T16:03:04.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.496+0000 7f7477400640 1 --2- 172.21.15.70:0/3662946043 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f745806ac00 0x7f745806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.496+0000 7f746f400640 1 --2- 172.21.15.70:0/3662946043 >> [v2:172.21.15.70:6808/4231595789,v1:172.21.15.70:6809/4231595789] conn(0x7f7458070b00 0x7f7458072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.496+0000 7f746f400640 1 -- 172.21.15.70:0/3662946043 --> [v2:172.21.15.70:6808/4231595789,v1:172.21.15.70:6809/4231595789] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f74580735d0 con 0x7f7458070b00 2024-09-13T16:03:04.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.496+0000 7f746f400640 1 -- 172.21.15.70:0/3662946043 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74700ae2c0 con 0x7f747815b770 2024-09-13T16:03:04.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.496+0000 7f7476a00640 1 --2- 172.21.15.70:0/3662946043 >> [v2:172.21.15.70:6808/4231595789,v1:172.21.15.70:6809/4231595789] conn(0x7f7458070b00 0x7f7458072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.496+0000 7f7477400640 1 --2- 172.21.15.70:0/3662946043 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f745806ac00 0x7f745806d0c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7468006fd0 tx=0x7f7468008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:04.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.496+0000 7f7476a00640 1 --2- 172.21.15.70:0/3662946043 >> [v2:172.21.15.70:6808/4231595789,v1:172.21.15.70:6809/4231595789] conn(0x7f7458070b00 0x7f7458072f20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:04.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.497+0000 7f746f400640 1 -- 172.21.15.70:0/3662946043 <== osd.3 v2:172.21.15.70:6808/4231595789 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f74580735d0 con 0x7f7458070b00 2024-09-13T16:03:04.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.509+0000 7f747e800640 1 -- 172.21.15.70:0/3662946043 --> [v2:172.21.15.70:6808/4231595789,v1:172.21.15.70:6809/4231595789] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f74780b2430 con 0x7f7458070b00 2024-09-13T16:03:04.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.510+0000 7f746f400640 1 -- 172.21.15.70:0/3662946043 <== osd.3 v2:172.21.15.70:6808/4231595789 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7464001400 con 0x7f7458070b00 2024-09-13T16:03:04.511 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-13T16:03:04.511 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T16:03:04.511 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-13T16:03:04.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.510+0000 7f747e800640 1 -- 172.21.15.70:0/3662946043 >> [v2:172.21.15.70:6808/4231595789,v1:172.21.15.70:6809/4231595789] conn(0x7f7458070b00 msgr2=0x7f7458072f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.510+0000 7f747e800640 1 --2- 172.21.15.70:0/3662946043 >> [v2:172.21.15.70:6808/4231595789,v1:172.21.15.70:6809/4231595789] conn(0x7f7458070b00 0x7f7458072f20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.510+0000 7f747e800640 1 -- 172.21.15.70:0/3662946043 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f745806ac00 msgr2=0x7f745806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.510+0000 7f747e800640 1 --2- 172.21.15.70:0/3662946043 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f745806ac00 0x7f745806d0c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7468006fd0 tx=0x7f7468008040 comp rx=0 tx=0).stop 2024-09-13T16:03:04.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.510+0000 7f747e800640 1 -- 172.21.15.70:0/3662946043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f747815b770 msgr2=0x7f74780aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.510+0000 7f747e800640 1 --2- 172.21.15.70:0/3662946043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f747815b770 0x7f74780aed90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7470009f40 tx=0x7f7470004a40 comp rx=0 tx=0).stop 2024-09-13T16:03:04.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.510+0000 7f7477e00640 1 -- 172.21.15.70:0/3662946043 reap_dead start 2024-09-13T16:03:04.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.510+0000 7f747e800640 1 -- 172.21.15.70:0/3662946043 shutdown_connections 2024-09-13T16:03:04.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.510+0000 7f747e800640 1 -- 172.21.15.70:0/3662946043 >> 172.21.15.70:0/3662946043 conn(0x7f74780b0510 msgr2=0x7f747815aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:04.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.511+0000 7f747e800640 1 -- 172.21.15.70:0/3662946043 shutdown_connections 2024-09-13T16:03:04.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.511+0000 7f747e800640 1 -- 172.21.15.70:0/3662946043 wait complete. 2024-09-13T16:03:04.526 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T16:03:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.678+0000 7f9188000640 1 Processor -- start 2024-09-13T16:03:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.678+0000 7f9188000640 1 -- start start 2024-09-13T16:03:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.679+0000 7f9188000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f918015b910 0x7f9180165190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.679+0000 7f9188000640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918006bea0 con 0x7f91800b1b00 2024-09-13T16:03:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.679+0000 7f9188000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918006c180 con 0x7f918015a520 2024-09-13T16:03:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.679+0000 7f9188000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f918006c460 con 0x7f918015b910 2024-09-13T16:03:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f9184c00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f91800b1b00 0x7f91800cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50782/0 (socket says 172.21.15.70:50782) 2024-09-13T16:03:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f9184c00640 1 -- 172.21.15.70:0/290812630 learned_addr learned my addr 172.21.15.70:0/290812630 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:03:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f9186000640 1 --2- 172.21.15.70:0/290812630 >> v2:172.21.15.107:3300/0 conn(0x7f918015b910 0x7f9180165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f917fe00640 1 -- 172.21.15.70:0/290812630 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611726348 0 0) 0x7f918006bea0 con 0x7f91800b1b00 2024-09-13T16:03:04.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f917fe00640 1 -- 172.21.15.70:0/290812630 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9168003520 con 0x7f91800b1b00 2024-09-13T16:03:04.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f917fe00640 1 -- 172.21.15.70:0/290812630 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433973230 0 0) 0x7f918006c180 con 0x7f918015a520 2024-09-13T16:03:04.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f917fe00640 1 -- 172.21.15.70:0/290812630 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f918006bea0 con 0x7f918015a520 2024-09-13T16:03:04.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f917fe00640 1 -- 172.21.15.70:0/290812630 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 719705584 0 0) 0x7f9168003520 con 0x7f91800b1b00 2024-09-13T16:03:04.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f917fe00640 1 -- 172.21.15.70:0/290812630 >> v2:172.21.15.107:3300/0 conn(0x7f918015b910 msgr2=0x7f9180165190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:04.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f917fe00640 1 --2- 172.21.15.70:0/290812630 >> v2:172.21.15.107:3300/0 conn(0x7f918015b910 0x7f9180165190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f917fe00640 1 -- 172.21.15.70:0/290812630 >> v1:172.21.15.107:6789/0 conn(0x7f918015a520 legacy=0x7f918006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f917fe00640 1 -- 172.21.15.70:0/290812630 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918006c740 con 0x7f91800b1b00 2024-09-13T16:03:04.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f917fe00640 1 -- 172.21.15.70:0/290812630 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f916c001670 con 0x7f91800b1b00 2024-09-13T16:03:04.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f917fe00640 1 -- 172.21.15.70:0/290812630 >> v1:172.21.15.70:6789/0 conn(0x7f91800b1b00 legacy=0x7f91800cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f917fe00640 1 --2- 172.21.15.70:0/290812630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9168003b00 0x7f9168003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f917fe00640 1 --2- 172.21.15.70:0/290812630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91680047c0 0x7f9168004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f917fe00640 1 --2- 172.21.15.70:0/290812630 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9168005180 0x7f916800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f917fe00640 1 -- 172.21.15.70:0/290812630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918006c460 con 0x7f9168003b00 2024-09-13T16:03:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.680+0000 7f917fe00640 1 -- 172.21.15.70:0/290812630 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916800c000 con 0x7f91680047c0 2024-09-13T16:03:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.681+0000 7f917fe00640 1 -- 172.21.15.70:0/290812630 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916800c1c0 con 0x7f9168005180 2024-09-13T16:03:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.681+0000 7f9185600640 1 --2- 172.21.15.70:0/290812630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9168003b00 0x7f9168003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.681+0000 7f9184c00640 1 --2- 172.21.15.70:0/290812630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91680047c0 0x7f9168004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.681+0000 7f9186000640 1 --2- 172.21.15.70:0/290812630 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9168005180 0x7f916800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.681+0000 7f9185600640 1 -- 172.21.15.70:0/290812630 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9168005180 msgr2=0x7f916800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.681+0000 7f9185600640 1 --2- 172.21.15.70:0/290812630 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9168005180 0x7f916800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.681+0000 7f9185600640 1 -- 172.21.15.70:0/290812630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91680047c0 msgr2=0x7f9168004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.681+0000 7f9185600640 1 --2- 172.21.15.70:0/290812630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91680047c0 0x7f9168004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.681+0000 7f9185600640 1 -- 172.21.15.70:0/290812630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9168003520 con 0x7f9168003b00 2024-09-13T16:03:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.681+0000 7f9186000640 1 -- 172.21.15.70:0/290812630 reap_dead start 2024-09-13T16:03:04.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.681+0000 7f9184c00640 1 --2- 172.21.15.70:0/290812630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91680047c0 0x7f9168004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:03:04.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.682+0000 7f9185600640 1 --2- 172.21.15.70:0/290812630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9168003b00 0x7f9168003f00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f91740018d0 tx=0x7f91680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d4113e9c23b98d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:04.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.682+0000 7f917fe00640 1 -- 172.21.15.70:0/290812630 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91740052d0 con 0x7f9168003b00 2024-09-13T16:03:04.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.683+0000 7f917fe00640 1 -- 172.21.15.70:0/290812630 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9174005430 con 0x7f9168003b00 2024-09-13T16:03:04.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.683+0000 7f917fe00640 1 -- 172.21.15.70:0/290812630 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917402ac40 con 0x7f9168003b00 2024-09-13T16:03:04.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.683+0000 7f9188000640 1 -- 172.21.15.70:0/290812630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9168003b00 msgr2=0x7f9168003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.683+0000 7f9188000640 1 --2- 172.21.15.70:0/290812630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9168003b00 0x7f9168003f00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f91740018d0 tx=0x7f91680057f0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.683+0000 7f9188000640 1 -- 172.21.15.70:0/290812630 shutdown_connections 2024-09-13T16:03:04.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.683+0000 7f9188000640 1 --2- 172.21.15.70:0/290812630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9168003b00 0x7f9168003f00 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.683+0000 7f9188000640 1 -- 172.21.15.70:0/290812630 >> 172.21.15.70:0/290812630 conn(0x7f91800b0510 msgr2=0x7f91800b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:04.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.683+0000 7f9188000640 1 -- 172.21.15.70:0/290812630 shutdown_connections 2024-09-13T16:03:04.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.683+0000 7f9188000640 1 -- 172.21.15.70:0/290812630 wait complete. 2024-09-13T16:03:04.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.685+0000 7f9188000640 1 Processor -- start 2024-09-13T16:03:04.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.685+0000 7f9188000640 1 -- start start 2024-09-13T16:03:04.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.686+0000 7f9188000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9168003b00 0x7f918014ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.686+0000 7f9188000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9180150f20 0x7f91800ad590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.686+0000 7f9188000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91801513a0 0x7f91800adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.686+0000 7f9188000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9180155eb0 con 0x7f91801513a0 2024-09-13T16:03:04.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.686+0000 7f9188000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9180156d10 con 0x7f9180150f20 2024-09-13T16:03:04.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.686+0000 7f9188000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9180156100 con 0x7f9168003b00 2024-09-13T16:03:04.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.686+0000 7f9186000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91801513a0 0x7f91800adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.686+0000 7f9186000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91801513a0 0x7f91800adad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49242/0 (socket says 172.21.15.70:49242) 2024-09-13T16:03:04.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.686+0000 7f9186000640 1 -- 172.21.15.70:0/3126528000 learned_addr learned my addr 172.21.15.70:0/3126528000 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:04.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.686+0000 7f9184c00640 1 --2- 172.21.15.70:0/3126528000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9180150f20 0x7f91800ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.686+0000 7f9185600640 1 --2- 172.21.15.70:0/3126528000 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9168003b00 0x7f918014ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.687+0000 7f9186000640 1 -- 172.21.15.70:0/3126528000 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9168003b00 msgr2=0x7f918014ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.687+0000 7f9186000640 1 --2- 172.21.15.70:0/3126528000 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9168003b00 0x7f918014ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.687+0000 7f9186000640 1 -- 172.21.15.70:0/3126528000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9180150f20 msgr2=0x7f91800ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.687+0000 7f9186000640 1 --2- 172.21.15.70:0/3126528000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9180150f20 0x7f91800ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.687+0000 7f9186000640 1 -- 172.21.15.70:0/3126528000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91801563e0 con 0x7f91801513a0 2024-09-13T16:03:04.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.687+0000 7f9186000640 1 --2- 172.21.15.70:0/3126528000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91801513a0 0x7f91800adad0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9168004740 tx=0x7f917800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:04.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.687+0000 7f917d600640 1 -- 172.21.15.70:0/3126528000 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917800e040 con 0x7f91801513a0 2024-09-13T16:03:04.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.687+0000 7f917d600640 1 -- 172.21.15.70:0/3126528000 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917800f040 con 0x7f91801513a0 2024-09-13T16:03:04.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.687+0000 7f9188000640 1 -- 172.21.15.70:0/3126528000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91801566c0 con 0x7f91801513a0 2024-09-13T16:03:04.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.687+0000 7f917d600640 1 -- 172.21.15.70:0/3126528000 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178015430 con 0x7f91801513a0 2024-09-13T16:03:04.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.687+0000 7f9188000640 1 -- 172.21.15.70:0/3126528000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918014cfd0 con 0x7f91801513a0 2024-09-13T16:03:04.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.688+0000 7f9188000640 1 -- 172.21.15.70:0/3126528000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f918006c180 con 0x7f91801513a0 2024-09-13T16:03:04.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.689+0000 7f917d600640 1 -- 172.21.15.70:0/3126528000 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9178015590 con 0x7f91801513a0 2024-09-13T16:03:04.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.690+0000 7f917d600640 1 --2- 172.21.15.70:0/3126528000 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f916006ac00 0x7f916006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:04.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.690+0000 7f917d600640 1 -- 172.21.15.70:0/3126528000 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9178089930 con 0x7f91801513a0 2024-09-13T16:03:04.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.690+0000 7f9185600640 1 --2- 172.21.15.70:0/3126528000 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f916006ac00 0x7f916006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:04.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.691+0000 7f9185600640 1 --2- 172.21.15.70:0/3126528000 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f916006ac00 0x7f916006d0c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9174032000 tx=0x7f9174009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:04.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.694+0000 7f917d600640 1 -- 172.21.15.70:0/3126528000 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9178054d10 con 0x7f91801513a0 2024-09-13T16:03:04.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.863+0000 7f9188000640 1 -- 172.21.15.70:0/3126528000 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f918006cf40 con 0x7f916006ac00 2024-09-13T16:03:04.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.864+0000 7f917d600640 1 -- 172.21.15.70:0/3126528000 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f917402aa20 con 0x7f916006ac00 2024-09-13T16:03:04.865 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T16:03:04.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.866+0000 7f9188000640 1 -- 172.21.15.70:0/3126528000 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f916006ac00 msgr2=0x7f916006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.866+0000 7f9188000640 1 --2- 172.21.15.70:0/3126528000 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f916006ac00 0x7f916006d0c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9174032000 tx=0x7f9174009030 comp rx=0 tx=0).stop 2024-09-13T16:03:04.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.866+0000 7f9188000640 1 -- 172.21.15.70:0/3126528000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91801513a0 msgr2=0x7f91800adad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:04.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.866+0000 7f9188000640 1 --2- 172.21.15.70:0/3126528000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91801513a0 0x7f91800adad0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9168004740 tx=0x7f917800f580 comp rx=0 tx=0).stop 2024-09-13T16:03:04.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.866+0000 7f9188000640 1 -- 172.21.15.70:0/3126528000 shutdown_connections 2024-09-13T16:03:04.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.866+0000 7f9188000640 1 --2- 172.21.15.70:0/3126528000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91801513a0 0x7f91800adad0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.866+0000 7f9188000640 1 --2- 172.21.15.70:0/3126528000 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f916006ac00 0x7f916006d0c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.866+0000 7f9188000640 1 --2- 172.21.15.70:0/3126528000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9180150f20 0x7f91800ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.866+0000 7f9188000640 1 --2- 172.21.15.70:0/3126528000 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9168003b00 0x7f918014ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:04.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.866+0000 7f9188000640 1 -- 172.21.15.70:0/3126528000 >> 172.21.15.70:0/3126528000 conn(0x7f91800b0510 msgr2=0x7f91800b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:04.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.866+0000 7f9188000640 1 -- 172.21.15.70:0/3126528000 shutdown_connections 2024-09-13T16:03:04.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:04.866+0000 7f9188000640 1 -- 172.21.15.70:0/3126528000 wait complete. 2024-09-13T16:03:04.882 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T16:03:04.882 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T16:03:05.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.037+0000 7fd280e00640 1 Processor -- start 2024-09-13T16:03:05.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.037+0000 7fd280e00640 1 -- start start 2024-09-13T16:03:05.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.038+0000 7fd280e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd27c0adeb0 0x7fd27c0704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.038+0000 7fd280e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd27c1596d0 0x7fd27c070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.038+0000 7fd280e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd27c070030 con 0x7fd27c1592f0 2024-09-13T16:03:05.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.038+0000 7fd280e00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27c071870 con 0x7fd27c0adeb0 2024-09-13T16:03:05.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.038+0000 7fd280e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c06f700 con 0x7fd27c1596d0 2024-09-13T16:03:05.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.038+0000 7fd279400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd27c0adeb0 0x7fd27c0704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.039+0000 7fd279400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd27c0adeb0 0x7fd27c0704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49256/0 (socket says 172.21.15.70:49256) 2024-09-13T16:03:05.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.039+0000 7fd279400640 1 -- 172.21.15.70:0/2271430578 learned_addr learned my addr 172.21.15.70:0/2271430578 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:05.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.039+0000 7fd27a800640 1 --2- 172.21.15.70:0/2271430578 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd27c1596d0 0x7fd27c070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.039+0000 7fd279400640 1 -- 172.21.15.70:0/2271430578 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd27c1596d0 msgr2=0x7fd27c070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:05.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.039+0000 7fd279400640 1 --2- 172.21.15.70:0/2271430578 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd27c1596d0 0x7fd27c070a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.039+0000 7fd279400640 1 -- 172.21.15.70:0/2271430578 >> v1:172.21.15.107:6789/0 conn(0x7fd27c1592f0 legacy=0x7fd27c0b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:05.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.039+0000 7fd279400640 1 -- 172.21.15.70:0/2271430578 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c06f9e0 con 0x7fd27c0adeb0 2024-09-13T16:03:05.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.039+0000 7fd27a800640 1 --2- 172.21.15.70:0/2271430578 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd27c1596d0 0x7fd27c070a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:03:05.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.040+0000 7fd279400640 1 --2- 172.21.15.70:0/2271430578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd27c0adeb0 0x7fd27c0704c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd268009870 tx=0x7fd26802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c1e3f475b35261 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:05.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.040+0000 7fd278a00640 1 -- 172.21.15.70:0/2271430578 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268032440 con 0x7fd27c0adeb0 2024-09-13T16:03:05.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.040+0000 7fd278a00640 1 -- 172.21.15.70:0/2271430578 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2680325a0 con 0x7fd27c0adeb0 2024-09-13T16:03:05.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.040+0000 7fd278a00640 1 -- 172.21.15.70:0/2271430578 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268032930 con 0x7fd27c0adeb0 2024-09-13T16:03:05.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.041+0000 7fd280e00640 1 -- 172.21.15.70:0/2271430578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd27c0adeb0 msgr2=0x7fd27c0704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.041+0000 7fd280e00640 1 --2- 172.21.15.70:0/2271430578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd27c0adeb0 0x7fd27c0704c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd268009870 tx=0x7fd26802a200 comp rx=0 tx=0).stop 2024-09-13T16:03:05.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.041+0000 7fd280e00640 1 -- 172.21.15.70:0/2271430578 shutdown_connections 2024-09-13T16:03:05.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.041+0000 7fd280e00640 1 --2- 172.21.15.70:0/2271430578 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd27c1596d0 0x7fd27c070a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.041+0000 7fd280e00640 1 --2- 172.21.15.70:0/2271430578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd27c0adeb0 0x7fd27c0704c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.041+0000 7fd280e00640 1 -- 172.21.15.70:0/2271430578 >> 172.21.15.70:0/2271430578 conn(0x7fd27c0b0510 msgr2=0x7fd27c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:05.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.041+0000 7fd280e00640 1 -- 172.21.15.70:0/2271430578 shutdown_connections 2024-09-13T16:03:05.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.041+0000 7fd280e00640 1 -- 172.21.15.70:0/2271430578 wait complete. 2024-09-13T16:03:05.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.042+0000 7fd280e00640 1 Processor -- start 2024-09-13T16:03:05.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.043+0000 7fd280e00640 1 -- start start 2024-09-13T16:03:05.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.043+0000 7fd280e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd27c0adeb0 0x7fd27c148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.043+0000 7fd280e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd27c1592f0 0x7fd27c159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.043+0000 7fd280e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd27c1596d0 0x7fd27c1f5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.043+0000 7fd280e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c15a030 con 0x7fd27c1592f0 2024-09-13T16:03:05.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.043+0000 7fd280e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c15a2b0 con 0x7fd27c0adeb0 2024-09-13T16:03:05.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.043+0000 7fd280e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c15a590 con 0x7fd27c1596d0 2024-09-13T16:03:05.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.044+0000 7fd279400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd27c1592f0 0x7fd27c159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.044+0000 7fd279400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd27c1592f0 0x7fd27c159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49258/0 (socket says 172.21.15.70:49258) 2024-09-13T16:03:05.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.044+0000 7fd279400640 1 -- 172.21.15.70:0/905555229 learned_addr learned my addr 172.21.15.70:0/905555229 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:05.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.044+0000 7fd279e00640 1 --2- 172.21.15.70:0/905555229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd27c0adeb0 0x7fd27c148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.044+0000 7fd27a800640 1 --2- 172.21.15.70:0/905555229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd27c1596d0 0x7fd27c1f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.044+0000 7fd279400640 1 -- 172.21.15.70:0/905555229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd27c1596d0 msgr2=0x7fd27c1f5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.044+0000 7fd279400640 1 --2- 172.21.15.70:0/905555229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd27c1596d0 0x7fd27c1f5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.044+0000 7fd279400640 1 -- 172.21.15.70:0/905555229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd27c0adeb0 msgr2=0x7fd27c148760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.044+0000 7fd279400640 1 --2- 172.21.15.70:0/905555229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd27c0adeb0 0x7fd27c148760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.044+0000 7fd279400640 1 -- 172.21.15.70:0/905555229 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2680094d0 con 0x7fd27c1592f0 2024-09-13T16:03:05.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.044+0000 7fd279e00640 1 --2- 172.21.15.70:0/905555229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd27c0adeb0 0x7fd27c148760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:03:05.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.044+0000 7fd27a800640 1 --2- 172.21.15.70:0/905555229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd27c1596d0 0x7fd27c1f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:03:05.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.044+0000 7fd279400640 1 --2- 172.21.15.70:0/905555229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd27c1592f0 0x7fd27c159af0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd268009870 tx=0x7fd2680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:05.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.045+0000 7fd272000640 1 -- 172.21.15.70:0/905555229 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268030b00 con 0x7fd27c1592f0 2024-09-13T16:03:05.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.045+0000 7fd272000640 1 -- 172.21.15.70:0/905555229 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd268030c60 con 0x7fd27c1592f0 2024-09-13T16:03:05.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.045+0000 7fd272000640 1 -- 172.21.15.70:0/905555229 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26803d420 con 0x7fd27c1592f0 2024-09-13T16:03:05.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.045+0000 7fd280e00640 1 -- 172.21.15.70:0/905555229 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27c15a870 con 0x7fd27c1592f0 2024-09-13T16:03:05.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.045+0000 7fd280e00640 1 -- 172.21.15.70:0/905555229 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27c15ae30 con 0x7fd27c1592f0 2024-09-13T16:03:05.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.046+0000 7fd280e00640 1 -- 172.21.15.70:0/905555229 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd27c070f40 con 0x7fd27c1592f0 2024-09-13T16:03:05.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.047+0000 7fd272000640 1 -- 172.21.15.70:0/905555229 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd268039040 con 0x7fd27c1592f0 2024-09-13T16:03:05.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.048+0000 7fd272000640 1 --2- 172.21.15.70:0/905555229 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd25c06ac00 0x7fd25c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.048+0000 7fd272000640 1 -- 172.21.15.70:0/905555229 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd2680aa480 con 0x7fd27c1592f0 2024-09-13T16:03:05.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.048+0000 7fd279e00640 1 --2- 172.21.15.70:0/905555229 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd25c06ac00 0x7fd25c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.048+0000 7fd272000640 1 --2- 172.21.15.70:0/905555229 >> [v2:172.21.15.107:6800/679436451,v1:172.21.15.107:6801/679436451] conn(0x7fd25c070b00 0x7fd25c072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.048+0000 7fd272000640 1 -- 172.21.15.70:0/905555229 --> [v2:172.21.15.107:6800/679436451,v1:172.21.15.107:6801/679436451] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd25c0735d0 con 0x7fd25c070b00 2024-09-13T16:03:05.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.048+0000 7fd272000640 1 -- 172.21.15.70:0/905555229 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2680aa8d0 con 0x7fd27c1592f0 2024-09-13T16:03:05.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.048+0000 7fd27a800640 1 --2- 172.21.15.70:0/905555229 >> [v2:172.21.15.107:6800/679436451,v1:172.21.15.107:6801/679436451] conn(0x7fd25c070b00 0x7fd25c072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.049+0000 7fd279e00640 1 --2- 172.21.15.70:0/905555229 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd25c06ac00 0x7fd25c06d0c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd26c003eb0 tx=0x7fd26c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:05.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.049+0000 7fd27a800640 1 --2- 172.21.15.70:0/905555229 >> [v2:172.21.15.107:6800/679436451,v1:172.21.15.107:6801/679436451] conn(0x7fd25c070b00 0x7fd25c072f20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:05.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.050+0000 7fd272000640 1 -- 172.21.15.70:0/905555229 <== osd.4 v2:172.21.15.107:6800/679436451 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd25c0735d0 con 0x7fd25c070b00 2024-09-13T16:03:05.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.062+0000 7fd280e00640 1 -- 172.21.15.70:0/905555229 --> [v2:172.21.15.107:6800/679436451,v1:172.21.15.107:6801/679436451] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd27c0b1810 con 0x7fd25c070b00 2024-09-13T16:03:05.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.063+0000 7fd272000640 1 -- 172.21.15.70:0/905555229 <== osd.4 v2:172.21.15.107:6800/679436451 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd27c0b1810 con 0x7fd25c070b00 2024-09-13T16:03:05.065 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-13T16:03:05.065 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T16:03:05.065 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-13T16:03:05.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.063+0000 7fd280e00640 1 -- 172.21.15.70:0/905555229 >> [v2:172.21.15.107:6800/679436451,v1:172.21.15.107:6801/679436451] conn(0x7fd25c070b00 msgr2=0x7fd25c072f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.063+0000 7fd280e00640 1 --2- 172.21.15.70:0/905555229 >> [v2:172.21.15.107:6800/679436451,v1:172.21.15.107:6801/679436451] conn(0x7fd25c070b00 0x7fd25c072f20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.064+0000 7fd280e00640 1 -- 172.21.15.70:0/905555229 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd25c06ac00 msgr2=0x7fd25c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.064+0000 7fd280e00640 1 --2- 172.21.15.70:0/905555229 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fd25c06ac00 0x7fd25c06d0c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd26c003eb0 tx=0x7fd26c009040 comp rx=0 tx=0).stop 2024-09-13T16:03:05.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.064+0000 7fd280e00640 1 -- 172.21.15.70:0/905555229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd27c1592f0 msgr2=0x7fd27c159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.064+0000 7fd280e00640 1 --2- 172.21.15.70:0/905555229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd27c1592f0 0x7fd27c159af0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd268009870 tx=0x7fd2680046c0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.064+0000 7fd27a800640 1 -- 172.21.15.70:0/905555229 reap_dead start 2024-09-13T16:03:05.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.064+0000 7fd280e00640 1 -- 172.21.15.70:0/905555229 shutdown_connections 2024-09-13T16:03:05.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.064+0000 7fd280e00640 1 -- 172.21.15.70:0/905555229 >> 172.21.15.70:0/905555229 conn(0x7fd27c0b0510 msgr2=0x7fd27c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:05.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.064+0000 7fd280e00640 1 -- 172.21.15.70:0/905555229 shutdown_connections 2024-09-13T16:03:05.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.064+0000 7fd280e00640 1 -- 172.21.15.70:0/905555229 wait complete. 2024-09-13T16:03:05.079 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T16:03:05.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.231+0000 7fb748600640 1 Processor -- start 2024-09-13T16:03:05.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.231+0000 7fb748600640 1 -- start start 2024-09-13T16:03:05.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.232+0000 7fb748600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7400b2a30 0x7fb74006bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.232+0000 7fb748600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb7400adcb0 0x7fb7400cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.232+0000 7fb748600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb740070110 con 0x7fb740160d10 2024-09-13T16:03:05.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.232+0000 7fb748600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7401610f0 con 0x7fb7400adcb0 2024-09-13T16:03:05.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.232+0000 7fb748600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400703f0 con 0x7fb7400b2a30 2024-09-13T16:03:05.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.233+0000 7fb745c00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb740160d10 0x7fb7400b2320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50792/0 (socket says 172.21.15.70:50792) 2024-09-13T16:03:05.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.233+0000 7fb745c00640 1 -- 172.21.15.70:0/3040871431 learned_addr learned my addr 172.21.15.70:0/3040871431 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:03:05.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.233+0000 7fb73fe00640 1 -- 172.21.15.70:0/3040871431 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2867711221 0 0) 0x7fb740070110 con 0x7fb740160d10 2024-09-13T16:03:05.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.233+0000 7fb73fe00640 1 -- 172.21.15.70:0/3040871431 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb728003520 con 0x7fb740160d10 2024-09-13T16:03:05.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.233+0000 7fb745200640 1 --2- 172.21.15.70:0/3040871431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7400b2a30 0x7fb74006bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.233+0000 7fb746600640 1 --2- 172.21.15.70:0/3040871431 >> v2:172.21.15.107:3300/0 conn(0x7fb7400adcb0 0x7fb7400cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.233+0000 7fb73fe00640 1 -- 172.21.15.70:0/3040871431 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2980076406 0 0) 0x7fb728003520 con 0x7fb740160d10 2024-09-13T16:03:05.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.233+0000 7fb73fe00640 1 -- 172.21.15.70:0/3040871431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7400b2a30 msgr2=0x7fb74006bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:05.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.233+0000 7fb73fe00640 1 --2- 172.21.15.70:0/3040871431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7400b2a30 0x7fb74006bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.233+0000 7fb73fe00640 1 -- 172.21.15.70:0/3040871431 >> v2:172.21.15.107:3300/0 conn(0x7fb7400adcb0 msgr2=0x7fb7400cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:05.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.233+0000 7fb73fe00640 1 --2- 172.21.15.70:0/3040871431 >> v2:172.21.15.107:3300/0 conn(0x7fb7400adcb0 0x7fb7400cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.233+0000 7fb73fe00640 1 -- 172.21.15.70:0/3040871431 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7400706d0 con 0x7fb740160d10 2024-09-13T16:03:05.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.233+0000 7fb73fe00640 1 -- 172.21.15.70:0/3040871431 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7fb734001670 con 0x7fb740160d10 2024-09-13T16:03:05.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.233+0000 7fb745200640 1 --2- 172.21.15.70:0/3040871431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7400b2a30 0x7fb74006bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:03:05.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.234+0000 7fb73fe00640 1 -- 172.21.15.70:0/3040871431 >> v1:172.21.15.70:6789/0 conn(0x7fb740160d10 legacy=0x7fb7400b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.234+0000 7fb73fe00640 1 --2- 172.21.15.70:0/3040871431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb728003970 0x7fb728003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.234+0000 7fb73fe00640 1 --2- 172.21.15.70:0/3040871431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7280047c0 0x7fb728004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.234+0000 7fb73fe00640 1 --2- 172.21.15.70:0/3040871431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7400b2a30 0x7fb728005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.234+0000 7fb73fe00640 1 -- 172.21.15.70:0/3040871431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7401610f0 con 0x7fb728003970 2024-09-13T16:03:05.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.234+0000 7fb73fe00640 1 -- 172.21.15.70:0/3040871431 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400703f0 con 0x7fb7280047c0 2024-09-13T16:03:05.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.234+0000 7fb73fe00640 1 -- 172.21.15.70:0/3040871431 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72800b980 con 0x7fb7400b2a30 2024-09-13T16:03:05.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.234+0000 7fb745c00640 1 --2- 172.21.15.70:0/3040871431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb728003970 0x7fb728003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.234+0000 7fb745200640 1 --2- 172.21.15.70:0/3040871431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7280047c0 0x7fb728004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.234+0000 7fb746600640 1 --2- 172.21.15.70:0/3040871431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7400b2a30 0x7fb728005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.234+0000 7fb745c00640 1 -- 172.21.15.70:0/3040871431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7400b2a30 msgr2=0x7fb728005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:05.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.234+0000 7fb745c00640 1 --2- 172.21.15.70:0/3040871431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7400b2a30 0x7fb728005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.234+0000 7fb745c00640 1 -- 172.21.15.70:0/3040871431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7280047c0 msgr2=0x7fb728004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:05.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.234+0000 7fb745c00640 1 --2- 172.21.15.70:0/3040871431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7280047c0 0x7fb728004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.234+0000 7fb745c00640 1 -- 172.21.15.70:0/3040871431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb728003520 con 0x7fb728003970 2024-09-13T16:03:05.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.235+0000 7fb745c00640 1 --2- 172.21.15.70:0/3040871431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb728003970 0x7fb728003d90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb73400c270 tx=0x7fb7280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226a8621756e4f23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:05.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.236+0000 7fb73fe00640 1 -- 172.21.15.70:0/3040871431 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb734005ad0 con 0x7fb728003970 2024-09-13T16:03:05.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.236+0000 7fb73fe00640 1 -- 172.21.15.70:0/3040871431 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb734005c30 con 0x7fb728003970 2024-09-13T16:03:05.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.236+0000 7fb73fe00640 1 -- 172.21.15.70:0/3040871431 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb734007070 con 0x7fb728003970 2024-09-13T16:03:05.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.236+0000 7fb748600640 1 -- 172.21.15.70:0/3040871431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb728003970 msgr2=0x7fb728003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.236+0000 7fb748600640 1 --2- 172.21.15.70:0/3040871431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb728003970 0x7fb728003d90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb73400c270 tx=0x7fb7280057f0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.236+0000 7fb746600640 1 -- 172.21.15.70:0/3040871431 reap_dead start 2024-09-13T16:03:05.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.236+0000 7fb748600640 1 -- 172.21.15.70:0/3040871431 shutdown_connections 2024-09-13T16:03:05.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.236+0000 7fb748600640 1 -- 172.21.15.70:0/3040871431 >> 172.21.15.70:0/3040871431 conn(0x7fb7400b0510 msgr2=0x7fb7400b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:05.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.236+0000 7fb748600640 1 -- 172.21.15.70:0/3040871431 shutdown_connections 2024-09-13T16:03:05.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.236+0000 7fb748600640 1 -- 172.21.15.70:0/3040871431 wait complete. 2024-09-13T16:03:05.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.238+0000 7fb748600640 1 Processor -- start 2024-09-13T16:03:05.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.238+0000 7fb748600640 1 -- start start 2024-09-13T16:03:05.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.239+0000 7fb748600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb728003970 0x7fb74014e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.239+0000 7fb748600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb74015da80 0x7fb7400a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.239+0000 7fb748600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7400a89a0 0x7fb7400a8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.239+0000 7fb748600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400aa0b0 con 0x7fb7400a89a0 2024-09-13T16:03:05.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.239+0000 7fb748600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400ad5e0 con 0x7fb74015da80 2024-09-13T16:03:05.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.239+0000 7fb748600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74014ea90 con 0x7fb728003970 2024-09-13T16:03:05.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.239+0000 7fb746600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7400a89a0 0x7fb7400a8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.239+0000 7fb746600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7400a89a0 0x7fb7400a8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49290/0 (socket says 172.21.15.70:49290) 2024-09-13T16:03:05.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.239+0000 7fb746600640 1 -- 172.21.15.70:0/134793702 learned_addr learned my addr 172.21.15.70:0/134793702 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.239+0000 7fb745c00640 1 --2- 172.21.15.70:0/134793702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb728003970 0x7fb74014e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.239+0000 7fb745200640 1 --2- 172.21.15.70:0/134793702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb74015da80 0x7fb7400a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.240+0000 7fb746600640 1 -- 172.21.15.70:0/134793702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb728003970 msgr2=0x7fb74014e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.240+0000 7fb746600640 1 --2- 172.21.15.70:0/134793702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb728003970 0x7fb74014e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.240+0000 7fb746600640 1 -- 172.21.15.70:0/134793702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb74015da80 msgr2=0x7fb7400a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.240+0000 7fb746600640 1 --2- 172.21.15.70:0/134793702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb74015da80 0x7fb7400a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.240+0000 7fb746600640 1 -- 172.21.15.70:0/134793702 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74014ed70 con 0x7fb7400a89a0 2024-09-13T16:03:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.240+0000 7fb746600640 1 --2- 172.21.15.70:0/134793702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7400a89a0 0x7fb7400a8e50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb7400b21e0 tx=0x7fb73800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.240+0000 7fb73d600640 1 -- 172.21.15.70:0/134793702 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73800e040 con 0x7fb7400a89a0 2024-09-13T16:03:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.240+0000 7fb73d600640 1 -- 172.21.15.70:0/134793702 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73800f040 con 0x7fb7400a89a0 2024-09-13T16:03:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.240+0000 7fb73d600640 1 -- 172.21.15.70:0/134793702 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb738015670 con 0x7fb7400a89a0 2024-09-13T16:03:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.240+0000 7fb748600640 1 -- 172.21.15.70:0/134793702 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74014f050 con 0x7fb7400a89a0 2024-09-13T16:03:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.240+0000 7fb748600640 1 -- 172.21.15.70:0/134793702 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7401509a0 con 0x7fb7400a89a0 2024-09-13T16:03:05.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.241+0000 7fb748600640 1 -- 172.21.15.70:0/134793702 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74014f240 con 0x7fb7400a89a0 2024-09-13T16:03:05.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.242+0000 7fb73d600640 1 -- 172.21.15.70:0/134793702 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb7380157d0 con 0x7fb7400a89a0 2024-09-13T16:03:05.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.243+0000 7fb73d600640 1 --2- 172.21.15.70:0/134793702 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb72006ac00 0x7fb72006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.243+0000 7fb73d600640 1 -- 172.21.15.70:0/134793702 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb738089900 con 0x7fb7400a89a0 2024-09-13T16:03:05.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.243+0000 7fb745c00640 1 --2- 172.21.15.70:0/134793702 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb72006ac00 0x7fb72006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.244+0000 7fb745c00640 1 --2- 172.21.15.70:0/134793702 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb72006ac00 0x7fb72006d0c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb734033000 tx=0x7fb734007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:05.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.247+0000 7fb73d600640 1 -- 172.21.15.70:0/134793702 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb738054ec0 con 0x7fb7400a89a0 2024-09-13T16:03:05.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.416+0000 7fb748600640 1 -- 172.21.15.70:0/134793702 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb74014e910 con 0x7fb72006ac00 2024-09-13T16:03:05.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.416+0000 7fb73d600640 1 -- 172.21.15.70:0/134793702 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb734005da0 con 0x7fb72006ac00 2024-09-13T16:03:05.418 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T16:03:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.418+0000 7fb748600640 1 -- 172.21.15.70:0/134793702 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb72006ac00 msgr2=0x7fb72006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.418+0000 7fb748600640 1 --2- 172.21.15.70:0/134793702 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb72006ac00 0x7fb72006d0c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb734033000 tx=0x7fb734007000 comp rx=0 tx=0).stop 2024-09-13T16:03:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.418+0000 7fb748600640 1 -- 172.21.15.70:0/134793702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7400a89a0 msgr2=0x7fb7400a8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.418+0000 7fb748600640 1 --2- 172.21.15.70:0/134793702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7400a89a0 0x7fb7400a8e50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb7400b21e0 tx=0x7fb73800f580 comp rx=0 tx=0).stop 2024-09-13T16:03:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.418+0000 7fb748600640 1 -- 172.21.15.70:0/134793702 shutdown_connections 2024-09-13T16:03:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.418+0000 7fb748600640 1 --2- 172.21.15.70:0/134793702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7400a89a0 0x7fb7400a8e50 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.418+0000 7fb748600640 1 --2- 172.21.15.70:0/134793702 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb72006ac00 0x7fb72006d0c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.418+0000 7fb748600640 1 --2- 172.21.15.70:0/134793702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb74015da80 0x7fb7400a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.418+0000 7fb748600640 1 --2- 172.21.15.70:0/134793702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb728003970 0x7fb74014e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.419+0000 7fb748600640 1 -- 172.21.15.70:0/134793702 >> 172.21.15.70:0/134793702 conn(0x7fb7400b0510 msgr2=0x7fb7400b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.419+0000 7fb748600640 1 -- 172.21.15.70:0/134793702 shutdown_connections 2024-09-13T16:03:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.419+0000 7fb748600640 1 -- 172.21.15.70:0/134793702 wait complete. 2024-09-13T16:03:05.435 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T16:03:05.435 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T16:03:05.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.590+0000 7ffba5200640 1 Processor -- start 2024-09-13T16:03:05.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.591+0000 7ffba5200640 1 -- start start 2024-09-13T16:03:05.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.592+0000 7ffba5200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffba015dda0 0x7ffba00b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.592+0000 7ffba5200640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba015cfe0 con 0x7ffba015cc00 2024-09-13T16:03:05.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.592+0000 7ffba5200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba00b2830 con 0x7ffba015d8f0 2024-09-13T16:03:05.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.592+0000 7ffba5200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba00b3200 con 0x7ffba015dda0 2024-09-13T16:03:05.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.592+0000 7ffb9f400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7ffba015cc00 0x7ffba015d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50806/0 (socket says 172.21.15.70:50806) 2024-09-13T16:03:05.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.592+0000 7ffb9f400640 1 -- 172.21.15.70:0/2781086862 learned_addr learned my addr 172.21.15.70:0/2781086862 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:03:05.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.592+0000 7ffb9fe00640 1 --2- 172.21.15.70:0/2781086862 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffba015dda0 0x7ffba00b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.593+0000 7ffb9ea00640 1 -- 172.21.15.70:0/2781086862 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721770519 0 0) 0x7ffba015cfe0 con 0x7ffba015cc00 2024-09-13T16:03:05.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.593+0000 7ffb9ea00640 1 -- 172.21.15.70:0/2781086862 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb84003520 con 0x7ffba015cc00 2024-09-13T16:03:05.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.593+0000 7ffb9ea00640 1 -- 172.21.15.70:0/2781086862 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3976903244 0 0) 0x7ffb84003520 con 0x7ffba015cc00 2024-09-13T16:03:05.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.593+0000 7ffb9ea00640 1 -- 172.21.15.70:0/2781086862 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffba015dda0 msgr2=0x7ffba00b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:05.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.593+0000 7ffb9ea00640 1 --2- 172.21.15.70:0/2781086862 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffba015dda0 0x7ffba00b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.593+0000 7ffb9ea00640 1 -- 172.21.15.70:0/2781086862 >> v1:172.21.15.107:6789/0 conn(0x7ffba015d8f0 legacy=0x7ffba00c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.593+0000 7ffb9ea00640 1 -- 172.21.15.70:0/2781086862 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba00cde20 con 0x7ffba015cc00 2024-09-13T16:03:05.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.593+0000 7ffb9ea00640 1 -- 172.21.15.70:0/2781086862 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7ffb90001670 con 0x7ffba015cc00 2024-09-13T16:03:05.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.593+0000 7ffb9ea00640 1 -- 172.21.15.70:0/2781086862 >> v1:172.21.15.70:6789/0 conn(0x7ffba015cc00 legacy=0x7ffba015d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.593+0000 7ffb9ea00640 1 --2- 172.21.15.70:0/2781086862 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffba015dda0 0x7ffb840039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.593+0000 7ffb9ea00640 1 --2- 172.21.15.70:0/2781086862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb84003f20 0x7ffb840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.593+0000 7ffb9ea00640 1 --2- 172.21.15.70:0/2781086862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb84004d00 0x7ffb84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.593+0000 7ffb9ea00640 1 -- 172.21.15.70:0/2781086862 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba00b3200 con 0x7ffb84004d00 2024-09-13T16:03:05.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.593+0000 7ffb9ea00640 1 -- 172.21.15.70:0/2781086862 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8400bac0 con 0x7ffb84003f20 2024-09-13T16:03:05.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.593+0000 7ffb9ea00640 1 -- 172.21.15.70:0/2781086862 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8400bc80 con 0x7ffba015dda0 2024-09-13T16:03:05.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.593+0000 7ffb9fe00640 1 --2- 172.21.15.70:0/2781086862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb84004d00 0x7ffb84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.593+0000 7ffb96a00640 1 --2- 172.21.15.70:0/2781086862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb84003f20 0x7ffb840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.593+0000 7ffb9f400640 1 --2- 172.21.15.70:0/2781086862 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffba015dda0 0x7ffb840039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.594+0000 7ffb9fe00640 1 -- 172.21.15.70:0/2781086862 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffba015dda0 msgr2=0x7ffb840039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:05.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.594+0000 7ffb9fe00640 1 --2- 172.21.15.70:0/2781086862 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffba015dda0 0x7ffb840039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.594+0000 7ffb9fe00640 1 -- 172.21.15.70:0/2781086862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb84003f20 msgr2=0x7ffb840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:05.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.594+0000 7ffb9fe00640 1 --2- 172.21.15.70:0/2781086862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb84003f20 0x7ffb840047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.594+0000 7ffb9fe00640 1 -- 172.21.15.70:0/2781086862 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba00cde20 con 0x7ffb84004d00 2024-09-13T16:03:05.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.595+0000 7ffb9fe00640 1 --2- 172.21.15.70:0/2781086862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb84004d00 0x7ffb84005180 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009fc0 tx=0x7ffb840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f038c4e27d3d031 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:05.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.595+0000 7ffb9ea00640 1 -- 172.21.15.70:0/2781086862 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb98031640 con 0x7ffb84004d00 2024-09-13T16:03:05.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.595+0000 7ffb9ea00640 1 -- 172.21.15.70:0/2781086862 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9802d070 con 0x7ffb84004d00 2024-09-13T16:03:05.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.595+0000 7ffb9ea00640 1 -- 172.21.15.70:0/2781086862 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb980319e0 con 0x7ffb84004d00 2024-09-13T16:03:05.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.595+0000 7ffba5200640 1 -- 172.21.15.70:0/2781086862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb84004d00 msgr2=0x7ffb84005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.595+0000 7ffba5200640 1 --2- 172.21.15.70:0/2781086862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb84004d00 0x7ffb84005180 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009fc0 tx=0x7ffb840057f0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.595+0000 7ffb9fe00640 1 -- 172.21.15.70:0/2781086862 reap_dead start 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.595+0000 7ffba5200640 1 -- 172.21.15.70:0/2781086862 shutdown_connections 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.595+0000 7ffba5200640 1 -- 172.21.15.70:0/2781086862 >> 172.21.15.70:0/2781086862 conn(0x7ffba00b0330 msgr2=0x7ffba00b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.596+0000 7ffba5200640 1 -- 172.21.15.70:0/2781086862 shutdown_connections 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.596+0000 7ffba5200640 1 -- 172.21.15.70:0/2781086862 wait complete. 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.597+0000 7ffba5200640 1 Processor -- start 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.597+0000 7ffba5200640 1 -- start start 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.598+0000 7ffba5200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb84004d00 0x7ffba0155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.598+0000 7ffba5200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba0158850 0x7ffba01f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.598+0000 7ffba5200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffba01f1d80 0x7ffba00cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.598+0000 7ffba5200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba01f2d80 con 0x7ffba01f1d80 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.598+0000 7ffba5200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba01f6290 con 0x7ffba0158850 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.598+0000 7ffba5200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba01f27c0 con 0x7ffb84004d00 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.599+0000 7ffb9fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffba01f1d80 0x7ffba00cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.599+0000 7ffb9fe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffba01f1d80 0x7ffba00cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49320/0 (socket says 172.21.15.70:49320) 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.599+0000 7ffb9fe00640 1 -- 172.21.15.70:0/4085959734 learned_addr learned my addr 172.21.15.70:0/4085959734 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.599+0000 7ffb9f400640 1 --2- 172.21.15.70:0/4085959734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb84004d00 0x7ffba0155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.599+0000 7ffb96a00640 1 --2- 172.21.15.70:0/4085959734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba0158850 0x7ffba01f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.599+0000 7ffb9fe00640 1 -- 172.21.15.70:0/4085959734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb84004d00 msgr2=0x7ffba0155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.599+0000 7ffb9fe00640 1 --2- 172.21.15.70:0/4085959734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb84004d00 0x7ffba0155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.599+0000 7ffb9fe00640 1 -- 172.21.15.70:0/4085959734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba0158850 msgr2=0x7ffba01f5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.599+0000 7ffb9fe00640 1 --2- 172.21.15.70:0/4085959734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba0158850 0x7ffba01f5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.599+0000 7ffb9fe00640 1 -- 172.21.15.70:0/4085959734 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba01f2aa0 con 0x7ffba01f1d80 2024-09-13T16:03:05.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.599+0000 7ffb9fe00640 1 --2- 172.21.15.70:0/4085959734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffba01f1d80 0x7ffba00cd220 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ffb98033040 tx=0x7ffb98009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:05.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.599+0000 7ffb97e00640 1 -- 172.21.15.70:0/4085959734 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb98031df0 con 0x7ffba01f1d80 2024-09-13T16:03:05.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.599+0000 7ffb97e00640 1 -- 172.21.15.70:0/4085959734 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb98040070 con 0x7ffba01f1d80 2024-09-13T16:03:05.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.600+0000 7ffb97e00640 1 -- 172.21.15.70:0/4085959734 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb98003bd0 con 0x7ffba01f1d80 2024-09-13T16:03:05.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.600+0000 7ffba5200640 1 -- 172.21.15.70:0/4085959734 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba01f5550 con 0x7ffba01f1d80 2024-09-13T16:03:05.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.600+0000 7ffba5200640 1 -- 172.21.15.70:0/4085959734 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba01f2200 con 0x7ffba01f1d80 2024-09-13T16:03:05.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.601+0000 7ffba5200640 1 -- 172.21.15.70:0/4085959734 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffba00b24c0 con 0x7ffba01f1d80 2024-09-13T16:03:05.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.601+0000 7ffb97e00640 1 -- 172.21.15.70:0/4085959734 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffb98042030 con 0x7ffba01f1d80 2024-09-13T16:03:05.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.602+0000 7ffb97e00640 1 --2- 172.21.15.70:0/4085959734 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ffb7c06ac60 0x7ffb7c06d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.602+0000 7ffb97e00640 1 -- 172.21.15.70:0/4085959734 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ffb980aa1d0 con 0x7ffba01f1d80 2024-09-13T16:03:05.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.602+0000 7ffb9f400640 1 --2- 172.21.15.70:0/4085959734 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ffb7c06ac60 0x7ffb7c06d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.603+0000 7ffb97e00640 1 --2- 172.21.15.70:0/4085959734 >> [v2:172.21.15.107:6809/951062155,v1:172.21.15.107:6811/951062155] conn(0x7ffb7c070b60 0x7ffb7c072f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.603+0000 7ffb97e00640 1 -- 172.21.15.70:0/4085959734 --> [v2:172.21.15.107:6809/951062155,v1:172.21.15.107:6811/951062155] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffb7c073630 con 0x7ffb7c070b60 2024-09-13T16:03:05.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.603+0000 7ffb97e00640 1 -- 172.21.15.70:0/4085959734 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb980ac7b0 con 0x7ffba01f1d80 2024-09-13T16:03:05.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.603+0000 7ffb96a00640 1 --2- 172.21.15.70:0/4085959734 >> [v2:172.21.15.107:6809/951062155,v1:172.21.15.107:6811/951062155] conn(0x7ffb7c070b60 0x7ffb7c072f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.603+0000 7ffb9f400640 1 --2- 172.21.15.70:0/4085959734 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ffb7c06ac60 0x7ffb7c06d120 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ffb900017a0 tx=0x7ffb90001470 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:05.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.604+0000 7ffb96a00640 1 --2- 172.21.15.70:0/4085959734 >> [v2:172.21.15.107:6809/951062155,v1:172.21.15.107:6811/951062155] conn(0x7ffb7c070b60 0x7ffb7c072f80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:05.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.605+0000 7ffb97e00640 1 -- 172.21.15.70:0/4085959734 <== osd.5 v2:172.21.15.107:6809/951062155 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ffb7c073630 con 0x7ffb7c070b60 2024-09-13T16:03:05.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.617+0000 7ffba5200640 1 -- 172.21.15.70:0/4085959734 --> [v2:172.21.15.107:6809/951062155,v1:172.21.15.107:6811/951062155] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffba00b21e0 con 0x7ffb7c070b60 2024-09-13T16:03:05.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.618+0000 7ffb97e00640 1 -- 172.21.15.70:0/4085959734 <== osd.5 v2:172.21.15.107:6809/951062155 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffb880019f0 con 0x7ffb7c070b60 2024-09-13T16:03:05.619 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-13T16:03:05.619 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T16:03:05.619 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-13T16:03:05.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.618+0000 7ffba5200640 1 -- 172.21.15.70:0/4085959734 >> [v2:172.21.15.107:6809/951062155,v1:172.21.15.107:6811/951062155] conn(0x7ffb7c070b60 msgr2=0x7ffb7c072f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.618+0000 7ffba5200640 1 --2- 172.21.15.70:0/4085959734 >> [v2:172.21.15.107:6809/951062155,v1:172.21.15.107:6811/951062155] conn(0x7ffb7c070b60 0x7ffb7c072f80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.618+0000 7ffba5200640 1 -- 172.21.15.70:0/4085959734 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ffb7c06ac60 msgr2=0x7ffb7c06d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.618+0000 7ffba5200640 1 --2- 172.21.15.70:0/4085959734 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7ffb7c06ac60 0x7ffb7c06d120 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ffb900017a0 tx=0x7ffb90001470 comp rx=0 tx=0).stop 2024-09-13T16:03:05.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.618+0000 7ffba5200640 1 -- 172.21.15.70:0/4085959734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffba01f1d80 msgr2=0x7ffba00cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.618+0000 7ffba5200640 1 --2- 172.21.15.70:0/4085959734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffba01f1d80 0x7ffba00cd220 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ffb98033040 tx=0x7ffb98009750 comp rx=0 tx=0).stop 2024-09-13T16:03:05.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.618+0000 7ffb9fe00640 1 -- 172.21.15.70:0/4085959734 reap_dead start 2024-09-13T16:03:05.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.618+0000 7ffba5200640 1 -- 172.21.15.70:0/4085959734 shutdown_connections 2024-09-13T16:03:05.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.618+0000 7ffba5200640 1 -- 172.21.15.70:0/4085959734 >> 172.21.15.70:0/4085959734 conn(0x7ffba00b0330 msgr2=0x7ffba00c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:05.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.618+0000 7ffba5200640 1 -- 172.21.15.70:0/4085959734 shutdown_connections 2024-09-13T16:03:05.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.618+0000 7ffba5200640 1 -- 172.21.15.70:0/4085959734 wait complete. 2024-09-13T16:03:05.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T16:03:05.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.785+0000 7fedd7000640 1 Processor -- start 2024-09-13T16:03:05.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.785+0000 7fedd7000640 1 -- start start 2024-09-13T16:03:05.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.786+0000 7fedd7000640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fedd0153b20 0x7fedd00b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.786+0000 7fedd7000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fedd0159a80 0x7fedd00b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.786+0000 7fedd7000640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd0153f00 con 0x7fedd00b2410 2024-09-13T16:03:05.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.786+0000 7fedd7000640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd00ce600 con 0x7fedd0153b20 2024-09-13T16:03:05.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.786+0000 7fedd7000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd0070f90 con 0x7fedd0159a80 2024-09-13T16:03:05.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.787+0000 7fedcfe00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fedd0153b20 0x7fedd00b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.787+0000 7fedd5000640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fedd00b2410 0x7fedd006f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50808/0 (socket says 172.21.15.70:50808) 2024-09-13T16:03:05.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.787+0000 7fedcfe00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fedd0153b20 0x7fedd00b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49326/0 (socket says 172.21.15.70:49326) 2024-09-13T16:03:05.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.787+0000 7fedd5000640 1 -- 172.21.15.70:0/1153252112 learned_addr learned my addr 172.21.15.70:0/1153252112 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:03:05.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.787+0000 7fedcf400640 1 --2- 172.21.15.70:0/1153252112 >> v2:172.21.15.107:3300/0 conn(0x7fedd0159a80 0x7fedd00b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.787+0000 7fedcfe00640 1 -- 172.21.15.70:0/1153252112 >> v2:172.21.15.107:3300/0 conn(0x7fedd0159a80 msgr2=0x7fedd00b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:05.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.787+0000 7fedcfe00640 1 --2- 172.21.15.70:0/1153252112 >> v2:172.21.15.107:3300/0 conn(0x7fedd0159a80 0x7fedd00b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.787+0000 7fedcfe00640 1 -- 172.21.15.70:0/1153252112 >> v1:172.21.15.70:6789/0 conn(0x7fedd00b2410 legacy=0x7fedd006f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.787+0000 7fedcea00640 1 -- 172.21.15.70:0/1153252112 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691907644 0 0) 0x7fedd0153f00 con 0x7fedd00b2410 2024-09-13T16:03:05.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.787+0000 7fedcfe00640 1 -- 172.21.15.70:0/1153252112 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd00b1a40 con 0x7fedd0153b20 2024-09-13T16:03:05.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.788+0000 7fedcfe00640 1 --2- 172.21.15.70:0/1153252112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedd0153b20 0x7fedd00b3990 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fedd00707d0 tx=0x7fedc002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e17fccc994c6b31 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:05.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.788+0000 7fedcea00640 1 -- 172.21.15.70:0/1153252112 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0032440 con 0x7fedd0153b20 2024-09-13T16:03:05.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.788+0000 7fedcea00640 1 -- 172.21.15.70:0/1153252112 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc00325a0 con 0x7fedd0153b20 2024-09-13T16:03:05.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.788+0000 7fedcea00640 1 -- 172.21.15.70:0/1153252112 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0032930 con 0x7fedd0153b20 2024-09-13T16:03:05.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.789+0000 7fedd7000640 1 -- 172.21.15.70:0/1153252112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedd0153b20 msgr2=0x7fedd00b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.789+0000 7fedd7000640 1 --2- 172.21.15.70:0/1153252112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedd0153b20 0x7fedd00b3990 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fedd00707d0 tx=0x7fedc002a1e0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.789+0000 7fedd7000640 1 -- 172.21.15.70:0/1153252112 shutdown_connections 2024-09-13T16:03:05.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.789+0000 7fedd7000640 1 --2- 172.21.15.70:0/1153252112 >> v2:172.21.15.107:3300/0 conn(0x7fedd0159a80 0x7fedd00b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.789+0000 7fedd7000640 1 --2- 172.21.15.70:0/1153252112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedd0153b20 0x7fedd00b3990 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.789+0000 7fedd7000640 1 -- 172.21.15.70:0/1153252112 >> 172.21.15.70:0/1153252112 conn(0x7fedd00b0510 msgr2=0x7fedd00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:05.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.789+0000 7fedd7000640 1 -- 172.21.15.70:0/1153252112 shutdown_connections 2024-09-13T16:03:05.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.789+0000 7fedd7000640 1 -- 172.21.15.70:0/1153252112 wait complete. 2024-09-13T16:03:05.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.790+0000 7fedd7000640 1 Processor -- start 2024-09-13T16:03:05.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.791+0000 7fedd7000640 1 -- start start 2024-09-13T16:03:05.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.791+0000 7fedd7000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedd00b2410 0x7fedd015c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.791+0000 7fedd7000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedd0153b20 0x7fedd01528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.791+0000 7fedd7000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedd0159a80 0x7fedd01540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.792+0000 7fedd7000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd015ba40 con 0x7fedd0153b20 2024-09-13T16:03:05.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.792+0000 7fedd7000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd0167af0 con 0x7fedd00b2410 2024-09-13T16:03:05.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.792+0000 7fedd7000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd0167dd0 con 0x7fedd0159a80 2024-09-13T16:03:05.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.792+0000 7fedcf400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedd0153b20 0x7fedd01528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.792+0000 7fedcf400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedd0153b20 0x7fedd01528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49338/0 (socket says 172.21.15.70:49338) 2024-09-13T16:03:05.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.792+0000 7fedcf400640 1 -- 172.21.15.70:0/699613061 learned_addr learned my addr 172.21.15.70:0/699613061 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:05.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.792+0000 7fedcfe00640 1 --2- 172.21.15.70:0/699613061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedd00b2410 0x7fedd015c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.792+0000 7fedd5000640 1 --2- 172.21.15.70:0/699613061 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedd0159a80 0x7fedd01540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.792+0000 7fedcf400640 1 -- 172.21.15.70:0/699613061 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedd0159a80 msgr2=0x7fedd01540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.792+0000 7fedcf400640 1 --2- 172.21.15.70:0/699613061 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedd0159a80 0x7fedd01540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.792+0000 7fedcf400640 1 -- 172.21.15.70:0/699613061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedd00b2410 msgr2=0x7fedd015c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.792+0000 7fedcf400640 1 --2- 172.21.15.70:0/699613061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedd00b2410 0x7fedd015c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.792+0000 7fedcf400640 1 -- 172.21.15.70:0/699613061 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc0009400 con 0x7fedd0153b20 2024-09-13T16:03:05.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.792+0000 7fedd5000640 1 --2- 172.21.15.70:0/699613061 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedd0159a80 0x7fedd01540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:03:05.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.792+0000 7fedcf400640 1 --2- 172.21.15.70:0/699613061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedd0153b20 0x7fedd01528f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00e9b0 tx=0x7fedbc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:05.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.793+0000 7fedc7e00640 1 -- 172.21.15.70:0/699613061 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc009670 con 0x7fedd0153b20 2024-09-13T16:03:05.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.793+0000 7fedc7e00640 1 -- 172.21.15.70:0/699613061 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedbc00c9a0 con 0x7fedd0153b20 2024-09-13T16:03:05.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.793+0000 7fedc7e00640 1 -- 172.21.15.70:0/699613061 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc00cd50 con 0x7fedd0153b20 2024-09-13T16:03:05.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.793+0000 7fedd7000640 1 -- 172.21.15.70:0/699613061 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd01680b0 con 0x7fedd0153b20 2024-09-13T16:03:05.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.793+0000 7fedd7000640 1 -- 172.21.15.70:0/699613061 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd015bf70 con 0x7fedd0153b20 2024-09-13T16:03:05.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.794+0000 7fedd7000640 1 -- 172.21.15.70:0/699613061 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd015c130 con 0x7fedd0153b20 2024-09-13T16:03:05.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.795+0000 7fedc7e00640 1 -- 172.21.15.70:0/699613061 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fedbc013470 con 0x7fedd0153b20 2024-09-13T16:03:05.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.795+0000 7fedc7e00640 1 --2- 172.21.15.70:0/699613061 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fedb006ac00 0x7fedb006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.796+0000 7fedc7e00640 1 -- 172.21.15.70:0/699613061 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fedbc089300 con 0x7fedd0153b20 2024-09-13T16:03:05.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.796+0000 7fedcfe00640 1 --2- 172.21.15.70:0/699613061 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fedb006ac00 0x7fedb006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.796+0000 7fedcfe00640 1 --2- 172.21.15.70:0/699613061 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fedb006ac00 0x7fedb006d0c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fedc0034000 tx=0x7fedc002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:05.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.800+0000 7fedc7e00640 1 -- 172.21.15.70:0/699613061 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fedbc054780 con 0x7fedd0153b20 2024-09-13T16:03:05.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.970+0000 7fedd7000640 1 -- 172.21.15.70:0/699613061 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fedd015a7b0 con 0x7fedb006ac00 2024-09-13T16:03:05.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.971+0000 7fedc7e00640 1 -- 172.21.15.70:0/699613061 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fedc0006e10 con 0x7fedb006ac00 2024-09-13T16:03:05.972 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T16:03:05.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.973+0000 7fedd7000640 1 -- 172.21.15.70:0/699613061 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fedb006ac00 msgr2=0x7fedb006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.973+0000 7fedd7000640 1 --2- 172.21.15.70:0/699613061 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fedb006ac00 0x7fedb006d0c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fedc0034000 tx=0x7fedc002e000 comp rx=0 tx=0).stop 2024-09-13T16:03:05.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.973+0000 7fedd7000640 1 -- 172.21.15.70:0/699613061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedd0153b20 msgr2=0x7fedd01528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.973+0000 7fedd7000640 1 --2- 172.21.15.70:0/699613061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedd0153b20 0x7fedd01528f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00e9b0 tx=0x7fedbc00ee70 comp rx=0 tx=0).stop 2024-09-13T16:03:05.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.973+0000 7fedd7000640 1 -- 172.21.15.70:0/699613061 shutdown_connections 2024-09-13T16:03:05.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.973+0000 7fedd7000640 1 --2- 172.21.15.70:0/699613061 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedd0159a80 0x7fedd01540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.973+0000 7fedd7000640 1 --2- 172.21.15.70:0/699613061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedd0153b20 0x7fedd01528f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.973+0000 7fedd7000640 1 --2- 172.21.15.70:0/699613061 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fedb006ac00 0x7fedb006d0c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.973+0000 7fedd7000640 1 --2- 172.21.15.70:0/699613061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedd00b2410 0x7fedd015c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.973+0000 7fedd7000640 1 -- 172.21.15.70:0/699613061 >> 172.21.15.70:0/699613061 conn(0x7fedd00b0510 msgr2=0x7fedd00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:05.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.973+0000 7fedd7000640 1 -- 172.21.15.70:0/699613061 shutdown_connections 2024-09-13T16:03:05.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:05.973+0000 7fedd7000640 1 -- 172.21.15.70:0/699613061 wait complete. 2024-09-13T16:03:05.989 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T16:03:05.989 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T16:03:06.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.144+0000 7f4426800640 1 Processor -- start 2024-09-13T16:03:06.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.144+0000 7f4426800640 1 -- start start 2024-09-13T16:03:06.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.145+0000 7f4426800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f44201596d0 0x7f4420070bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.145+0000 7f4426800640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4420070030 con 0x7f44201592f0 2024-09-13T16:03:06.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.145+0000 7f4426800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4420071110 con 0x7f44200adeb0 2024-09-13T16:03:06.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.145+0000 7f4426800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4420071870 con 0x7f44201596d0 2024-09-13T16:03:06.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.145+0000 7f441f400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f44201592f0 0x7f44200b1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50816/0 (socket says 172.21.15.70:50816) 2024-09-13T16:03:06.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.145+0000 7f441f400640 1 -- 172.21.15.70:0/2904837129 learned_addr learned my addr 172.21.15.70:0/2904837129 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:03:06.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.146+0000 7f441ea00640 1 -- 172.21.15.70:0/2904837129 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947412085 0 0) 0x7f4420070030 con 0x7f44201592f0 2024-09-13T16:03:06.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.146+0000 7f441ea00640 1 -- 172.21.15.70:0/2904837129 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4404003520 con 0x7f44201592f0 2024-09-13T16:03:06.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.146+0000 7f441fe00640 1 --2- 172.21.15.70:0/2904837129 >> v2:172.21.15.107:3300/0 conn(0x7f44201596d0 0x7f4420070bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.146+0000 7f441ea00640 1 -- 172.21.15.70:0/2904837129 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 705317906 0 0) 0x7f4404003520 con 0x7f44201592f0 2024-09-13T16:03:06.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.146+0000 7f441ea00640 1 -- 172.21.15.70:0/2904837129 >> v2:172.21.15.107:3300/0 conn(0x7f44201596d0 msgr2=0x7f4420070bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:06.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.146+0000 7f441ea00640 1 --2- 172.21.15.70:0/2904837129 >> v2:172.21.15.107:3300/0 conn(0x7f44201596d0 0x7f4420070bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.146+0000 7f441ea00640 1 -- 172.21.15.70:0/2904837129 >> v1:172.21.15.107:6789/0 conn(0x7f44200adeb0 legacy=0x7f44200704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.146+0000 7f441ea00640 1 -- 172.21.15.70:0/2904837129 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442006f700 con 0x7f44201592f0 2024-09-13T16:03:06.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.146+0000 7f441ea00640 1 -- 172.21.15.70:0/2904837129 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f4410001670 con 0x7f44201592f0 2024-09-13T16:03:06.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.146+0000 7f441ea00640 1 -- 172.21.15.70:0/2904837129 >> v1:172.21.15.70:6789/0 conn(0x7f44201592f0 legacy=0x7f44200b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.146+0000 7f441ea00640 1 --2- 172.21.15.70:0/2904837129 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4404003970 0x7f4404003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.146+0000 7f441ea00640 1 --2- 172.21.15.70:0/2904837129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44040047c0 0x7f4404004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.146+0000 7f441ea00640 1 --2- 172.21.15.70:0/2904837129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4404005180 0x7f440400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.146+0000 7f441ea00640 1 -- 172.21.15.70:0/2904837129 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4420071870 con 0x7f44040047c0 2024-09-13T16:03:06.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.146+0000 7f441ea00640 1 -- 172.21.15.70:0/2904837129 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440400c020 con 0x7f4404005180 2024-09-13T16:03:06.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.146+0000 7f441ea00640 1 -- 172.21.15.70:0/2904837129 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440400c1e0 con 0x7f4404003970 2024-09-13T16:03:06.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.147+0000 7f4416a00640 1 --2- 172.21.15.70:0/2904837129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44040047c0 0x7f4404004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.147+0000 7f441f400640 1 --2- 172.21.15.70:0/2904837129 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4404003970 0x7f4404003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.147+0000 7f441fe00640 1 --2- 172.21.15.70:0/2904837129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4404005180 0x7f440400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.147+0000 7f4416a00640 1 -- 172.21.15.70:0/2904837129 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4404003970 msgr2=0x7f4404003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:06.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.147+0000 7f4416a00640 1 --2- 172.21.15.70:0/2904837129 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4404003970 0x7f4404003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.147+0000 7f4416a00640 1 -- 172.21.15.70:0/2904837129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4404005180 msgr2=0x7f440400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:06.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.147+0000 7f4416a00640 1 --2- 172.21.15.70:0/2904837129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4404005180 0x7f440400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.147+0000 7f4416a00640 1 -- 172.21.15.70:0/2904837129 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4404003520 con 0x7f44040047c0 2024-09-13T16:03:06.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.147+0000 7f441fe00640 1 -- 172.21.15.70:0/2904837129 reap_dead start 2024-09-13T16:03:06.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.148+0000 7f4416a00640 1 --2- 172.21.15.70:0/2904837129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44040047c0 0x7f4404004c40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4408001720 tx=0x7f44040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69cbe4146aa82031 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:06.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.148+0000 7f441ea00640 1 -- 172.21.15.70:0/2904837129 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44080052d0 con 0x7f44040047c0 2024-09-13T16:03:06.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.148+0000 7f441ea00640 1 -- 172.21.15.70:0/2904837129 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4408005430 con 0x7f44040047c0 2024-09-13T16:03:06.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.148+0000 7f441ea00640 1 -- 172.21.15.70:0/2904837129 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440802ab90 con 0x7f44040047c0 2024-09-13T16:03:06.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.149+0000 7f4426800640 1 -- 172.21.15.70:0/2904837129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44040047c0 msgr2=0x7f4404004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.149+0000 7f4426800640 1 --2- 172.21.15.70:0/2904837129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44040047c0 0x7f4404004c40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4408001720 tx=0x7f44040057f0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.149+0000 7f4426800640 1 -- 172.21.15.70:0/2904837129 shutdown_connections 2024-09-13T16:03:06.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.149+0000 7f4426800640 1 --2- 172.21.15.70:0/2904837129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44040047c0 0x7f4404004c40 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.149+0000 7f4426800640 1 -- 172.21.15.70:0/2904837129 >> 172.21.15.70:0/2904837129 conn(0x7f44200b0510 msgr2=0x7f44200b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:06.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.149+0000 7f4426800640 1 -- 172.21.15.70:0/2904837129 shutdown_connections 2024-09-13T16:03:06.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.149+0000 7f4426800640 1 -- 172.21.15.70:0/2904837129 wait complete. 2024-09-13T16:03:06.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.151+0000 7f4426800640 1 Processor -- start 2024-09-13T16:03:06.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.151+0000 7f4426800640 1 -- start start 2024-09-13T16:03:06.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.152+0000 7f4426800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44040047c0 0x7f4420157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.152+0000 7f4426800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f442014a4a0 0x7f4420143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.152+0000 7f4426800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4420149ee0 0x7f442015a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.152+0000 7f4426800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44201582d0 con 0x7f442014a4a0 2024-09-13T16:03:06.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.152+0000 7f4426800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44201444b0 con 0x7f4420149ee0 2024-09-13T16:03:06.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.152+0000 7f4426800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4420156cf0 con 0x7f44040047c0 2024-09-13T16:03:06.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.152+0000 7f4416a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f442014a4a0 0x7f4420143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.152+0000 7f4416a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f442014a4a0 0x7f4420143f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49350/0 (socket says 172.21.15.70:49350) 2024-09-13T16:03:06.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.152+0000 7f4416a00640 1 -- 172.21.15.70:0/1010351882 learned_addr learned my addr 172.21.15.70:0/1010351882 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:06.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.152+0000 7f441f400640 1 --2- 172.21.15.70:0/1010351882 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44040047c0 0x7f4420157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.152+0000 7f441fe00640 1 --2- 172.21.15.70:0/1010351882 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4420149ee0 0x7f442015a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.152+0000 7f4416a00640 1 -- 172.21.15.70:0/1010351882 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44040047c0 msgr2=0x7f4420157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.152+0000 7f4416a00640 1 --2- 172.21.15.70:0/1010351882 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44040047c0 0x7f4420157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.152+0000 7f4416a00640 1 -- 172.21.15.70:0/1010351882 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4420149ee0 msgr2=0x7f442015a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.152+0000 7f4416a00640 1 --2- 172.21.15.70:0/1010351882 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4420149ee0 0x7f442015a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.152+0000 7f4416a00640 1 -- 172.21.15.70:0/1010351882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4420156fd0 con 0x7f442014a4a0 2024-09-13T16:03:06.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.153+0000 7f4416a00640 1 --2- 172.21.15.70:0/1010351882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f442014a4a0 0x7f4420143f70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f440802a470 tx=0x7f4408001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:06.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.153+0000 7f4417e00640 1 -- 172.21.15.70:0/1010351882 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408007a30 con 0x7f442014a4a0 2024-09-13T16:03:06.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.153+0000 7f4417e00640 1 -- 172.21.15.70:0/1010351882 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44080073f0 con 0x7f442014a4a0 2024-09-13T16:03:06.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.153+0000 7f4417e00640 1 -- 172.21.15.70:0/1010351882 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44080067d0 con 0x7f442014a4a0 2024-09-13T16:03:06.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.153+0000 7f4426800640 1 -- 172.21.15.70:0/1010351882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44201572b0 con 0x7f442014a4a0 2024-09-13T16:03:06.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.153+0000 7f4426800640 1 -- 172.21.15.70:0/1010351882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4420157870 con 0x7f442014a4a0 2024-09-13T16:03:06.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.154+0000 7f4426800640 1 -- 172.21.15.70:0/1010351882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f442006fcc0 con 0x7f442014a4a0 2024-09-13T16:03:06.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.155+0000 7f4417e00640 1 -- 172.21.15.70:0/1010351882 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4408006930 con 0x7f442014a4a0 2024-09-13T16:03:06.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.156+0000 7f4417e00640 1 --2- 172.21.15.70:0/1010351882 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f43fc06ac30 0x7f43fc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.156+0000 7f4417e00640 1 -- 172.21.15.70:0/1010351882 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f44080a8830 con 0x7f442014a4a0 2024-09-13T16:03:06.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.156+0000 7f4417e00640 1 --2- 172.21.15.70:0/1010351882 >> [v2:172.21.15.107:6822/3873935546,v1:172.21.15.107:6825/3873935546] conn(0x7f43fc070b30 0x7f43fc072f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.156+0000 7f4417e00640 1 -- 172.21.15.70:0/1010351882 --> [v2:172.21.15.107:6822/3873935546,v1:172.21.15.107:6825/3873935546] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f43fc073600 con 0x7f43fc070b30 2024-09-13T16:03:06.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.156+0000 7f4417e00640 1 -- 172.21.15.70:0/1010351882 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44080aae10 con 0x7f442014a4a0 2024-09-13T16:03:06.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.156+0000 7f441f400640 1 --2- 172.21.15.70:0/1010351882 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f43fc06ac30 0x7f43fc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.157+0000 7f441fe00640 1 --2- 172.21.15.70:0/1010351882 >> [v2:172.21.15.107:6822/3873935546,v1:172.21.15.107:6825/3873935546] conn(0x7f43fc070b30 0x7f43fc072f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.157+0000 7f441f400640 1 --2- 172.21.15.70:0/1010351882 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f43fc06ac30 0x7f43fc06d0f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4410001c90 tx=0x7f4410000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:06.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.157+0000 7f441fe00640 1 --2- 172.21.15.70:0/1010351882 >> [v2:172.21.15.107:6822/3873935546,v1:172.21.15.107:6825/3873935546] conn(0x7f43fc070b30 0x7f43fc072f50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:06.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.158+0000 7f4417e00640 1 -- 172.21.15.70:0/1010351882 <== osd.6 v2:172.21.15.107:6822/3873935546 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f43fc073600 con 0x7f43fc070b30 2024-09-13T16:03:06.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.170+0000 7f4426800640 1 -- 172.21.15.70:0/1010351882 --> [v2:172.21.15.107:6822/3873935546,v1:172.21.15.107:6825/3873935546] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4420157a00 con 0x7f43fc070b30 2024-09-13T16:03:06.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.171+0000 7f4417e00640 1 -- 172.21.15.70:0/1010351882 <== osd.6 v2:172.21.15.107:6822/3873935546 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4420157a00 con 0x7f43fc070b30 2024-09-13T16:03:06.172 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-13T16:03:06.173 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T16:03:06.173 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-13T16:03:06.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.171+0000 7f4426800640 1 -- 172.21.15.70:0/1010351882 >> [v2:172.21.15.107:6822/3873935546,v1:172.21.15.107:6825/3873935546] conn(0x7f43fc070b30 msgr2=0x7f43fc072f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.171+0000 7f4426800640 1 --2- 172.21.15.70:0/1010351882 >> [v2:172.21.15.107:6822/3873935546,v1:172.21.15.107:6825/3873935546] conn(0x7f43fc070b30 0x7f43fc072f50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.172+0000 7f4426800640 1 -- 172.21.15.70:0/1010351882 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f43fc06ac30 msgr2=0x7f43fc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.172+0000 7f4426800640 1 --2- 172.21.15.70:0/1010351882 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f43fc06ac30 0x7f43fc06d0f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4410001c90 tx=0x7f4410000ed0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.172+0000 7f4426800640 1 -- 172.21.15.70:0/1010351882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f442014a4a0 msgr2=0x7f4420143f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.172+0000 7f4426800640 1 --2- 172.21.15.70:0/1010351882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f442014a4a0 0x7f4420143f70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f440802a470 tx=0x7f4408001120 comp rx=0 tx=0).stop 2024-09-13T16:03:06.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.172+0000 7f441fe00640 1 -- 172.21.15.70:0/1010351882 reap_dead start 2024-09-13T16:03:06.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.172+0000 7f4426800640 1 -- 172.21.15.70:0/1010351882 shutdown_connections 2024-09-13T16:03:06.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.172+0000 7f4426800640 1 -- 172.21.15.70:0/1010351882 >> 172.21.15.70:0/1010351882 conn(0x7f44200b0510 msgr2=0x7f44200ad720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:06.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.172+0000 7f4426800640 1 -- 172.21.15.70:0/1010351882 shutdown_connections 2024-09-13T16:03:06.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.172+0000 7f4426800640 1 -- 172.21.15.70:0/1010351882 wait complete. 2024-09-13T16:03:06.187 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T16:03:06.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.340+0000 7fb8ac600640 1 Processor -- start 2024-09-13T16:03:06.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.340+0000 7fb8ac600640 1 -- start start 2024-09-13T16:03:06.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.342+0000 7fb8ac600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb8a4153b20 0x7fb8a40b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.342+0000 7fb8ac600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8a406f660 0x7fb8a406fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.342+0000 7fb8ac600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a4153f00 con 0x7fb8a4159a80 2024-09-13T16:03:06.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.342+0000 7fb8ac600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a40ce600 con 0x7fb8a4153b20 2024-09-13T16:03:06.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.342+0000 7fb8ac600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a4070f90 con 0x7fb8a406f660 2024-09-13T16:03:06.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.342+0000 7fb8a9200640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb8a4159a80 0x7fb8a40b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50822/0 (socket says 172.21.15.70:50822) 2024-09-13T16:03:06.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.342+0000 7fb8a9200640 1 -- 172.21.15.70:0/3066954196 learned_addr learned my addr 172.21.15.70:0/3066954196 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:03:06.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.342+0000 7fb8a9c00640 1 --2- 172.21.15.70:0/3066954196 >> v2:172.21.15.107:3300/0 conn(0x7fb8a4153b20 0x7fb8a40b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.342+0000 7fb8aa600640 1 --2- 172.21.15.70:0/3066954196 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8a406f660 0x7fb8a406fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.342+0000 7fb8a3e00640 1 -- 172.21.15.70:0/3066954196 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550483760 0 0) 0x7fb8a4153f00 con 0x7fb8a4159a80 2024-09-13T16:03:06.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.342+0000 7fb8a3e00640 1 -- 172.21.15.70:0/3066954196 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb88c003520 con 0x7fb8a4159a80 2024-09-13T16:03:06.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.343+0000 7fb8a9c00640 1 -- 172.21.15.70:0/3066954196 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8a406f660 msgr2=0x7fb8a406fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:06.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.343+0000 7fb8a9c00640 1 --2- 172.21.15.70:0/3066954196 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8a406f660 0x7fb8a406fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.343+0000 7fb8a9c00640 1 -- 172.21.15.70:0/3066954196 >> v1:172.21.15.70:6789/0 conn(0x7fb8a4159a80 legacy=0x7fb8a40b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.343+0000 7fb8a9c00640 1 -- 172.21.15.70:0/3066954196 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a40b1a40 con 0x7fb8a4153b20 2024-09-13T16:03:06.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.343+0000 7fb8aa600640 1 --2- 172.21.15.70:0/3066954196 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8a406f660 0x7fb8a406fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:03:06.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.344+0000 7fb8a9c00640 1 --2- 172.21.15.70:0/3066954196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8a4153b20 0x7fb8a40b3990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb8980097d0 tx=0x7fb89802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a03d48c3adf5c491 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:06.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.344+0000 7fb8a3e00640 1 -- 172.21.15.70:0/3066954196 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb898032440 con 0x7fb8a4153b20 2024-09-13T16:03:06.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.344+0000 7fb8a3e00640 1 -- 172.21.15.70:0/3066954196 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8980325a0 con 0x7fb8a4153b20 2024-09-13T16:03:06.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.344+0000 7fb8a3e00640 1 -- 172.21.15.70:0/3066954196 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb898032930 con 0x7fb8a4153b20 2024-09-13T16:03:06.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.345+0000 7fb8ac600640 1 -- 172.21.15.70:0/3066954196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8a4153b20 msgr2=0x7fb8a40b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.345+0000 7fb8ac600640 1 --2- 172.21.15.70:0/3066954196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8a4153b20 0x7fb8a40b3990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb8980097d0 tx=0x7fb89802a1c0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.345+0000 7fb8ac600640 1 -- 172.21.15.70:0/3066954196 shutdown_connections 2024-09-13T16:03:06.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.345+0000 7fb8ac600640 1 --2- 172.21.15.70:0/3066954196 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8a406f660 0x7fb8a406fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.345+0000 7fb8ac600640 1 --2- 172.21.15.70:0/3066954196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8a4153b20 0x7fb8a40b3990 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.345+0000 7fb8ac600640 1 -- 172.21.15.70:0/3066954196 >> 172.21.15.70:0/3066954196 conn(0x7fb8a40b0510 msgr2=0x7fb8a40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:06.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.345+0000 7fb8ac600640 1 -- 172.21.15.70:0/3066954196 shutdown_connections 2024-09-13T16:03:06.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.345+0000 7fb8ac600640 1 -- 172.21.15.70:0/3066954196 wait complete. 2024-09-13T16:03:06.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.346+0000 7fb8ac600640 1 Processor -- start 2024-09-13T16:03:06.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.347+0000 7fb8ac600640 1 -- start start 2024-09-13T16:03:06.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.347+0000 7fb8ac600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8a406f660 0x7fb8a415bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.347+0000 7fb8ac600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8a4153b20 0x7fb8a4151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.348+0000 7fb8ac600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8a4159a80 0x7fb8a414f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.348+0000 7fb8ac600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a415cb40 con 0x7fb8a406f660 2024-09-13T16:03:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.348+0000 7fb8ac600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a4151880 con 0x7fb8a4159a80 2024-09-13T16:03:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.348+0000 7fb8ac600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a415c580 con 0x7fb8a4153b20 2024-09-13T16:03:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.348+0000 7fb8a9c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8a406f660 0x7fb8a415bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.348+0000 7fb8a9c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8a406f660 0x7fb8a415bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49366/0 (socket says 172.21.15.70:49366) 2024-09-13T16:03:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.348+0000 7fb8a9c00640 1 -- 172.21.15.70:0/1606972272 learned_addr learned my addr 172.21.15.70:0/1606972272 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.348+0000 7fb8a9200640 1 --2- 172.21.15.70:0/1606972272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8a4153b20 0x7fb8a4151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.348+0000 7fb8aa600640 1 --2- 172.21.15.70:0/1606972272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8a4159a80 0x7fb8a414f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.348+0000 7fb8a9c00640 1 -- 172.21.15.70:0/1606972272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8a4153b20 msgr2=0x7fb8a4151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.348+0000 7fb8a9c00640 1 --2- 172.21.15.70:0/1606972272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8a4153b20 0x7fb8a4151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.348+0000 7fb8a9c00640 1 -- 172.21.15.70:0/1606972272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8a4159a80 msgr2=0x7fb8a414f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.348+0000 7fb8a9c00640 1 --2- 172.21.15.70:0/1606972272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8a4159a80 0x7fb8a414f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.348+0000 7fb8a9c00640 1 -- 172.21.15.70:0/1606972272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c009a70 con 0x7fb8a406f660 2024-09-13T16:03:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.348+0000 7fb8a9200640 1 --2- 172.21.15.70:0/1606972272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8a4153b20 0x7fb8a4151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:03:06.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.348+0000 7fb8a9c00640 1 --2- 172.21.15.70:0/1606972272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8a406f660 0x7fb8a415bef0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb898035040 tx=0x7fb8980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:06.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.349+0000 7fb8a1600640 1 -- 172.21.15.70:0/1606972272 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89803d8f0 con 0x7fb8a406f660 2024-09-13T16:03:06.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.349+0000 7fb8a1600640 1 -- 172.21.15.70:0/1606972272 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89803da70 con 0x7fb8a406f660 2024-09-13T16:03:06.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.349+0000 7fb8a1600640 1 -- 172.21.15.70:0/1606972272 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89803de20 con 0x7fb8a406f660 2024-09-13T16:03:06.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.349+0000 7fb8ac600640 1 -- 172.21.15.70:0/1606972272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb898009400 con 0x7fb8a406f660 2024-09-13T16:03:06.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.349+0000 7fb8ac600640 1 -- 172.21.15.70:0/1606972272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a4150b40 con 0x7fb8a406f660 2024-09-13T16:03:06.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.350+0000 7fb8ac600640 1 -- 172.21.15.70:0/1606972272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a41509a0 con 0x7fb8a406f660 2024-09-13T16:03:06.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.351+0000 7fb8a1600640 1 -- 172.21.15.70:0/1606972272 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb898039040 con 0x7fb8a406f660 2024-09-13T16:03:06.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.352+0000 7fb8a1600640 1 --2- 172.21.15.70:0/1606972272 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb88406ac00 0x7fb88406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.352+0000 7fb8a1600640 1 -- 172.21.15.70:0/1606972272 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb8980a9b40 con 0x7fb8a406f660 2024-09-13T16:03:06.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.352+0000 7fb8a9200640 1 --2- 172.21.15.70:0/1606972272 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb88406ac00 0x7fb88406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.353+0000 7fb8a9200640 1 --2- 172.21.15.70:0/1606972272 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb88406ac00 0x7fb88406d0c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40ad210 tx=0x7fb890009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:06.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.356+0000 7fb8a1600640 1 -- 172.21.15.70:0/1606972272 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb8a41509a0 con 0x7fb8a406f660 2024-09-13T16:03:06.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.528+0000 7fb8ac600640 1 -- 172.21.15.70:0/1606972272 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8a415a7b0 con 0x7fb88406ac00 2024-09-13T16:03:06.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.529+0000 7fb8a1600640 1 -- 172.21.15.70:0/1606972272 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb890001470 con 0x7fb88406ac00 2024-09-13T16:03:06.530 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T16:03:06.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.531+0000 7fb8ac600640 1 -- 172.21.15.70:0/1606972272 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb88406ac00 msgr2=0x7fb88406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.531+0000 7fb8ac600640 1 --2- 172.21.15.70:0/1606972272 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb88406ac00 0x7fb88406d0c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40ad210 tx=0x7fb890009040 comp rx=0 tx=0).stop 2024-09-13T16:03:06.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.531+0000 7fb8ac600640 1 -- 172.21.15.70:0/1606972272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8a406f660 msgr2=0x7fb8a415bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.531+0000 7fb8ac600640 1 --2- 172.21.15.70:0/1606972272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8a406f660 0x7fb8a415bef0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb898035040 tx=0x7fb8980046c0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.531+0000 7fb8ac600640 1 -- 172.21.15.70:0/1606972272 shutdown_connections 2024-09-13T16:03:06.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.531+0000 7fb8ac600640 1 --2- 172.21.15.70:0/1606972272 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fb88406ac00 0x7fb88406d0c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.531+0000 7fb8ac600640 1 --2- 172.21.15.70:0/1606972272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8a4159a80 0x7fb8a414f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.531+0000 7fb8ac600640 1 --2- 172.21.15.70:0/1606972272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8a4153b20 0x7fb8a4151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.531+0000 7fb8ac600640 1 --2- 172.21.15.70:0/1606972272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8a406f660 0x7fb8a415bef0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.531+0000 7fb8ac600640 1 -- 172.21.15.70:0/1606972272 >> 172.21.15.70:0/1606972272 conn(0x7fb8a40b0510 msgr2=0x7fb8a415d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:06.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.531+0000 7fb8ac600640 1 -- 172.21.15.70:0/1606972272 shutdown_connections 2024-09-13T16:03:06.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.531+0000 7fb8ac600640 1 -- 172.21.15.70:0/1606972272 wait complete. 2024-09-13T16:03:06.547 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T16:03:06.547 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T16:03:06.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.702+0000 7f6d5ea00640 1 Processor -- start 2024-09-13T16:03:06.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.702+0000 7f6d5ea00640 1 -- start start 2024-09-13T16:03:06.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.703+0000 7f6d5ea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6d5806cd60 0x7f6d580b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.703+0000 7f6d5ea00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6d580cd870 0x7f6d580cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.703+0000 7f6d5ea00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d58151a20 con 0x7f6d5815b770 2024-09-13T16:03:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.703+0000 7f6d5ea00640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d580cc430 con 0x7f6d580cd870 2024-09-13T16:03:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.703+0000 7f6d5ea00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d580b1bb0 con 0x7f6d5806cd60 2024-09-13T16:03:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.704+0000 7f6d5ca00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6d580cd870 0x7f6d580cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.704+0000 7f6d5ca00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6d580cd870 0x7f6d580cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49368/0 (socket says 172.21.15.70:49368) 2024-09-13T16:03:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.704+0000 7f6d5ca00640 1 -- 172.21.15.70:0/3936017499 learned_addr learned my addr 172.21.15.70:0/3936017499 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.704+0000 7f6d57e00640 1 --2- 172.21.15.70:0/3936017499 >> v2:172.21.15.107:3300/0 conn(0x7f6d5806cd60 0x7f6d580b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.704+0000 7f6d5ca00640 1 -- 172.21.15.70:0/3936017499 >> v2:172.21.15.107:3300/0 conn(0x7f6d5806cd60 msgr2=0x7f6d580b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.704+0000 7f6d5ca00640 1 --2- 172.21.15.70:0/3936017499 >> v2:172.21.15.107:3300/0 conn(0x7f6d5806cd60 0x7f6d580b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.704+0000 7f6d5ca00640 1 -- 172.21.15.70:0/3936017499 >> v1:172.21.15.107:6789/0 conn(0x7f6d5815b770 legacy=0x7f6d580cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.704+0000 7f6d5ca00640 1 -- 172.21.15.70:0/3936017499 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d580b1e70 con 0x7f6d580cd870 2024-09-13T16:03:06.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.705+0000 7f6d5ca00640 1 --2- 172.21.15.70:0/3936017499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d580cd870 0x7f6d580cdc80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6d580b15b0 tx=0x7f6d5002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971a1983089bcf67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:06.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.705+0000 7f6d57400640 1 -- 172.21.15.70:0/3936017499 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50031600 con 0x7f6d580cd870 2024-09-13T16:03:06.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.706+0000 7f6d57400640 1 -- 172.21.15.70:0/3936017499 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5002d050 con 0x7f6d580cd870 2024-09-13T16:03:06.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.706+0000 7f6d57400640 1 -- 172.21.15.70:0/3936017499 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50031980 con 0x7f6d580cd870 2024-09-13T16:03:06.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.706+0000 7f6d5ea00640 1 -- 172.21.15.70:0/3936017499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d580cd870 msgr2=0x7f6d580cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.706+0000 7f6d5ea00640 1 --2- 172.21.15.70:0/3936017499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d580cd870 0x7f6d580cdc80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6d580b15b0 tx=0x7f6d5002a730 comp rx=0 tx=0).stop 2024-09-13T16:03:06.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.706+0000 7f6d5ea00640 1 -- 172.21.15.70:0/3936017499 shutdown_connections 2024-09-13T16:03:06.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.706+0000 7f6d5ea00640 1 --2- 172.21.15.70:0/3936017499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d580cd870 0x7f6d580cdc80 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.706+0000 7f6d5ea00640 1 --2- 172.21.15.70:0/3936017499 >> v2:172.21.15.107:3300/0 conn(0x7f6d5806cd60 0x7f6d580b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.706+0000 7f6d5ea00640 1 -- 172.21.15.70:0/3936017499 >> 172.21.15.70:0/3936017499 conn(0x7f6d580b0510 msgr2=0x7f6d580b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:06.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.706+0000 7f6d5ea00640 1 -- 172.21.15.70:0/3936017499 shutdown_connections 2024-09-13T16:03:06.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.706+0000 7f6d5ea00640 1 -- 172.21.15.70:0/3936017499 wait complete. 2024-09-13T16:03:06.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.708+0000 7f6d5ea00640 1 Processor -- start 2024-09-13T16:03:06.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.708+0000 7f6d5ea00640 1 -- start start 2024-09-13T16:03:06.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.709+0000 7f6d5ea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5806cd60 0x7f6d58070120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.709+0000 7f6d5ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d580cd870 0x7f6d580c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.709+0000 7f6d5ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d5815b770 0x7f6d5814de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.709+0000 7f6d5ea00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d58070700 con 0x7f6d5806cd60 2024-09-13T16:03:06.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.709+0000 7f6d5ea00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d580709e0 con 0x7f6d580cd870 2024-09-13T16:03:06.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.709+0000 7f6d5ea00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d58070cc0 con 0x7f6d5815b770 2024-09-13T16:03:06.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.709+0000 7f6d57e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5806cd60 0x7f6d58070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.709+0000 7f6d57e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5806cd60 0x7f6d58070120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49382/0 (socket says 172.21.15.70:49382) 2024-09-13T16:03:06.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.709+0000 7f6d57e00640 1 -- 172.21.15.70:0/2021062693 learned_addr learned my addr 172.21.15.70:0/2021062693 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:06.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.709+0000 7f6d4f400640 1 --2- 172.21.15.70:0/2021062693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d580cd870 0x7f6d580c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.709+0000 7f6d5ca00640 1 --2- 172.21.15.70:0/2021062693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d5815b770 0x7f6d5814de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.709+0000 7f6d57e00640 1 -- 172.21.15.70:0/2021062693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d5815b770 msgr2=0x7f6d5814de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.709+0000 7f6d57e00640 1 --2- 172.21.15.70:0/2021062693 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6d5815b770 0x7f6d5814de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.709+0000 7f6d57e00640 1 -- 172.21.15.70:0/2021062693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d580cd870 msgr2=0x7f6d580c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.709+0000 7f6d57e00640 1 --2- 172.21.15.70:0/2021062693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d580cd870 0x7f6d580c44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.709+0000 7f6d57e00640 1 -- 172.21.15.70:0/2021062693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d50009b30 con 0x7f6d5806cd60 2024-09-13T16:03:06.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.710+0000 7f6d57e00640 1 --2- 172.21.15.70:0/2021062693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5806cd60 0x7f6d58070120 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800d800 tx=0x7f6d4800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:06.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.710+0000 7f6d54c00640 1 -- 172.21.15.70:0/2021062693 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4800b6c0 con 0x7f6d5806cd60 2024-09-13T16:03:06.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.710+0000 7f6d54c00640 1 -- 172.21.15.70:0/2021062693 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4800b840 con 0x7f6d5806cd60 2024-09-13T16:03:06.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.710+0000 7f6d54c00640 1 -- 172.21.15.70:0/2021062693 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4800bbf0 con 0x7f6d5806cd60 2024-09-13T16:03:06.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.710+0000 7f6d5ea00640 1 -- 172.21.15.70:0/2021062693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d58070fa0 con 0x7f6d5806cd60 2024-09-13T16:03:06.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.710+0000 7f6d5ea00640 1 -- 172.21.15.70:0/2021062693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d580c4a20 con 0x7f6d5806cd60 2024-09-13T16:03:06.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.711+0000 7f6d5ea00640 1 -- 172.21.15.70:0/2021062693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d580ce1c0 con 0x7f6d5806cd60 2024-09-13T16:03:06.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.712+0000 7f6d54c00640 1 -- 172.21.15.70:0/2021062693 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6d4800bd50 con 0x7f6d5806cd60 2024-09-13T16:03:06.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.713+0000 7f6d54c00640 1 --2- 172.21.15.70:0/2021062693 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6d3406ac00 0x7f6d3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.713+0000 7f6d54c00640 1 -- 172.21.15.70:0/2021062693 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6d48089700 con 0x7f6d5806cd60 2024-09-13T16:03:06.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.713+0000 7f6d4f400640 1 --2- 172.21.15.70:0/2021062693 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6d3406ac00 0x7f6d3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.713+0000 7f6d54c00640 1 --2- 172.21.15.70:0/2021062693 >> [v2:172.21.15.107:6808/2642179308,v1:172.21.15.107:6810/2642179308] conn(0x7f6d34070b00 0x7f6d34072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.713+0000 7f6d54c00640 1 -- 172.21.15.70:0/2021062693 --> [v2:172.21.15.107:6808/2642179308,v1:172.21.15.107:6810/2642179308] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d340735d0 con 0x7f6d34070b00 2024-09-13T16:03:06.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.713+0000 7f6d54c00640 1 -- 172.21.15.70:0/2021062693 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d4808bdc0 con 0x7f6d5806cd60 2024-09-13T16:03:06.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.714+0000 7f6d4f400640 1 --2- 172.21.15.70:0/2021062693 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6d3406ac00 0x7f6d3406d0c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6d5814e760 tx=0x7f6d40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:06.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.714+0000 7f6d5ca00640 1 --2- 172.21.15.70:0/2021062693 >> [v2:172.21.15.107:6808/2642179308,v1:172.21.15.107:6810/2642179308] conn(0x7f6d34070b00 0x7f6d34072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.714+0000 7f6d5ca00640 1 --2- 172.21.15.70:0/2021062693 >> [v2:172.21.15.107:6808/2642179308,v1:172.21.15.107:6810/2642179308] conn(0x7f6d34070b00 0x7f6d34072f20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:06.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.715+0000 7f6d54c00640 1 -- 172.21.15.70:0/2021062693 <== osd.7 v2:172.21.15.107:6808/2642179308 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6d340735d0 con 0x7f6d34070b00 2024-09-13T16:03:06.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.728+0000 7f6d5ea00640 1 -- 172.21.15.70:0/2021062693 --> [v2:172.21.15.107:6808/2642179308,v1:172.21.15.107:6810/2642179308] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6d580b2430 con 0x7f6d34070b00 2024-09-13T16:03:06.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.729+0000 7f6d54c00640 1 -- 172.21.15.70:0/2021062693 <== osd.7 v2:172.21.15.107:6808/2642179308 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6d50009510 con 0x7f6d34070b00 2024-09-13T16:03:06.730 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-13T16:03:06.730 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T16:03:06.730 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-13T16:03:06.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.729+0000 7f6d5ea00640 1 -- 172.21.15.70:0/2021062693 >> [v2:172.21.15.107:6808/2642179308,v1:172.21.15.107:6810/2642179308] conn(0x7f6d34070b00 msgr2=0x7f6d34072f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.729+0000 7f6d5ea00640 1 --2- 172.21.15.70:0/2021062693 >> [v2:172.21.15.107:6808/2642179308,v1:172.21.15.107:6810/2642179308] conn(0x7f6d34070b00 0x7f6d34072f20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.729+0000 7f6d5ea00640 1 -- 172.21.15.70:0/2021062693 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6d3406ac00 msgr2=0x7f6d3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.729+0000 7f6d5ea00640 1 --2- 172.21.15.70:0/2021062693 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f6d3406ac00 0x7f6d3406d0c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6d5814e760 tx=0x7f6d40009040 comp rx=0 tx=0).stop 2024-09-13T16:03:06.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.729+0000 7f6d5ea00640 1 -- 172.21.15.70:0/2021062693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5806cd60 msgr2=0x7f6d58070120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.729+0000 7f6d5ea00640 1 --2- 172.21.15.70:0/2021062693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5806cd60 0x7f6d58070120 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800d800 tx=0x7f6d4800dcc0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.729+0000 7f6d5ca00640 1 -- 172.21.15.70:0/2021062693 reap_dead start 2024-09-13T16:03:06.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.729+0000 7f6d5ea00640 1 -- 172.21.15.70:0/2021062693 shutdown_connections 2024-09-13T16:03:06.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.729+0000 7f6d5ea00640 1 -- 172.21.15.70:0/2021062693 >> 172.21.15.70:0/2021062693 conn(0x7f6d580b0510 msgr2=0x7f6d580afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:06.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.730+0000 7f6d5ea00640 1 -- 172.21.15.70:0/2021062693 shutdown_connections 2024-09-13T16:03:06.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.730+0000 7f6d5ea00640 1 -- 172.21.15.70:0/2021062693 wait complete. 2024-09-13T16:03:06.745 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T16:03:06.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.895+0000 7f3256a00640 1 Processor -- start 2024-09-13T16:03:06.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.895+0000 7f3256a00640 1 -- start start 2024-09-13T16:03:06.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.897+0000 7f3256a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3250159210 0x7f32500b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.897+0000 7f3256a00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325015a430 con 0x7f32500b3100 2024-09-13T16:03:06.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.897+0000 7f3256a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32500b3540 con 0x7f325006bdd0 2024-09-13T16:03:06.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.897+0000 7f3256a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32501595f0 con 0x7f3250159210 2024-09-13T16:03:06.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.897+0000 7f324f400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f32500b3100 0x7f325006b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50826/0 (socket says 172.21.15.70:50826) 2024-09-13T16:03:06.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.897+0000 7f324f400640 1 -- 172.21.15.70:0/1958879337 learned_addr learned my addr 172.21.15.70:0/1958879337 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:03:06.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.897+0000 7f324fe00640 1 --2- 172.21.15.70:0/1958879337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3250159210 0x7f32500b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.897+0000 7f324ea00640 1 -- 172.21.15.70:0/1958879337 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112760381 0 0) 0x7f325015a430 con 0x7f32500b3100 2024-09-13T16:03:06.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.897+0000 7f324ea00640 1 -- 172.21.15.70:0/1958879337 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3234003520 con 0x7f32500b3100 2024-09-13T16:03:06.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.897+0000 7f324ea00640 1 -- 172.21.15.70:0/1958879337 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 780930887 0 0) 0x7f3234003520 con 0x7f32500b3100 2024-09-13T16:03:06.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324ea00640 1 -- 172.21.15.70:0/1958879337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3250159210 msgr2=0x7f32500b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:06.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324ea00640 1 --2- 172.21.15.70:0/1958879337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3250159210 0x7f32500b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324ea00640 1 -- 172.21.15.70:0/1958879337 >> v1:172.21.15.107:6789/0 conn(0x7f325006bdd0 legacy=0x7f32500b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324ea00640 1 -- 172.21.15.70:0/1958879337 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32501598b0 con 0x7f32500b3100 2024-09-13T16:03:06.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324ea00640 1 -- 172.21.15.70:0/1958879337 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f323c001670 con 0x7f32500b3100 2024-09-13T16:03:06.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324ea00640 1 -- 172.21.15.70:0/1958879337 >> v1:172.21.15.70:6789/0 conn(0x7f32500b3100 legacy=0x7f325006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324ea00640 1 --2- 172.21.15.70:0/1958879337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3250159210 0x7f32340039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324ea00640 1 --2- 172.21.15.70:0/1958879337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3234003ee0 0x7f32340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324ea00640 1 --2- 172.21.15.70:0/1958879337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3234004d00 0x7f3234005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324ea00640 1 -- 172.21.15.70:0/1958879337 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32501595f0 con 0x7f3234003ee0 2024-09-13T16:03:06.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324ea00640 1 -- 172.21.15.70:0/1958879337 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323400bb40 con 0x7f3234004d00 2024-09-13T16:03:06.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324ea00640 1 -- 172.21.15.70:0/1958879337 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323400df10 con 0x7f3250159210 2024-09-13T16:03:06.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324f400640 1 --2- 172.21.15.70:0/1958879337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3234003ee0 0x7f32340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324fe00640 1 --2- 172.21.15.70:0/1958879337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3250159210 0x7f32340039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f3254a00640 1 --2- 172.21.15.70:0/1958879337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3234004d00 0x7f3234005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324f400640 1 -- 172.21.15.70:0/1958879337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3250159210 msgr2=0x7f32340039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:06.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324f400640 1 --2- 172.21.15.70:0/1958879337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3250159210 0x7f32340039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324f400640 1 -- 172.21.15.70:0/1958879337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3234004d00 msgr2=0x7f3234005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:06.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324f400640 1 --2- 172.21.15.70:0/1958879337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3234004d00 0x7f3234005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.898+0000 7f324f400640 1 -- 172.21.15.70:0/1958879337 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3234003520 con 0x7f3234003ee0 2024-09-13T16:03:06.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.899+0000 7f324f400640 1 --2- 172.21.15.70:0/1958879337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3234003ee0 0x7f32340047c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c160 tx=0x7f32340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a6b222fb59ca1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:06.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.900+0000 7f324ea00640 1 -- 172.21.15.70:0/1958879337 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c005ad0 con 0x7f3234003ee0 2024-09-13T16:03:06.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.900+0000 7f324ea00640 1 -- 172.21.15.70:0/1958879337 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323c02d070 con 0x7f3234003ee0 2024-09-13T16:03:06.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.900+0000 7f324ea00640 1 -- 172.21.15.70:0/1958879337 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c007070 con 0x7f3234003ee0 2024-09-13T16:03:06.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.900+0000 7f3256a00640 1 -- 172.21.15.70:0/1958879337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3234003ee0 msgr2=0x7f32340047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.900+0000 7f3256a00640 1 --2- 172.21.15.70:0/1958879337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3234003ee0 0x7f32340047c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c160 tx=0x7f32340057f0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.900+0000 7f3254a00640 1 -- 172.21.15.70:0/1958879337 reap_dead start 2024-09-13T16:03:06.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.900+0000 7f3256a00640 1 -- 172.21.15.70:0/1958879337 shutdown_connections 2024-09-13T16:03:06.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.900+0000 7f3256a00640 1 -- 172.21.15.70:0/1958879337 >> 172.21.15.70:0/1958879337 conn(0x7f32500b0510 msgr2=0x7f32500b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:06.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.900+0000 7f3256a00640 1 -- 172.21.15.70:0/1958879337 shutdown_connections 2024-09-13T16:03:06.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.900+0000 7f3256a00640 1 -- 172.21.15.70:0/1958879337 wait complete. 2024-09-13T16:03:06.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.902+0000 7f3256a00640 1 Processor -- start 2024-09-13T16:03:06.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.902+0000 7f3256a00640 1 -- start start 2024-09-13T16:03:06.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.903+0000 7f3256a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3234003ee0 0x7f32500a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.903+0000 7f3256a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32500ad2a0 0x7f325013bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.903+0000 7f3256a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f325015b330 0x7f325015b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.903+0000 7f3256a00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325013c4d0 con 0x7f32500ad2a0 2024-09-13T16:03:06.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.903+0000 7f3256a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32500abeb0 con 0x7f325015b330 2024-09-13T16:03:06.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.903+0000 7f3256a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32500a8690 con 0x7f3234003ee0 2024-09-13T16:03:06.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.903+0000 7f324f400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32500ad2a0 0x7f325013bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.903+0000 7f324f400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32500ad2a0 0x7f325013bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49390/0 (socket says 172.21.15.70:49390) 2024-09-13T16:03:06.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.903+0000 7f324f400640 1 -- 172.21.15.70:0/5082026 learned_addr learned my addr 172.21.15.70:0/5082026 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:06.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.903+0000 7f324fe00640 1 --2- 172.21.15.70:0/5082026 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3234003ee0 0x7f32500a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.903+0000 7f3254a00640 1 --2- 172.21.15.70:0/5082026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f325015b330 0x7f325015b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.904+0000 7f324f400640 1 -- 172.21.15.70:0/5082026 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3234003ee0 msgr2=0x7f32500a8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.904+0000 7f324f400640 1 --2- 172.21.15.70:0/5082026 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3234003ee0 0x7f32500a8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.904+0000 7f324f400640 1 -- 172.21.15.70:0/5082026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f325015b330 msgr2=0x7f325015b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:06.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.904+0000 7f324f400640 1 --2- 172.21.15.70:0/5082026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f325015b330 0x7f325015b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:06.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.904+0000 7f324f400640 1 -- 172.21.15.70:0/5082026 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32500ab2e0 con 0x7f32500ad2a0 2024-09-13T16:03:06.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.904+0000 7f324f400640 1 --2- 172.21.15.70:0/5082026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32500ad2a0 0x7f325013bf90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c160 tx=0x7f323c001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:06.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.904+0000 7f3247e00640 1 -- 172.21.15.70:0/5082026 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c004bf0 con 0x7f32500ad2a0 2024-09-13T16:03:06.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.904+0000 7f3247e00640 1 -- 172.21.15.70:0/5082026 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323c004d50 con 0x7f32500ad2a0 2024-09-13T16:03:06.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.904+0000 7f3247e00640 1 -- 172.21.15.70:0/5082026 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c0072b0 con 0x7f32500ad2a0 2024-09-13T16:03:06.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.904+0000 7f3256a00640 1 -- 172.21.15.70:0/5082026 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32500ab580 con 0x7f32500ad2a0 2024-09-13T16:03:06.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.904+0000 7f3256a00640 1 -- 172.21.15.70:0/5082026 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32500abb40 con 0x7f32500ad2a0 2024-09-13T16:03:06.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.906+0000 7f3256a00640 1 -- 172.21.15.70:0/5082026 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3250141d60 con 0x7f32500ad2a0 2024-09-13T16:03:06.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.906+0000 7f3247e00640 1 -- 172.21.15.70:0/5082026 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f323c02f030 con 0x7f32500ad2a0 2024-09-13T16:03:06.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.907+0000 7f3247e00640 1 --2- 172.21.15.70:0/5082026 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f323006ac00 0x7f323006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:06.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.907+0000 7f3247e00640 1 -- 172.21.15.70:0/5082026 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f323c0a8820 con 0x7f32500ad2a0 2024-09-13T16:03:06.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.907+0000 7f324fe00640 1 --2- 172.21.15.70:0/5082026 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f323006ac00 0x7f323006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:06.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.908+0000 7f324fe00640 1 --2- 172.21.15.70:0/5082026 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f323006ac00 0x7f323006d0c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3240009bc0 tx=0x7f3240009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:06.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:06.911+0000 7f3247e00640 1 -- 172.21.15.70:0/5082026 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f323c073da0 con 0x7f32500ad2a0 2024-09-13T16:03:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.080+0000 7f3256a00640 1 -- 172.21.15.70:0/5082026 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f325015a150 con 0x7f323006ac00 2024-09-13T16:03:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.081+0000 7f3247e00640 1 -- 172.21.15.70:0/5082026 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3240019070 con 0x7f323006ac00 2024-09-13T16:03:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T16:03:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.082+0000 7f3256a00640 1 -- 172.21.15.70:0/5082026 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f323006ac00 msgr2=0x7f323006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.082+0000 7f3256a00640 1 --2- 172.21.15.70:0/5082026 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f323006ac00 0x7f323006d0c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3240009bc0 tx=0x7f3240009190 comp rx=0 tx=0).stop 2024-09-13T16:03:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.083+0000 7f3256a00640 1 -- 172.21.15.70:0/5082026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32500ad2a0 msgr2=0x7f325013bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.083+0000 7f3256a00640 1 --2- 172.21.15.70:0/5082026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32500ad2a0 0x7f325013bf90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c160 tx=0x7f323c001980 comp rx=0 tx=0).stop 2024-09-13T16:03:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.083+0000 7f3256a00640 1 -- 172.21.15.70:0/5082026 shutdown_connections 2024-09-13T16:03:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.083+0000 7f3256a00640 1 --2- 172.21.15.70:0/5082026 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f323006ac00 0x7f323006d0c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.083+0000 7f3256a00640 1 --2- 172.21.15.70:0/5082026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f325015b330 0x7f325015b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.083+0000 7f3256a00640 1 --2- 172.21.15.70:0/5082026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32500ad2a0 0x7f325013bf90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.083+0000 7f3256a00640 1 --2- 172.21.15.70:0/5082026 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3234003ee0 0x7f32500a8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.083+0000 7f3256a00640 1 -- 172.21.15.70:0/5082026 >> 172.21.15.70:0/5082026 conn(0x7f32500b0510 msgr2=0x7f32500ae380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.083+0000 7f3256a00640 1 -- 172.21.15.70:0/5082026 shutdown_connections 2024-09-13T16:03:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.083+0000 7f3256a00640 1 -- 172.21.15.70:0/5082026 wait complete. 2024-09-13T16:03:07.100 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T16:03:07.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.252+0000 7f0594600640 1 Processor -- start 2024-09-13T16:03:07.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.252+0000 7f0594600640 1 -- start start 2024-09-13T16:03:07.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.253+0000 7f0594600640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f058c0b3990 0x7f058c159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:07.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.253+0000 7f0594600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f058c06f660 0x7f058c06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:07.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.253+0000 7f0594600640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058c159fc0 con 0x7f058c153b20 2024-09-13T16:03:07.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.253+0000 7f0594600640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058c0ce600 con 0x7f058c0b3990 2024-09-13T16:03:07.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.253+0000 7f0594600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058c070f90 con 0x7f058c06f660 2024-09-13T16:03:07.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.253+0000 7f0591200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f058c0b3990 0x7f058c159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:07.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.253+0000 7f0591200640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f058c0b3990 0x7f058c159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49404/0 (socket says 172.21.15.70:49404) 2024-09-13T16:03:07.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.253+0000 7f0591200640 1 -- 172.21.15.70:0/3656073221 learned_addr learned my addr 172.21.15.70:0/3656073221 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:07.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.253+0000 7f0591c00640 1 --1- 172.21.15.70:0/3656073221 >> v1:172.21.15.70:6789/0 conn(0x7f058c153b20 0x7f058c0b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50830/0 (socket says 172.21.15.70:50830) 2024-09-13T16:03:07.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.254+0000 7f0592600640 1 --2- 172.21.15.70:0/3656073221 >> v2:172.21.15.107:3300/0 conn(0x7f058c06f660 0x7f058c06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:07.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.254+0000 7f0591200640 1 -- 172.21.15.70:0/3656073221 >> v2:172.21.15.107:3300/0 conn(0x7f058c06f660 msgr2=0x7f058c06fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:07.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.254+0000 7f0591200640 1 --2- 172.21.15.70:0/3656073221 >> v2:172.21.15.107:3300/0 conn(0x7f058c06f660 0x7f058c06fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:07.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.254+0000 7f0591200640 1 -- 172.21.15.70:0/3656073221 >> v1:172.21.15.70:6789/0 conn(0x7f058c153b20 legacy=0x7f058c0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:07.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.254+0000 7f0591200640 1 -- 172.21.15.70:0/3656073221 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c153f00 con 0x7f058c0b3990 2024-09-13T16:03:07.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.255+0000 7f0591200640 1 --2- 172.21.15.70:0/3656073221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f058c0b3990 0x7f058c159a80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f058c0cb060 tx=0x7f057802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e3cbf7d13c4786 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:07.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.255+0000 7f058be00640 1 -- 172.21.15.70:0/3656073221 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0578032440 con 0x7f058c0b3990 2024-09-13T16:03:07.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.255+0000 7f058be00640 1 -- 172.21.15.70:0/3656073221 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05780325a0 con 0x7f058c0b3990 2024-09-13T16:03:07.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.255+0000 7f058be00640 1 -- 172.21.15.70:0/3656073221 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0578032930 con 0x7f058c0b3990 2024-09-13T16:03:07.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.256+0000 7f0594600640 1 -- 172.21.15.70:0/3656073221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f058c0b3990 msgr2=0x7f058c159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:07.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.256+0000 7f0594600640 1 --2- 172.21.15.70:0/3656073221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f058c0b3990 0x7f058c159a80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f058c0cb060 tx=0x7f057802a2a0 comp rx=0 tx=0).stop 2024-09-13T16:03:07.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.256+0000 7f0594600640 1 -- 172.21.15.70:0/3656073221 shutdown_connections 2024-09-13T16:03:07.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.256+0000 7f0594600640 1 --2- 172.21.15.70:0/3656073221 >> v2:172.21.15.107:3300/0 conn(0x7f058c06f660 0x7f058c06fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:07.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.256+0000 7f0594600640 1 --2- 172.21.15.70:0/3656073221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f058c0b3990 0x7f058c159a80 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:07.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.256+0000 7f0594600640 1 -- 172.21.15.70:0/3656073221 >> 172.21.15.70:0/3656073221 conn(0x7f058c0b0510 msgr2=0x7f058c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:07.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.256+0000 7f0594600640 1 -- 172.21.15.70:0/3656073221 shutdown_connections 2024-09-13T16:03:07.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.256+0000 7f0594600640 1 -- 172.21.15.70:0/3656073221 wait complete. 2024-09-13T16:03:07.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.257+0000 7f0594600640 1 Processor -- start 2024-09-13T16:03:07.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.258+0000 7f0594600640 1 -- start start 2024-09-13T16:03:07.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.258+0000 7f0594600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f058c06f660 0x7f058c14e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:07.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.258+0000 7f0594600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f058c0b3990 0x7f058c15ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:07.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.259+0000 7f0594600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f058c153b20 0x7f058c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:07.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.259+0000 7f0594600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0ae380 con 0x7f058c153b20 2024-09-13T16:03:07.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.259+0000 7f0594600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0ae660 con 0x7f058c0b3990 2024-09-13T16:03:07.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.259+0000 7f0594600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0ae940 con 0x7f058c06f660 2024-09-13T16:03:07.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.259+0000 7f0592600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f058c153b20 0x7f058c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:07.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.259+0000 7f0592600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f058c153b20 0x7f058c0af420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49420/0 (socket says 172.21.15.70:49420) 2024-09-13T16:03:07.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.259+0000 7f0592600640 1 -- 172.21.15.70:0/1692771365 learned_addr learned my addr 172.21.15.70:0/1692771365 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:07.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.259+0000 7f0591200640 1 --2- 172.21.15.70:0/1692771365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f058c0b3990 0x7f058c15ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:07.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.259+0000 7f0591c00640 1 --2- 172.21.15.70:0/1692771365 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f058c06f660 0x7f058c14e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:07.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.259+0000 7f0592600640 1 -- 172.21.15.70:0/1692771365 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f058c06f660 msgr2=0x7f058c14e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:07.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.259+0000 7f0592600640 1 --2- 172.21.15.70:0/1692771365 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f058c06f660 0x7f058c14e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:07.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.259+0000 7f0592600640 1 -- 172.21.15.70:0/1692771365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f058c0b3990 msgr2=0x7f058c15ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:07.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.259+0000 7f0592600640 1 --2- 172.21.15.70:0/1692771365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f058c0b3990 0x7f058c15ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:07.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.259+0000 7f0592600640 1 -- 172.21.15.70:0/1692771365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05780094d0 con 0x7f058c153b20 2024-09-13T16:03:07.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.259+0000 7f0591c00640 1 --2- 172.21.15.70:0/1692771365 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f058c06f660 0x7f058c14e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:03:07.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.260+0000 7f0592600640 1 --2- 172.21.15.70:0/1692771365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f058c153b20 0x7f058c0af420 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0584007e60 tx=0x7f058400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:07.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.260+0000 7f0589600640 1 -- 172.21.15.70:0/1692771365 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584014420 con 0x7f058c153b20 2024-09-13T16:03:07.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.260+0000 7f0589600640 1 -- 172.21.15.70:0/1692771365 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05840145a0 con 0x7f058c153b20 2024-09-13T16:03:07.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.260+0000 7f0589600640 1 -- 172.21.15.70:0/1692771365 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584014950 con 0x7f058c153b20 2024-09-13T16:03:07.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.260+0000 7f0594600640 1 -- 172.21.15.70:0/1692771365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c0aec20 con 0x7f058c153b20 2024-09-13T16:03:07.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.260+0000 7f0594600640 1 -- 172.21.15.70:0/1692771365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058c14ea30 con 0x7f058c153b20 2024-09-13T16:03:07.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.261+0000 7f0594600640 1 -- 172.21.15.70:0/1692771365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058c0ae1f0 con 0x7f058c153b20 2024-09-13T16:03:07.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.262+0000 7f0589600640 1 -- 172.21.15.70:0/1692771365 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0584014ab0 con 0x7f058c153b20 2024-09-13T16:03:07.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.263+0000 7f0589600640 1 --2- 172.21.15.70:0/1692771365 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f056c06ac00 0x7f056c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:07.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.263+0000 7f0589600640 1 -- 172.21.15.70:0/1692771365 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f0584089920 con 0x7f058c153b20 2024-09-13T16:03:07.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.263+0000 7f0591c00640 1 --2- 172.21.15.70:0/1692771365 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f056c06ac00 0x7f056c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:07.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.264+0000 7f0591c00640 1 --2- 172.21.15.70:0/1692771365 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f056c06ac00 0x7f056c06d0c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0580007fd0 tx=0x7f0580007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:07.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.267+0000 7f0589600640 1 -- 172.21.15.70:0/1692771365 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0584054da0 con 0x7f058c153b20 2024-09-13T16:03:07.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.434+0000 7f0594600640 1 -- 172.21.15.70:0/1692771365 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f058c0ae7d0 con 0x7f056c06ac00 2024-09-13T16:03:07.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.436+0000 7f0589600640 1 -- 172.21.15.70:0/1692771365 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50438 (secure 0 0 0) 0x7f058c0ae7d0 con 0x7f056c06ac00 2024-09-13T16:03:07.438 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:03:07.438 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-13T16:03:07.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.439+0000 7f0594600640 1 -- 172.21.15.70:0/1692771365 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f056c06ac00 msgr2=0x7f056c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:07.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.439+0000 7f0594600640 1 --2- 172.21.15.70:0/1692771365 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f056c06ac00 0x7f056c06d0c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0580007fd0 tx=0x7f0580007d40 comp rx=0 tx=0).stop 2024-09-13T16:03:07.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.439+0000 7f0594600640 1 -- 172.21.15.70:0/1692771365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f058c153b20 msgr2=0x7f058c0af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:07.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.439+0000 7f0594600640 1 --2- 172.21.15.70:0/1692771365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f058c153b20 0x7f058c0af420 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0584007e60 tx=0x7f058400e4b0 comp rx=0 tx=0).stop 2024-09-13T16:03:07.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.439+0000 7f0594600640 1 -- 172.21.15.70:0/1692771365 shutdown_connections 2024-09-13T16:03:07.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.439+0000 7f0594600640 1 --2- 172.21.15.70:0/1692771365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f058c153b20 0x7f058c0af420 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:07.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.439+0000 7f0594600640 1 --2- 172.21.15.70:0/1692771365 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f056c06ac00 0x7f056c06d0c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:07.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.439+0000 7f0594600640 1 --2- 172.21.15.70:0/1692771365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f058c0b3990 0x7f058c15ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:07.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.439+0000 7f0594600640 1 --2- 172.21.15.70:0/1692771365 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f058c06f660 0x7f058c14e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:07.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.439+0000 7f0594600640 1 -- 172.21.15.70:0/1692771365 >> 172.21.15.70:0/1692771365 conn(0x7f058c0b0510 msgr2=0x7f058c1562a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:07.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.439+0000 7f0594600640 1 -- 172.21.15.70:0/1692771365 shutdown_connections 2024-09-13T16:03:07.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:07.439+0000 7f0594600640 1 -- 172.21.15.70:0/1692771365 wait complete. 2024-09-13T16:03:07.455 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-09-13T16:03:06.038601+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":237200,"kb_used_data":4612,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737520,"statfs":{"total":773094113280,"available":772851220480,"internally_reserved":0,"allocated":4722688,"data_stored":2586717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.791702"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T16:02:56.985731+0000","last_change":"2024-09-13T16:01:07.580186+0000","last_active":"2024-09-13T16:02:56.985731+0000","last_peered":"2024-09-13T16:02:56.985731+0000","last_clean":"2024-09-13T16:02:56.985731+0000","last_became_active":"2024-09-13T16:01:07.579877+0000","last_became_peered":"2024-09-13T16:01:07.579877+0000","last_unstale":"2024-09-13T16:02:56.985731+0000","last_undegraded":"2024-09-13T16:02:56.985731+0000","last_fullsized":"2024-09-13T16:02:56.985731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:01:06.070807+0000","last_clean_scrub_stamp":"2024-09-13T16:01:06.070807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:40.645649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":766243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.48799999999999999}]},{"osd":5,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.73699999999999999}]},{"osd":6,"last update":"Fri Sep 13 16:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.63700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":175875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.443},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.51700000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.56799999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.63100000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.69299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":175875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.1230000000000002,"5min":5.1230000000000002,"15min":5.1230000000000002},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.68200000000000005}]},{"osd":3,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.0750000000000002,"5min":5.0750000000000002,"15min":5.0750000000000002},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.71199999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.92200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":175875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.755},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.48699999999999999}]},{"osd":3,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.65900000000000003}]},{"osd":6,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.82999999999999996}]},{"osd":7,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.78300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31552,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":442368,"data_stored":175875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.41699999999999998}]},{"osd":1,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.39500000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Fri Sep 13 16:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.61199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":442368,"data_stored":175875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.45600000000000002}]},{"osd":1,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.502},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.52200000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.55000000000000004}]},{"osd":5,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.71699999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.55500000000000005}]},{"osd":7,"last update":"Fri Sep 13 16:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.68600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":442368,"data_stored":175875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.377},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.315}]},{"osd":2,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.40699999999999997}]},{"osd":3,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Sep 13 16:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":1032192,"data_stored":765224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.44}]},{"osd":3,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.317},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.40200000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.70099999999999996}]},{"osd":6,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.83099999999999996}]},{"osd":7,"last update":"Fri Sep 13 16:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.65800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:03:07.460 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T16:01:06.070807+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=16, tm_min=1, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=16, tm_min=3, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T16:03:07.460 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T16:03:16.418 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T16:03:16.423 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T16:03:27.462 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T16:03:27.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.621+0000 7f296b800640 1 Processor -- start 2024-09-13T16:03:27.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.621+0000 7f296b800640 1 -- start start 2024-09-13T16:03:27.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.622+0000 7f296b800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f29640b3990 0x7f2964159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:27.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.622+0000 7f296b800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f296406f660 0x7f296406fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:27.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.622+0000 7f296b800640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2964159fc0 con 0x7f2964153b20 2024-09-13T16:03:27.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.622+0000 7f296b800640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29640ce600 con 0x7f29640b3990 2024-09-13T16:03:27.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.622+0000 7f296b800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2964070f90 con 0x7f296406f660 2024-09-13T16:03:27.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.622+0000 7f2963e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f29640b3990 0x7f2964159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:27.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.623+0000 7f2963e00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f29640b3990 0x7f2964159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47896/0 (socket says 172.21.15.70:47896) 2024-09-13T16:03:27.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.623+0000 7f2963e00640 1 -- 172.21.15.70:0/1835824701 learned_addr learned my addr 172.21.15.70:0/1835824701 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:27.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.623+0000 7f2963e00640 1 -- 172.21.15.70:0/1835824701 >> v2:172.21.15.107:3300/0 conn(0x7f296406f660 msgr2=0x7f296406fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:27.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.623+0000 7f2969800640 1 --2- 172.21.15.70:0/1835824701 >> v2:172.21.15.107:3300/0 conn(0x7f296406f660 0x7f296406fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:27.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.623+0000 7f2963e00640 1 --2- 172.21.15.70:0/1835824701 >> v2:172.21.15.107:3300/0 conn(0x7f296406f660 0x7f296406fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:27.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.623+0000 7f2963400640 1 -- 172.21.15.70:0/1835824701 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948872787 0 0) 0x7f2964159fc0 con 0x7f2964153b20 2024-09-13T16:03:27.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.623+0000 7f2963e00640 1 -- 172.21.15.70:0/1835824701 >> v1:172.21.15.70:6789/0 conn(0x7f2964153b20 legacy=0x7f29640b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:27.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.623+0000 7f2963e00640 1 -- 172.21.15.70:0/1835824701 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2964153f00 con 0x7f29640b3990 2024-09-13T16:03:27.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.623+0000 7f2969800640 1 --2- 172.21.15.70:0/1835824701 >> v2:172.21.15.107:3300/0 conn(0x7f296406f660 0x7f296406fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:03:27.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.624+0000 7f2963e00640 1 --2- 172.21.15.70:0/1835824701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29640b3990 0x7f2964159a80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f29640cb060 tx=0x7f295002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213801ad430ca861 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:27.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.624+0000 7f2963400640 1 -- 172.21.15.70:0/1835824701 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2950032440 con 0x7f29640b3990 2024-09-13T16:03:27.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.624+0000 7f2963400640 1 -- 172.21.15.70:0/1835824701 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29500325a0 con 0x7f29640b3990 2024-09-13T16:03:27.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.624+0000 7f2963400640 1 -- 172.21.15.70:0/1835824701 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2950032930 con 0x7f29640b3990 2024-09-13T16:03:27.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.625+0000 7f296b800640 1 -- 172.21.15.70:0/1835824701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29640b3990 msgr2=0x7f2964159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:27.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.625+0000 7f296b800640 1 --2- 172.21.15.70:0/1835824701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29640b3990 0x7f2964159a80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f29640cb060 tx=0x7f295002a2a0 comp rx=0 tx=0).stop 2024-09-13T16:03:27.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.625+0000 7f296b800640 1 -- 172.21.15.70:0/1835824701 shutdown_connections 2024-09-13T16:03:27.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.625+0000 7f296b800640 1 --2- 172.21.15.70:0/1835824701 >> v2:172.21.15.107:3300/0 conn(0x7f296406f660 0x7f296406fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:27.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.625+0000 7f296b800640 1 --2- 172.21.15.70:0/1835824701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29640b3990 0x7f2964159a80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:27.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.625+0000 7f296b800640 1 -- 172.21.15.70:0/1835824701 >> 172.21.15.70:0/1835824701 conn(0x7f29640b0510 msgr2=0x7f29640b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:27.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.625+0000 7f296b800640 1 -- 172.21.15.70:0/1835824701 shutdown_connections 2024-09-13T16:03:27.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.625+0000 7f296b800640 1 -- 172.21.15.70:0/1835824701 wait complete. 2024-09-13T16:03:27.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.627+0000 7f296b800640 1 Processor -- start 2024-09-13T16:03:27.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.627+0000 7f296b800640 1 -- start start 2024-09-13T16:03:27.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.628+0000 7f296b800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f296406f660 0x7f296414ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:27.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.628+0000 7f296b800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29640b3990 0x7f2964156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:27.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.628+0000 7f296b800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2964153b20 0x7f29640ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:27.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.628+0000 7f296b800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2964155010 con 0x7f296406f660 2024-09-13T16:03:27.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.628+0000 7f296b800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29641554a0 con 0x7f2964153b20 2024-09-13T16:03:27.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.628+0000 7f296b800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2964154400 con 0x7f29640b3990 2024-09-13T16:03:27.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.628+0000 7f2968e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f296406f660 0x7f296414ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:27.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.628+0000 7f2968e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f296406f660 0x7f296414ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47908/0 (socket says 172.21.15.70:47908) 2024-09-13T16:03:27.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.628+0000 7f2968e00640 1 -- 172.21.15.70:0/3062074545 learned_addr learned my addr 172.21.15.70:0/3062074545 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:27.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.628+0000 7f2969800640 1 --2- 172.21.15.70:0/3062074545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2964153b20 0x7f29640ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:27.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.628+0000 7f2963e00640 1 --2- 172.21.15.70:0/3062074545 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29640b3990 0x7f2964156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:27.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.628+0000 7f2968e00640 1 -- 172.21.15.70:0/3062074545 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29640b3990 msgr2=0x7f2964156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:27.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.628+0000 7f2968e00640 1 --2- 172.21.15.70:0/3062074545 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29640b3990 0x7f2964156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:27.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.628+0000 7f2968e00640 1 -- 172.21.15.70:0/3062074545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2964153b20 msgr2=0x7f29640ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:27.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.628+0000 7f2968e00640 1 --2- 172.21.15.70:0/3062074545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2964153b20 0x7f29640ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:27.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.628+0000 7f2968e00640 1 -- 172.21.15.70:0/3062074545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29500094d0 con 0x7f296406f660 2024-09-13T16:03:27.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.628+0000 7f2969800640 1 --2- 172.21.15.70:0/3062074545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2964153b20 0x7f29640ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:03:27.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.628+0000 7f2963e00640 1 --2- 172.21.15.70:0/3062074545 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29640b3990 0x7f2964156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:03:27.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.629+0000 7f2968e00640 1 --2- 172.21.15.70:0/3062074545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f296406f660 0x7f296414ecc0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f295800c4b0 tx=0x7f295800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:27.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.629+0000 7f2960c00640 1 -- 172.21.15.70:0/3062074545 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2958005480 con 0x7f296406f660 2024-09-13T16:03:27.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.629+0000 7f2960c00640 1 -- 172.21.15.70:0/3062074545 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29580035f0 con 0x7f296406f660 2024-09-13T16:03:27.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.629+0000 7f2960c00640 1 -- 172.21.15.70:0/3062074545 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29580039e0 con 0x7f296406f660 2024-09-13T16:03:27.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.629+0000 7f296b800640 1 -- 172.21.15.70:0/3062074545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29641546e0 con 0x7f296406f660 2024-09-13T16:03:27.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.629+0000 7f296b800640 1 -- 172.21.15.70:0/3062074545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2964154ca0 con 0x7f296406f660 2024-09-13T16:03:27.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.630+0000 7f296b800640 1 -- 172.21.15.70:0/3062074545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296406fa90 con 0x7f296406f660 2024-09-13T16:03:27.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.631+0000 7f2960c00640 1 -- 172.21.15.70:0/3062074545 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2958003b40 con 0x7f296406f660 2024-09-13T16:03:27.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.632+0000 7f2960c00640 1 --2- 172.21.15.70:0/3062074545 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f294406ac00 0x7f294406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:27.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.632+0000 7f2960c00640 1 -- 172.21.15.70:0/3062074545 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f29580886a0 con 0x7f296406f660 2024-09-13T16:03:27.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.632+0000 7f2963e00640 1 --2- 172.21.15.70:0/3062074545 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f294406ac00 0x7f294406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:27.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.633+0000 7f2963e00640 1 --2- 172.21.15.70:0/3062074545 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f294406ac00 0x7f294406d0c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2950034000 tx=0x7f295002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:27.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.636+0000 7f2960c00640 1 -- 172.21.15.70:0/3062074545 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2958053b20 con 0x7f296406f660 2024-09-13T16:03:27.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.802+0000 7f296b800640 1 -- 172.21.15.70:0/3062074545 --> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f296415a4d0 con 0x7f294406ac00 2024-09-13T16:03:27.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.804+0000 7f2960c00640 1 -- 172.21.15.70:0/3062074545 <== mgr.4107 v2:172.21.15.70:6832/4156194691 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50558 (secure 0 0 0) 0x7f2950030340 con 0x7f294406ac00 2024-09-13T16:03:27.807 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:03:27.807 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-13T16:03:27.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.806+0000 7f296b800640 1 -- 172.21.15.70:0/3062074545 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f294406ac00 msgr2=0x7f294406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:27.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.806+0000 7f296b800640 1 --2- 172.21.15.70:0/3062074545 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f294406ac00 0x7f294406d0c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2950034000 tx=0x7f295002e000 comp rx=0 tx=0).stop 2024-09-13T16:03:27.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.806+0000 7f296b800640 1 -- 172.21.15.70:0/3062074545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f296406f660 msgr2=0x7f296414ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:27.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.806+0000 7f296b800640 1 --2- 172.21.15.70:0/3062074545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f296406f660 0x7f296414ecc0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f295800c4b0 tx=0x7f295800c970 comp rx=0 tx=0).stop 2024-09-13T16:03:27.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.806+0000 7f296b800640 1 -- 172.21.15.70:0/3062074545 shutdown_connections 2024-09-13T16:03:27.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.806+0000 7f296b800640 1 --2- 172.21.15.70:0/3062074545 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f294406ac00 0x7f294406d0c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:27.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.806+0000 7f296b800640 1 --2- 172.21.15.70:0/3062074545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2964153b20 0x7f29640ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:27.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.806+0000 7f296b800640 1 --2- 172.21.15.70:0/3062074545 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29640b3990 0x7f2964156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:27.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.806+0000 7f296b800640 1 --2- 172.21.15.70:0/3062074545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f296406f660 0x7f296414ecc0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:27.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.806+0000 7f296b800640 1 -- 172.21.15.70:0/3062074545 >> 172.21.15.70:0/3062074545 conn(0x7f29640b0510 msgr2=0x7f29640ad280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:27.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.807+0000 7f296b800640 1 -- 172.21.15.70:0/3062074545 shutdown_connections 2024-09-13T16:03:27.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.807+0000 7f296b800640 1 -- 172.21.15.70:0/3062074545 wait complete. 2024-09-13T16:03:27.829 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-13T16:03:26.043003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":237180,"kb_used_data":4612,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737540,"statfs":{"total":773094113280,"available":772851240960,"internally_reserved":0,"allocated":4722688,"data_stored":2586717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002678"},"pg_stats":[{"pgid":"1.0","version":"38'119","reported_seq":195,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T16:03:13.764077+0000","last_change":"2024-09-13T16:03:13.764211+0000","last_active":"2024-09-13T16:03:13.764077+0000","last_peered":"2024-09-13T16:03:13.764077+0000","last_clean":"2024-09-13T16:03:13.764077+0000","last_became_active":"2024-09-13T16:01:07.579877+0000","last_became_peered":"2024-09-13T16:01:07.579877+0000","last_unstale":"2024-09-13T16:03:13.764077+0000","last_undegraded":"2024-09-13T16:03:13.764077+0000","last_fullsized":"2024-09-13T16:03:13.764077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'119","last_scrub_stamp":"2024-09-13T16:03:13.764054+0000","last_deep_scrub":"38'119","last_deep_scrub_stamp":"2024-09-13T16:03:13.764054+0000","last_clean_scrub_stamp":"2024-09-13T16:03:13.764054+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:40.312000+0000","scrub_duration":0.0077864320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1036288,"data_stored":766243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.75},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0129999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Sep 13 16:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63100000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.755},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.48499999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Sep 13 16:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72399999999999998,"15min":0.72999999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93400000000000005,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86299999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.82099999999999995}]},{"osd":3,"last update":"Fri Sep 13 16:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.997,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.754,"15min":0.76200000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88300000000000001,"5min":1.196,"15min":1.196},"last":0.68100000000000005}]},{"osd":4,"last update":"Fri Sep 13 16:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.66300000000000003,"15min":0.67100000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82799999999999996,"5min":1.075,"15min":1.075},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.67300000000000004,"15min":0.68799999999999994},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.76900000000000002,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Sep 13 16:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.747,"15min":0.76700000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.80900000000000005,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.55300000000000005,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81000000000000005,"5min":1.224,"15min":1.224},"last":0.52300000000000002}]},{"osd":6,"last update":"Fri Sep 13 16:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.82599999999999996,"15min":0.84099999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.92300000000000004,"5min":1.948,"15min":1.948},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.86499999999999999,"5min":1.244,"15min":1.244},"last":0.60799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":175875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94799999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.45600000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.67100000000000004}]},{"osd":1,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.435,"15min":0.435},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.49199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.98799999999999999,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.65400000000000003}]},{"osd":2,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65800000000000003,"15min":0.65200000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.755},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.63700000000000001}]},{"osd":3,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.68600000000000005,"15min":0.67800000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90500000000000003,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.61799999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66000000000000003,"15min":0.65700000000000003},"min":{"1min":0.48599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89500000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.54500000000000004}]},{"osd":5,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63400000000000001,"15min":0.63600000000000001},"min":{"1min":0.38600000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.77600000000000002,"15min":0.76800000000000002},"min":{"1min":0.626,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.45700000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.85799999999999998,"5min":0.874,"15min":0.874},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.53600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":175875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63,"15min":0.626},"min":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.70399999999999996}]},{"osd":1,"last update":"Fri Sep 13 16:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.47799999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.67400000000000004}]},{"osd":2,"last update":"Fri Sep 13 16:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.84399999999999997,"15min":0.874},"min":{"1min":0.53100000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.81599999999999995,"5min":5.1230000000000002,"15min":5.1230000000000002},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68000000000000005,"15min":0.68400000000000005},"min":{"1min":0.501,"5min":0.5,"15min":0.5},"max":{"1min":0.81899999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.75}]},{"osd":3,"last update":"Fri Sep 13 16:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.84399999999999997,"15min":0.871},"min":{"1min":0.54500000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.876,"5min":5.0750000000000002,"15min":5.0750000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68300000000000005,"15min":0.68500000000000005},"min":{"1min":0.54100000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.67300000000000004,"15min":0.68500000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86899999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Sep 13 16:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67000000000000004,"15min":0.67500000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72699999999999998,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94499999999999995,"5min":1.046,"15min":1.046},"last":0.82699999999999996}]},{"osd":7,"last update":"Fri Sep 13 16:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.74399999999999999,"15min":0.76100000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.90500000000000003,"5min":1.248,"15min":1.248},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.92200000000000004,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.84899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":175875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69899999999999995,"15min":0.70399999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86699999999999999,"5min":1.028,"15min":1.028},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70299999999999996,"15min":0.71099999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.80200000000000005,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.751}]},{"osd":1,"last update":"Fri Sep 13 16:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.874,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.82399999999999995,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.92200000000000004}]},{"osd":2,"last update":"Fri Sep 13 16:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.51800000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.86199999999999999,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73099999999999998,"15min":0.73599999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85199999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.89700000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.47499999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.83799999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72399999999999998,"15min":0.72699999999999998},"min":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.84099999999999997,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Sep 13 16:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91600000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.67200000000000004,"15min":0.68000000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89000000000000001,"5min":0.998,"15min":0.998},"last":0.83999999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.66900000000000004,"15min":0.67900000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81699999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.875,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.77400000000000002}]},{"osd":7,"last update":"Fri Sep 13 16:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.75600000000000001,"15min":0.77000000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.874,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.80100000000000005,"15min":0.81299999999999994},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93000000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.81999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31552,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":442368,"data_stored":175875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.376},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44700000000000001},"min":{"1min":0.35899999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67200000000000004,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.65800000000000003}]},{"osd":1,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.436,"15min":0.433},"min":{"1min":0.31,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69299999999999995,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46700000000000003,"15min":0.46600000000000003},"min":{"1min":0.35699999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.42599999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.38200000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.627,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.496,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.621,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.40200000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.746,"15min":0.73899999999999999},"min":{"1min":0.58299999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0069999999999999,"5min":1.262,"15min":1.262},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.75600000000000001,"15min":0.747},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0640000000000001,"5min":1.121,"15min":1.121},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.72999999999999998,"15min":0.72399999999999998},"min":{"1min":0.53800000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.746},{"interface":"front","average":{"1min":0.747,"5min":0.71499999999999997,"15min":0.70899999999999996},"min":{"1min":0.56899999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.97999999999999998,"5min":1.248,"15min":1.248},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.57399999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.03,"5min":1.288,"15min":1.288},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.75900000000000001,"15min":0.751},"min":{"1min":0.59199999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.012,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.81799999999999995}]},{"osd":7,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.70399999999999996,"15min":0.69199999999999995},"min":{"1min":0.55800000000000005,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.98599999999999999,"5min":1.042,"15min":1.042},"last":0.876}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":442368,"data_stored":175875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67000000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.44800000000000001,"15min":0.44500000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.621,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.51200000000000001,"15min":0.52300000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.56699999999999995,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.501,"15min":0.50600000000000001},"min":{"1min":0.39400000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69899999999999995,"5min":1.121,"15min":1.121},"last":0.59699999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.39700000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.65200000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.38600000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.746,"5min":1.341,"15min":1.341},"last":0.46700000000000003}]},{"osd":4,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72499999999999998,"15min":0.71899999999999997},"min":{"1min":0.58699999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0389999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.70999999999999996,"15min":0.70299999999999996},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.96399999999999997,"5min":1.284,"15min":1.284},"last":0.86399999999999999}]},{"osd":5,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.68200000000000005,"15min":0.67200000000000004},"min":{"1min":0.53600000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.88400000000000001,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.98699999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.73299999999999998}]},{"osd":6,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.755,"15min":0.755},"min":{"1min":0.59699999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94999999999999996,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.76200000000000001,"15min":0.76400000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97299999999999998,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.752}]},{"osd":7,"last update":"Fri Sep 13 16:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.56699999999999995,"5min":0.497,"15min":0.497},"max":{"1min":0.95999999999999996,"5min":1.548,"15min":1.548},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.89900000000000002,"5min":1.367,"15min":1.367},"last":0.78200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":442368,"data_stored":175875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.433,"15min":0.435},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.62,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.442,"15min":0.44800000000000001},"min":{"1min":0.29799999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56299999999999994,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.432,"15min":0.434},"min":{"1min":0.29899999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58599999999999997,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.497,"15min":0.503},"min":{"1min":0.36099999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66900000000000004,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Sep 13 16:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.746,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.499,"15min":0.504},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.60399999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68300000000000005,"15min":0.68000000000000005},"min":{"1min":0.42899999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1379999999999999,"5min":1.321,"15min":1.321},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.52400000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1599999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.81499999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2070000000000001,"5min":1.21,"15min":1.21},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.503,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.244,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.83099999999999996}]},{"osd":6,"last update":"Fri Sep 13 16:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.54900000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95399999999999996,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72499999999999998,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.73299999999999998}]},{"osd":7,"last update":"Fri Sep 13 16:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.58399999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3220000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.75700000000000001},"min":{"1min":0.55700000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2929999999999999,"5min":1.466,"15min":1.466},"last":0.79700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":1032192,"data_stored":765224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 16:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40699999999999997,"15min":0.40799999999999997},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.45100000000000001,"15min":0.45500000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65100000000000002,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47999999999999998,"15min":0.48799999999999999},"min":{"1min":0.34000000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63100000000000001,"5min":1.107,"15min":1.107},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.495,"15min":0.496},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.60199999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46200000000000002,"15min":0.46800000000000003},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60799999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.55100000000000005,"15min":0.55800000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78100000000000003,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.50600000000000001}]},{"osd":4,"last update":"Fri Sep 13 16:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.69199999999999995,"15min":0.69599999999999995},"min":{"1min":0.46899999999999997,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.026,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.753},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.748,"15min":0.75700000000000001},"min":{"1min":0.49199999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.052,"5min":1.153,"15min":1.153},"last":0.84199999999999997}]},{"osd":5,"last update":"Fri Sep 13 16:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.48599999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.58099999999999996,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.871}]},{"osd":6,"last update":"Fri Sep 13 16:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0649999999999999,"5min":1.454,"15min":1.454},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74199999999999999,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0369999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.179,"5min":1.214,"15min":1.214},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.77000000000000002,"15min":0.78600000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:03:27.831 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T16:03:27.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.976+0000 7fc0ae400640 1 Processor -- start 2024-09-13T16:03:27.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.976+0000 7fc0ae400640 1 -- start start 2024-09-13T16:03:27.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.977+0000 7fc0ae400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc0a81566f0 0x7fc0a8070170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:27.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.978+0000 7fc0ae400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0a806be40 0x7fc0a80ad950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:27.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.978+0000 7fc0ae400640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a806fce0 con 0x7fc0a806c2a0 2024-09-13T16:03:27.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.978+0000 7fc0ae400640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a806c820 con 0x7fc0a81566f0 2024-09-13T16:03:27.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.978+0000 7fc0ae400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a806f690 con 0x7fc0a806be40 2024-09-13T16:03:27.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.978+0000 7fc0a7400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc0a81566f0 0x7fc0a8070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:27.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.978+0000 7fc0a7400640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc0a81566f0 0x7fc0a8070170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47916/0 (socket says 172.21.15.70:47916) 2024-09-13T16:03:27.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.978+0000 7fc0a7400640 1 -- 172.21.15.70:0/3177280216 learned_addr learned my addr 172.21.15.70:0/3177280216 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:27.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.978+0000 7fc0a7e00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fc0a806c2a0 0x7fc0a815c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:59452/0 (socket says 172.21.15.70:59452) 2024-09-13T16:03:27.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.978+0000 7fc0a6a00640 1 --2- 172.21.15.70:0/3177280216 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0a806be40 0x7fc0a80ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:27.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.978+0000 7fc0a7400640 1 -- 172.21.15.70:0/3177280216 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0a806be40 msgr2=0x7fc0a80ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:27.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.978+0000 7fc0a7400640 1 --2- 172.21.15.70:0/3177280216 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0a806be40 0x7fc0a80ad950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:27.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.978+0000 7fc0a7400640 1 -- 172.21.15.70:0/3177280216 >> v1:172.21.15.70:6789/0 conn(0x7fc0a806c2a0 legacy=0x7fc0a815c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:27.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.978+0000 7fc0a7400640 1 -- 172.21.15.70:0/3177280216 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a806f970 con 0x7fc0a81566f0 2024-09-13T16:03:27.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.978+0000 7fc0a6000640 1 -- 172.21.15.70:0/3177280216 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435777951 0 0) 0x7fc0a806fce0 con 0x7fc0a806c2a0 2024-09-13T16:03:27.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.979+0000 7fc0a7400640 1 --2- 172.21.15.70:0/3177280216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0a81566f0 0x7fc0a8070170 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc098009e80 tx=0x7fc09802a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fcb5ccda16e4ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:27.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.980+0000 7fc0a6000640 1 -- 172.21.15.70:0/3177280216 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098031600 con 0x7fc0a81566f0 2024-09-13T16:03:27.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.980+0000 7fc0a6000640 1 -- 172.21.15.70:0/3177280216 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09802d050 con 0x7fc0a81566f0 2024-09-13T16:03:27.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.980+0000 7fc0a6000640 1 -- 172.21.15.70:0/3177280216 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098031980 con 0x7fc0a81566f0 2024-09-13T16:03:27.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.980+0000 7fc0ae400640 1 -- 172.21.15.70:0/3177280216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0a81566f0 msgr2=0x7fc0a8070170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:27.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.980+0000 7fc0ae400640 1 --2- 172.21.15.70:0/3177280216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0a81566f0 0x7fc0a8070170 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc098009e80 tx=0x7fc09802a750 comp rx=0 tx=0).stop 2024-09-13T16:03:27.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.980+0000 7fc0ae400640 1 -- 172.21.15.70:0/3177280216 shutdown_connections 2024-09-13T16:03:27.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.980+0000 7fc0ae400640 1 --2- 172.21.15.70:0/3177280216 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0a806be40 0x7fc0a80ad950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:27.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.980+0000 7fc0ae400640 1 --2- 172.21.15.70:0/3177280216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0a81566f0 0x7fc0a8070170 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:27.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.980+0000 7fc0ae400640 1 -- 172.21.15.70:0/3177280216 >> 172.21.15.70:0/3177280216 conn(0x7fc0a80b0580 msgr2=0x7fc0a80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:27.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.980+0000 7fc0ae400640 1 -- 172.21.15.70:0/3177280216 shutdown_connections 2024-09-13T16:03:27.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.980+0000 7fc0ae400640 1 -- 172.21.15.70:0/3177280216 wait complete. 2024-09-13T16:03:27.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.982+0000 7fc0ae400640 1 Processor -- start 2024-09-13T16:03:27.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.982+0000 7fc0ae400640 1 -- start start 2024-09-13T16:03:27.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.983+0000 7fc0ae400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0a806be40 0x7fc0a80c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:27.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.983+0000 7fc0ae400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0a806c2a0 0x7fc0a81417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:27.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.983+0000 7fc0ae400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0a81566f0 0x7fc0a8142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:27.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.983+0000 7fc0ae400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a814a920 con 0x7fc0a806c2a0 2024-09-13T16:03:27.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.983+0000 7fc0ae400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a814ab70 con 0x7fc0a81566f0 2024-09-13T16:03:27.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.983+0000 7fc0ae400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a814ae50 con 0x7fc0a806be40 2024-09-13T16:03:27.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.983+0000 7fc0a6a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0a806c2a0 0x7fc0a81417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:27.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.983+0000 7fc0a6a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0a806c2a0 0x7fc0a81417e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47926/0 (socket says 172.21.15.70:47926) 2024-09-13T16:03:27.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.983+0000 7fc0a6a00640 1 -- 172.21.15.70:0/1933857139 learned_addr learned my addr 172.21.15.70:0/1933857139 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:27.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.983+0000 7fc0a7400640 1 --2- 172.21.15.70:0/1933857139 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0a806be40 0x7fc0a80c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:27.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.983+0000 7fc0a7e00640 1 --2- 172.21.15.70:0/1933857139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0a81566f0 0x7fc0a8142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:27.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.984+0000 7fc0a6a00640 1 -- 172.21.15.70:0/1933857139 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0a806be40 msgr2=0x7fc0a80c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:27.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.984+0000 7fc0a6a00640 1 --2- 172.21.15.70:0/1933857139 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0a806be40 0x7fc0a80c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:27.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.984+0000 7fc0a6a00640 1 -- 172.21.15.70:0/1933857139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0a81566f0 msgr2=0x7fc0a8142dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:27.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.984+0000 7fc0a6a00640 1 --2- 172.21.15.70:0/1933857139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0a81566f0 0x7fc0a8142dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:27.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.984+0000 7fc0a6a00640 1 -- 172.21.15.70:0/1933857139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc098009b30 con 0x7fc0a806c2a0 2024-09-13T16:03:27.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.984+0000 7fc0a6a00640 1 --2- 172.21.15.70:0/1933857139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0a806c2a0 0x7fc0a81417e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc09400d7d0 tx=0x7fc09400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:27.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.984+0000 7fc09f400640 1 -- 172.21.15.70:0/1933857139 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094018070 con 0x7fc0a806c2a0 2024-09-13T16:03:27.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.984+0000 7fc09f400640 1 -- 172.21.15.70:0/1933857139 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc094004020 con 0x7fc0a806c2a0 2024-09-13T16:03:27.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.984+0000 7fc09f400640 1 -- 172.21.15.70:0/1933857139 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0940041b0 con 0x7fc0a806c2a0 2024-09-13T16:03:27.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.984+0000 7fc0ae400640 1 -- 172.21.15.70:0/1933857139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a814b130 con 0x7fc0a806c2a0 2024-09-13T16:03:27.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.984+0000 7fc0ae400640 1 -- 172.21.15.70:0/1933857139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a8142460 con 0x7fc0a806c2a0 2024-09-13T16:03:27.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.985+0000 7fc0ae400640 1 -- 172.21.15.70:0/1933857139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a8070150 con 0x7fc0a806c2a0 2024-09-13T16:03:27.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.986+0000 7fc09f400640 1 -- 172.21.15.70:0/1933857139 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc094004310 con 0x7fc0a806c2a0 2024-09-13T16:03:27.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.987+0000 7fc09f400640 1 --2- 172.21.15.70:0/1933857139 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fc08806ac00 0x7fc08806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:27.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.987+0000 7fc09f400640 1 -- 172.21.15.70:0/1933857139 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc094088e50 con 0x7fc0a806c2a0 2024-09-13T16:03:27.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.987+0000 7fc0a7400640 1 --2- 172.21.15.70:0/1933857139 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fc08806ac00 0x7fc08806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:27.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.988+0000 7fc0a7400640 1 --2- 172.21.15.70:0/1933857139 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fc08806ac00 0x7fc08806d0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc098033000 tx=0x7fc098009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:27.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:27.991+0000 7fc09f400640 1 -- 172.21.15.70:0/1933857139 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc094054370 con 0x7fc0a806c2a0 2024-09-13T16:03:28.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.161+0000 7fc0ae400640 1 -- 172.21.15.70:0/1933857139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fc0a80b2400 con 0x7fc0a806c2a0 2024-09-13T16:03:28.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.166+0000 7fc09f400640 1 -- 172.21.15.70:0/1933857139 <== mon.0 v2:172.21.15.70:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc09405e0c0 con 0x7fc0a806c2a0 2024-09-13T16:03:28.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.166+0000 7fc09f400640 1 -- 172.21.15.70:0/1933857139 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fc094057990 con 0x7fc0a806c2a0 2024-09-13T16:03:28.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.169+0000 7fc0ae400640 1 -- 172.21.15.70:0/1933857139 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fc08806ac00 msgr2=0x7fc08806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:28.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.169+0000 7fc0ae400640 1 --2- 172.21.15.70:0/1933857139 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fc08806ac00 0x7fc08806d0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc098033000 tx=0x7fc098009000 comp rx=0 tx=0).stop 2024-09-13T16:03:28.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.169+0000 7fc0ae400640 1 -- 172.21.15.70:0/1933857139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0a806c2a0 msgr2=0x7fc0a81417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:28.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.169+0000 7fc0ae400640 1 --2- 172.21.15.70:0/1933857139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0a806c2a0 0x7fc0a81417e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc09400d7d0 tx=0x7fc09400dc90 comp rx=0 tx=0).stop 2024-09-13T16:03:28.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.169+0000 7fc0ae400640 1 -- 172.21.15.70:0/1933857139 shutdown_connections 2024-09-13T16:03:28.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.169+0000 7fc0ae400640 1 --2- 172.21.15.70:0/1933857139 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7fc08806ac00 0x7fc08806d0c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.169+0000 7fc0ae400640 1 --2- 172.21.15.70:0/1933857139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0a81566f0 0x7fc0a8142dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.169+0000 7fc0ae400640 1 --2- 172.21.15.70:0/1933857139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0a806c2a0 0x7fc0a81417e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.169+0000 7fc0ae400640 1 --2- 172.21.15.70:0/1933857139 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc0a806be40 0x7fc0a80c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.169+0000 7fc0ae400640 1 -- 172.21.15.70:0/1933857139 >> 172.21.15.70:0/1933857139 conn(0x7fc0a80b0580 msgr2=0x7fc0a80b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:28.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.169+0000 7fc0ae400640 1 -- 172.21.15.70:0/1933857139 shutdown_connections 2024-09-13T16:03:28.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.169+0000 7fc0ae400640 1 -- 172.21.15.70:0/1933857139 wait complete. 2024-09-13T16:03:28.187 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T16:03:28.187 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:03:28.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.337+0000 7f3c63000640 1 Processor -- start 2024-09-13T16:03:28.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.338+0000 7f3c63000640 1 -- start start 2024-09-13T16:03:28.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.339+0000 7f3c63000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c5c15a520 0x7f3c5c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:28.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.339+0000 7f3c63000640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c06bc00 con 0x7f3c5c0b1b00 2024-09-13T16:03:28.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.339+0000 7f3c63000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c06bea0 con 0x7f3c5c0ce020 2024-09-13T16:03:28.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.339+0000 7f3c63000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c06c180 con 0x7f3c5c15a520 2024-09-13T16:03:28.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.339+0000 7f3c53400640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3c5c0b1b00 0x7f3c5c0cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:59462/0 (socket says 172.21.15.70:59462) 2024-09-13T16:03:28.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.339+0000 7f3c53400640 1 -- 172.21.15.70:0/1976000631 learned_addr learned my addr 172.21.15.70:0/1976000631 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-13T16:03:28.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.339+0000 7f3c5be00640 1 --2- 172.21.15.70:0/1976000631 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c5c15a520 0x7f3c5c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:28.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.339+0000 7f3c5b400640 1 -- 172.21.15.70:0/1976000631 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799851895 0 0) 0x7f3c5c06bc00 con 0x7f3c5c0b1b00 2024-09-13T16:03:28.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c5b400640 1 -- 172.21.15.70:0/1976000631 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c40003520 con 0x7f3c5c0b1b00 2024-09-13T16:03:28.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c5b400640 1 -- 172.21.15.70:0/1976000631 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444529042 0 0) 0x7f3c5c06bea0 con 0x7f3c5c0ce020 2024-09-13T16:03:28.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c5b400640 1 -- 172.21.15.70:0/1976000631 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c5c06bc00 con 0x7f3c5c0ce020 2024-09-13T16:03:28.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c5b400640 1 -- 172.21.15.70:0/1976000631 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3055598712 0 0) 0x7f3c40003520 con 0x7f3c5c0b1b00 2024-09-13T16:03:28.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c5b400640 1 -- 172.21.15.70:0/1976000631 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c5c15a520 msgr2=0x7f3c5c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:28.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c5b400640 1 --2- 172.21.15.70:0/1976000631 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c5c15a520 0x7f3c5c06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c5b400640 1 -- 172.21.15.70:0/1976000631 >> v1:172.21.15.107:6789/0 conn(0x7f3c5c0ce020 legacy=0x7f3c5c15a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:28.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c5b400640 1 -- 172.21.15.70:0/1976000631 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c06c460 con 0x7f3c5c0b1b00 2024-09-13T16:03:28.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c5b400640 1 -- 172.21.15.70:0/1976000631 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 86859118 0 0) 0x7f3c44001670 con 0x7f3c5c0b1b00 2024-09-13T16:03:28.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c5b400640 1 -- 172.21.15.70:0/1976000631 >> v1:172.21.15.70:6789/0 conn(0x7f3c5c0b1b00 legacy=0x7f3c5c0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:28.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c5b400640 1 --2- 172.21.15.70:0/1976000631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c40003b30 0x7f3c40003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:28.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c5b400640 1 --2- 172.21.15.70:0/1976000631 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c5c15a520 0x7f3c400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:28.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c5b400640 1 --2- 172.21.15.70:0/1976000631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c40004d00 0x7f3c40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:28.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c5b400640 1 -- 172.21.15.70:0/1976000631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c06c180 con 0x7f3c40004d00 2024-09-13T16:03:28.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c5b400640 1 -- 172.21.15.70:0/1976000631 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4000ba30 con 0x7f3c40003b30 2024-09-13T16:03:28.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c5b400640 1 -- 172.21.15.70:0/1976000631 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4000bba0 con 0x7f3c5c15a520 2024-09-13T16:03:28.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c61000640 1 --2- 172.21.15.70:0/1976000631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c40004d00 0x7f3c40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:28.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c5be00640 1 --2- 172.21.15.70:0/1976000631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c40003b30 0x7f3c40003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:28.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.340+0000 7f3c53400640 1 --2- 172.21.15.70:0/1976000631 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c5c15a520 0x7f3c400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:28.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.341+0000 7f3c61000640 1 -- 172.21.15.70:0/1976000631 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c5c15a520 msgr2=0x7f3c400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:28.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.341+0000 7f3c61000640 1 --2- 172.21.15.70:0/1976000631 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c5c15a520 0x7f3c400047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.341+0000 7f3c61000640 1 -- 172.21.15.70:0/1976000631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c40003b30 msgr2=0x7f3c40003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:28.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.341+0000 7f3c61000640 1 --2- 172.21.15.70:0/1976000631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c40003b30 0x7f3c40003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.341+0000 7f3c61000640 1 -- 172.21.15.70:0/1976000631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c40003520 con 0x7f3c40004d00 2024-09-13T16:03:28.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.342+0000 7f3c61000640 1 --2- 172.21.15.70:0/1976000631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c40004d00 0x7f3c40005180 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3c54001fd0 tx=0x7f3c400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b8d7a0d5c828f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:28.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.342+0000 7f3c5b400640 1 -- 172.21.15.70:0/1976000631 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c54003b70 con 0x7f3c40004d00 2024-09-13T16:03:28.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.342+0000 7f3c5b400640 1 -- 172.21.15.70:0/1976000631 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3c5402d050 con 0x7f3c40004d00 2024-09-13T16:03:28.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.342+0000 7f3c5b400640 1 -- 172.21.15.70:0/1976000631 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c540050d0 con 0x7f3c40004d00 2024-09-13T16:03:28.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.342+0000 7f3c63000640 1 -- 172.21.15.70:0/1976000631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c40004d00 msgr2=0x7f3c40005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:28.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.342+0000 7f3c63000640 1 --2- 172.21.15.70:0/1976000631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c40004d00 0x7f3c40005180 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3c54001fd0 tx=0x7f3c400057f0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.342+0000 7f3c61000640 1 -- 172.21.15.70:0/1976000631 reap_dead start 2024-09-13T16:03:28.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.343+0000 7f3c63000640 1 -- 172.21.15.70:0/1976000631 shutdown_connections 2024-09-13T16:03:28.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.343+0000 7f3c63000640 1 -- 172.21.15.70:0/1976000631 >> 172.21.15.70:0/1976000631 conn(0x7f3c5c0b0510 msgr2=0x7f3c5c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:28.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.343+0000 7f3c63000640 1 -- 172.21.15.70:0/1976000631 shutdown_connections 2024-09-13T16:03:28.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.343+0000 7f3c63000640 1 -- 172.21.15.70:0/1976000631 wait complete. 2024-09-13T16:03:28.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.344+0000 7f3c63000640 1 Processor -- start 2024-09-13T16:03:28.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.344+0000 7f3c63000640 1 -- start start 2024-09-13T16:03:28.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.345+0000 7f3c63000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c40004d00 0x7f3c5c14fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:28.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.345+0000 7f3c63000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c5c0a9220 0x7f3c5c1e17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:28.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.345+0000 7f3c63000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c5c0a96a0 0x7f3c5c1e1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:28.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.345+0000 7f3c63000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c0a8d90 con 0x7f3c5c0a9220 2024-09-13T16:03:28.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.345+0000 7f3c63000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c150250 con 0x7f3c40004d00 2024-09-13T16:03:28.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.345+0000 7f3c63000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c152c60 con 0x7f3c5c0a96a0 2024-09-13T16:03:28.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.346+0000 7f3c53400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c5c0a9220 0x7f3c5c1e17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:28.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.346+0000 7f3c53400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c5c0a9220 0x7f3c5c1e17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47944/0 (socket says 172.21.15.70:47944) 2024-09-13T16:03:28.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.346+0000 7f3c53400640 1 -- 172.21.15.70:0/333089126 learned_addr learned my addr 172.21.15.70:0/333089126 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-13T16:03:28.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.346+0000 7f3c5be00640 1 --2- 172.21.15.70:0/333089126 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c40004d00 0x7f3c5c14fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:28.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.346+0000 7f3c61000640 1 --2- 172.21.15.70:0/333089126 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c5c0a96a0 0x7f3c5c1e1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:28.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.346+0000 7f3c53400640 1 -- 172.21.15.70:0/333089126 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c5c0a96a0 msgr2=0x7f3c5c1e1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:28.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.346+0000 7f3c53400640 1 --2- 172.21.15.70:0/333089126 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c5c0a96a0 0x7f3c5c1e1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.346+0000 7f3c53400640 1 -- 172.21.15.70:0/333089126 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c40004d00 msgr2=0x7f3c5c14fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:28.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.346+0000 7f3c53400640 1 --2- 172.21.15.70:0/333089126 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c40004d00 0x7f3c5c14fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.346+0000 7f3c53400640 1 -- 172.21.15.70:0/333089126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c0a8460 con 0x7f3c5c0a9220 2024-09-13T16:03:28.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.346+0000 7f3c53400640 1 --2- 172.21.15.70:0/333089126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c5c0a9220 0x7f3c5c1e17e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3c44007340 tx=0x7f3c44007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:28.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.346+0000 7f3c58c00640 1 -- 172.21.15.70:0/333089126 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44001630 con 0x7f3c5c0a9220 2024-09-13T16:03:28.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.347+0000 7f3c58c00640 1 -- 172.21.15.70:0/333089126 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3c4400f8e0 con 0x7f3c5c0a9220 2024-09-13T16:03:28.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.347+0000 7f3c58c00640 1 -- 172.21.15.70:0/333089126 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4400fcb0 con 0x7f3c5c0a9220 2024-09-13T16:03:28.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.347+0000 7f3c63000640 1 -- 172.21.15.70:0/333089126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c0a8740 con 0x7f3c5c0a9220 2024-09-13T16:03:28.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.347+0000 7f3c63000640 1 -- 172.21.15.70:0/333089126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c1531e0 con 0x7f3c5c0a9220 2024-09-13T16:03:28.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.348+0000 7f3c63000640 1 -- 172.21.15.70:0/333089126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c06b640 con 0x7f3c5c0a9220 2024-09-13T16:03:28.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.348+0000 7f3c58c00640 1 -- 172.21.15.70:0/333089126 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3c4401d460 con 0x7f3c5c0a9220 2024-09-13T16:03:28.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.349+0000 7f3c58c00640 1 --2- 172.21.15.70:0/333089126 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f3c3806ac30 0x7f3c3806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:28.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.349+0000 7f3c58c00640 1 -- 172.21.15.70:0/333089126 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3c440892c0 con 0x7f3c5c0a9220 2024-09-13T16:03:28.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.350+0000 7f3c5be00640 1 --2- 172.21.15.70:0/333089126 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f3c3806ac30 0x7f3c3806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:28.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.350+0000 7f3c5be00640 1 --2- 172.21.15.70:0/333089126 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f3c3806ac30 0x7f3c3806d0f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009bc0 tx=0x7f3c4c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:28.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.354+0000 7f3c58c00640 1 -- 172.21.15.70:0/333089126 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3c44054610 con 0x7f3c5c0a9220 2024-09-13T16:03:28.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.557+0000 7f3c63000640 1 -- 172.21.15.70:0/333089126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c5c159b60 con 0x7f3c5c0a9220 2024-09-13T16:03:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.558+0000 7f3c58c00640 1 -- 172.21.15.70:0/333089126 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f3c44057c30 con 0x7f3c5c0a9220 2024-09-13T16:03:28.560 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-13T16:03:28.560 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2990833970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":2990833970},{"type":"v1","addr":"172.21.15.70:6837","nonce":2990833970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/89056265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":89056265},{"type":"v1","addr":"172.21.15.107:6835","nonce":89056265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/1247927631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1247927631},{"type":"v1","addr":"172.21.15.70:6836","nonce":1247927631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/1077617661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1077617661},{"type":"v1","addr":"172.21.15.107:6834","nonce":1077617661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[]} 2024-09-13T16:03:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 24 2024-09-13T16:03:28.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.560+0000 7f3c63000640 1 -- 172.21.15.70:0/333089126 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f3c3806ac30 msgr2=0x7f3c3806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:28.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.560+0000 7f3c63000640 1 --2- 172.21.15.70:0/333089126 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f3c3806ac30 0x7f3c3806d0f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009bc0 tx=0x7f3c4c009190 comp rx=0 tx=0).stop 2024-09-13T16:03:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.560+0000 7f3c63000640 1 -- 172.21.15.70:0/333089126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c5c0a9220 msgr2=0x7f3c5c1e17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.560+0000 7f3c63000640 1 --2- 172.21.15.70:0/333089126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c5c0a9220 0x7f3c5c1e17e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3c44007340 tx=0x7f3c44007740 comp rx=0 tx=0).stop 2024-09-13T16:03:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.560+0000 7f3c63000640 1 -- 172.21.15.70:0/333089126 shutdown_connections 2024-09-13T16:03:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.560+0000 7f3c63000640 1 --2- 172.21.15.70:0/333089126 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c5c0a96a0 0x7f3c5c1e1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.560+0000 7f3c63000640 1 --2- 172.21.15.70:0/333089126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c5c0a9220 0x7f3c5c1e17e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.560+0000 7f3c63000640 1 --2- 172.21.15.70:0/333089126 >> [v2:172.21.15.70:6832/4156194691,v1:172.21.15.70:6833/4156194691] conn(0x7f3c3806ac30 0x7f3c3806d0f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.560+0000 7f3c63000640 1 --2- 172.21.15.70:0/333089126 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c40004d00 0x7f3c5c14fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.560+0000 7f3c63000640 1 -- 172.21.15.70:0/333089126 >> 172.21.15.70:0/333089126 conn(0x7f3c5c0b0510 msgr2=0x7f3c5c158680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.560+0000 7f3c63000640 1 -- 172.21.15.70:0/333089126 shutdown_connections 2024-09-13T16:03:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-13T16:03:28.560+0000 7f3c63000640 1 -- 172.21.15.70:0/333089126 wait complete. 2024-09-13T16:03:28.579 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-13T16:03:28.579 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T16:03:28.579 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T16:03:28.580 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:03:28.593 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T16:03:28.594 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T16:03:28.594 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:03:28.648 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T16:03:28.648 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T16:03:28.648 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:03:28.663 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T16:03:28.663 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T16:03:28.663 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:03:28.717 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T16:03:28.718 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T16:03:28.718 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T16:03:28.718 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:03:28.765 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T16:03:28.765 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T16:03:28.765 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:03:28.803 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T16:03:28.803 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T16:03:28.804 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:03:28.895 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T16:03:28.895 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T16:03:28.895 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:03:28.950 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T16:03:28.951 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T16:03:28.951 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:03:28.993 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T16:03:28.994 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T16:03:28.994 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:03:29.050 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T16:03:29.050 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T16:03:29.050 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:03:29.097 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T16:03:29.097 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T16:03:29.097 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:03:29.153 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T16:03:29.153 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T16:03:29.153 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T16:03:29.153 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:03:29.221 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T16:03:29.221 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T16:03:29.221 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:03:29.282 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T16:03:29.282 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T16:03:29.282 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T16:03:29.283 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:03:29.303 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T16:03:29.303 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T16:03:29.304 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:03:29.321 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T16:03:29.321 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T16:03:29.321 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:03:29.379 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T16:03:29.379 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T16:03:29.380 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Replacing daemon mds.a' | head -n 1 2024-09-13T16:03:29.455 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-13T16:03:29.455 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T16:03:29.684 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-13T16:03:29.684 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T16:03:29.838 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-13T16:03:29.838 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T16:03:29.936 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-13T16:03:29.937 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T16:03:30.072 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-13T16:03:30.072 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T16:03:30.317 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-13T16:03:30.317 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T16:03:30.411 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-13T16:03:30.411 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T16:03:30.502 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-13T16:03:30.502 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T16:03:30.604 INFO:tasks.ceph:Archiving mon data... 2024-09-13T16:03:30.606 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903774/data/mon.a.tgz 2024-09-13T16:03:30.606 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-13T16:03:30.643 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.1doZ9apHW3 2024-09-13T16:03:30.644 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.1doZ9apHW3 2024-09-13T16:03:30.804 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.1doZ9apHW3 2024-09-13T16:03:30.898 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.1doZ9apHW3 is 288KB 2024-09-13T16:03:30.990 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.1doZ9apHW3 2024-09-13T16:03:31.025 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903774/data/mon.b.tgz 2024-09-13T16:03:31.025 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-09-13T16:03:31.061 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.XuKidDWgtS 2024-09-13T16:03:31.061 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.XuKidDWgtS 2024-09-13T16:03:31.241 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.XuKidDWgtS 2024-09-13T16:03:31.335 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.XuKidDWgtS is 384KB 2024-09-13T16:03:31.426 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.XuKidDWgtS 2024-09-13T16:03:31.462 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903774/data/mon.c.tgz 2024-09-13T16:03:31.462 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-09-13T16:03:31.536 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.aEULmd78eh 2024-09-13T16:03:31.537 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.aEULmd78eh 2024-09-13T16:03:31.707 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.aEULmd78eh 2024-09-13T16:03:31.800 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.aEULmd78eh is 383KB 2024-09-13T16:03:31.889 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.aEULmd78eh 2024-09-13T16:03:31.924 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T16:03:31.924 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T16:03:31.932 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T16:03:32.021 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T16:03:32.021 DEBUG:teuthology.orchestra.run.smithi070:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T16:03:32.025 DEBUG:teuthology.orchestra.run.smithi107:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T16:03:32.084 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T16:03:32.087 INFO:teuthology.orchestra.run.smithi107.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T16:03:32.097 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T16:03:32.099 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903774/remote/smithi070/crash 2024-09-13T16:03:32.100 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T16:03:32.155 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903774/remote/smithi107/crash 2024-09-13T16:03:32.157 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T16:03:32.211 INFO:tasks.ceph:Shutting down logrotate 2024-09-13T16:03:32.212 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T16:03:32.216 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T16:03:32.299 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T16:03:32.354 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T16:03:32.409 INFO:tasks.ceph:Compressing logs... 2024-09-13T16:03:32.410 DEBUG:teuthology.orchestra.run.smithi070:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T16:03:32.414 DEBUG:teuthology.orchestra.run.smithi107:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T16:03:33.260 INFO:tasks.ceph:Archiving logs... 2024-09-13T16:03:33.260 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903774/remote/smithi070/log 2024-09-13T16:03:33.261 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T16:03:33.586 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903774/remote/smithi107/log 2024-09-13T16:03:33.587 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T16:03:33.741 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T16:03:33.757 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T16:03:33.757 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T16:03:33.761 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T16:03:33.879 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T16:03:33.888 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T16:03:33.888 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T16:03:33.893 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T16:03:33.922 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-09-13T16:03:33.926 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-09-13T16:03:33.928 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T16:03:33.929 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-09-13T16:03:33.929 INFO:teuthology.orchestra.run.smithi070.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 +217us[ +206us] +/- 46ms 2024-09-13T16:03:33.929 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 -495us[ -507us] +/- 62ms 2024-09-13T16:03:33.929 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +279us[ +268us] +/- 90ms 2024-09-13T16:03:33.929 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:03:33.933 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T16:03:33.933 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-09-13T16:03:33.933 INFO:teuthology.orchestra.run.smithi107.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 +259us[ +254us] +/- 46ms 2024-09-13T16:03:33.933 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 -495us[ -500us] +/- 62ms 2024-09-13T16:03:33.933 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +277us[ +277us] +/- 90ms 2024-09-13T16:03:33.933 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:03:33.934 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T16:03:33.948 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T16:03:33.949 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T16:03:33.964 DEBUG:teuthology.orchestra.run.smithi070:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T16:03:34.088 DEBUG:teuthology.orchestra.run.smithi107:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T16:03:34.200 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T16:03:34.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:03:34.261 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T16:03:34.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:03:34.321 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T16:03:34.333 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T16:03:34.342 INFO:teuthology.task.internal:Duration was 590.243194 seconds 2024-09-13T16:03:34.343 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T16:03:34.352 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T16:03:34.352 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T16:03:34.356 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T16:03:34.439 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T16:03:34.444 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T16:03:34.908 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T16:03:34.909 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-09-13T16:03:34.909 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T16:03:34.958 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-09-13T16:03:34.959 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T16:03:35.008 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T16:03:35.008 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T16:03:35.012 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T16:03:35.070 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T16:03:35.070 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T16:03:35.074 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T16:03:35.215 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T16:03:35.225 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T16:03:35.226 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T16:03:35.281 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T16:03:35.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T16:03:35.347 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T16:03:35.352 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T16:03:35.418 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-09-13T16:03:35.422 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-09-13T16:03:35.452 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T16:03:35.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:03:35.486 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T16:03:35.519 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:03:35.520 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T16:03:35.530 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T16:03:35.531 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903774/remote/smithi070 2024-09-13T16:03:35.531 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T16:03:35.595 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903774/remote/smithi107 2024-09-13T16:03:35.595 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T16:03:35.659 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T16:03:35.659 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T16:03:35.663 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T16:03:35.698 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T16:03:35.709 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T16:03:35.710 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T16:03:35.721 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T16:03:35.721 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T16:03:35.738 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T16:03:35.768 INFO:teuthology.orchestra.run.smithi070.stdout: 393687 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 16:03 /home/ubuntu/cephtest 2024-09-13T16:03:35.773 INFO:teuthology.orchestra.run.smithi107.stdout: 393253 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 16:03 /home/ubuntu/cephtest 2024-09-13T16:03:35.775 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T16:03:35.787 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T16:03:35.812 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/cap-flush} duration: 590.2431943416595 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T16:03:35.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T16:03:35.963 INFO:teuthology.run:pass